theblackcat102.github.io
What does LoRA specialized Muon optimizer even mean? - theblackcat102
Testing anpaure's Dimuon variant for LoRA finds it outperforms AdamW at all ranks, with feature-side conditioning as the active ingredient.
One line. Many voicesSeek and you shall find
theblackcat102.github.io
Testing anpaure's Dimuon variant for LoRA finds it outperforms AdamW at all ranks, with feature-side conditioning as the active ingredient.