GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
182
TheFireHacker
TheFireHacker
AI & ML interests
LLM, sub quadraric attention, AI Agents , Synthetic Data
Organizations
TheFireHacker's activity
upvoted
2
papers
7 months ago