MegaTrain: Full Precision Training of 100B+ Parameter LLMs on a Single GPU

Heykuki News

326 points

3 months ago

57 comments

Threaded

Loading comments...

MegaTrain: Full Precision Training of 100B+ Parameter LLMs on a Single GPU | Heykuki News