Decoupled DiLoCo for Resilient Distributed Pre-Training [pdf]storage.googleapis.com3 pointsgnabgib2 months ago