Zachary Garrett

ZacharyGarrett's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 2 papers 8 months ago

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Paper • 2501.18512 • Published Jan 30 • 30

Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo

Paper • 2503.09799 • Published Mar 12 • 15

authored a paper over 1 year ago

FAX: Scalable and Differentiable Federated Primitives in JAX

Paper • 2403.07128 • Published Mar 11, 2024 • 13