PhysiQuanty's picture

Open to Collab

PhysiQuanty PRO

PhysiQuanty

·

AI & ML interests

Theoretical Physics, Meta Deep Learning

Recent Activity

reacted to rob-x-ai's post with 🔥 about 16 hours ago

Genesis 1B is now public. 🔥 I’m training a 1.003B parameter model from scratch on 2× RTX 4090s and opened a public playground for early checkpoints. The real bottleneck wasn’t training. It was checkpointing: FSDP full-state gather over PCIe = NCCL timeout hell Switching to DCP sharded checkpoints changed the trajectory of the run. - Playground: https://huggingface.co/spaces/rob-x-ai/genesis-1b-playground - Write-up: https://kroonen.ai/blog/distributed-checkpoint-failures-rtx4090/

liked a dataset about 18 hours ago

Shrijanagain/SKT-OMNI-CORPUS-146T-V1

liked a dataset 1 day ago

open-index/hacker-news

View all activity

Organizations

New activity in OpenTransformer/AGILLM-3-large-v2 6 days ago

FSDP or DDP

#1 opened 6 days ago by

FSDP or DDP

#1 opened 6 days ago by