nanochat d24 training checkpoints (2026-08-29)

Full intermediate checkpoint trajectories for three nanochat d24 pretraining runs.

folder run steps saved model_*.pt
d24/ base every 50 steps, up to 5568 112
d24_6shard_10ep/ 6-shard, 10 epochs every 26 steps, up to 2590 100
d24_13shard_10ep/ 13-shard, 10 epochs every 56 steps, up to 5600 100

Each folder contains:

  • model_XXXXXX.pt โ€” model weights at that step (~3.9 GB each)
  • optim_XXXXXX_rank{0..7}.pt โ€” optimizer state at the final step (resume training)
  • meta_XXXXXX.json โ€” per-checkpoint metadata
  • val_metrics.jsonl โ€” validation curve for the run
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support