🤝 Open to Collab
Carlos García
cgarciams
·
AI & ML interests
Building a GPT-2 medium size (approx. 400 M parameters) model from scratch, using PyTorch, the OpenWebText dataset, Tiktoken, AdamW optimizer and FlashAttention. Just for fun.
Recent Activity
upvoted an article 28 days ago
Adding MCP Tools to Reachy Mini liked a dataset 28 days ago
Skylion007/openwebtext liked a dataset 28 days ago
tatsu-lab/alpaca