AI & ML interests

Deep Learning, Computer Vision, Machine Learning

ariG23498 
posted an update 11 months ago
view post
Post
2744
New post is live!

This time we cover some major updates to transformers.

🤗
  • 2 replies
·
ariG23498 
posted an update about 1 year ago
ariG23498 
posted an update about 1 year ago
view post
Post
1811
🚨 Implement KV Cache from scratch in pure PyTorch. 🚨

We have documented all of our learning while implementing KV Cache to nanoVLM. Joint work with @kashif @lusxvr @andito @pcuenq

Blog: hf.co/blog/kv-cache
  • 1 reply
·
ariG23498 
posted an update over 1 year ago
view post
Post
2866
Tried my hand at simplifying the derivations of Direct Preference Optimization.

I cover how one can reformulate RLHF into DPO. The idea of implicit reward modeling is chef's kiss.

Blog: https://huggingface.co/blog/ariG23498/rlhf-to-dpo
ariG23498 
posted an update over 1 year ago
ariG23498 
posted an update over 1 year ago