# Deep-Rl-Course

## Docs

- [Monte Carlo vs Temporal Difference Learning [[mc-vs-td]]](https://huggingface.co/learn/deep-rl-course/unit2/mc-vs-td.md)
- [Two types of value-based methods [[two-types-value-based-methods]]](https://huggingface.co/learn/deep-rl-course/unit2/two-types-value-based-methods.md)
- [Second Quiz [[quiz2]]](https://huggingface.co/learn/deep-rl-course/unit2/quiz2.md)
- [Hands-on [[hands-on]]](https://huggingface.co/learn/deep-rl-course/unit2/hands-on.md)
- [Conclusion [[conclusion]]](https://huggingface.co/learn/deep-rl-course/unit2/conclusion.md)
- [A Q-Learning example [[q-learning-example]]](https://huggingface.co/learn/deep-rl-course/unit2/q-learning-example.md)
- [The Bellman Equation: simplify our value estimation [[bellman-equation]]](https://huggingface.co/learn/deep-rl-course/unit2/bellman-equation.md)
- [Introduction to Q-Learning [[introduction-q-learning]]](https://huggingface.co/learn/deep-rl-course/unit2/introduction.md)
- [Mid-way Quiz [[mid-way-quiz]]](https://huggingface.co/learn/deep-rl-course/unit2/mid-way-quiz.md)
- [Glossary [[glossary]]](https://huggingface.co/learn/deep-rl-course/unit2/glossary.md)
- [What is RL? A short recap [[what-is-rl]]](https://huggingface.co/learn/deep-rl-course/unit2/what-is-rl.md)
- [Introducing Q-Learning [[q-learning]]](https://huggingface.co/learn/deep-rl-course/unit2/q-learning.md)
- [Mid-way Recap [[mid-way-recap]]](https://huggingface.co/learn/deep-rl-course/unit2/mid-way-recap.md)
- [Q-Learning Recap [[q-learning-recap]]](https://huggingface.co/learn/deep-rl-course/unit2/q-learning-recap.md)
- [Additional Readings [[additional-readings]]](https://huggingface.co/learn/deep-rl-course/unit2/additional-readings.md)
- [The Deep Q-Learning Algorithm [[deep-q-algorithm]]](https://huggingface.co/learn/deep-rl-course/unit3/deep-q-algorithm.md)
- [Hands-on [[hands-on]]](https://huggingface.co/learn/deep-rl-course/unit3/hands-on.md)
- [Conclusion [[conclusion]]](https://huggingface.co/learn/deep-rl-course/unit3/conclusion.md)
- [Deep Q-Learning [[deep-q-learning]]](https://huggingface.co/learn/deep-rl-course/unit3/introduction.md)
- [Glossary](https://huggingface.co/learn/deep-rl-course/unit3/glossary.md)
- [The Deep Q-Network (DQN)  [[deep-q-network]]](https://huggingface.co/learn/deep-rl-course/unit3/deep-q-network.md)
- [From Q-Learning to Deep Q-Learning [[from-q-to-dqn]]](https://huggingface.co/learn/deep-rl-course/unit3/from-q-to-dqn.md)
- [Additional Readings [[additional-readings]]](https://huggingface.co/learn/deep-rl-course/unit3/additional-readings.md)
- [Quiz [[quiz]]](https://huggingface.co/learn/deep-rl-course/unit3/quiz.md)
- [Conclusion](https://huggingface.co/learn/deep-rl-course/unit8/conclusion-sf.md)
- [Introducing the Clipped Surrogate Objective Function](https://huggingface.co/learn/deep-rl-course/unit8/clipped-surrogate-objective.md)
- [Conclusion [[Conclusion]]](https://huggingface.co/learn/deep-rl-course/unit8/conclusion.md)
- [Introduction [[introduction]]](https://huggingface.co/learn/deep-rl-course/unit8/introduction.md)
- [Introduction to PPO with Sample-Factory](https://huggingface.co/learn/deep-rl-course/unit8/introduction-sf.md)
- [The intuition behind PPO [[the-intuition-behind-ppo]]](https://huggingface.co/learn/deep-rl-course/unit8/intuition-behind-ppo.md)
- [Additional Readings [[additional-readings]]](https://huggingface.co/learn/deep-rl-course/unit8/additional-readings.md)
- [Hands-on](https://huggingface.co/learn/deep-rl-course/unit8/hands-on-cleanrl.md)
- [Visualize the Clipped Surrogate Objective Function](https://huggingface.co/learn/deep-rl-course/unit8/visualize.md)
- [Hands-on: advanced Deep Reinforcement Learning. Using Sample Factory to play Doom from pixels](https://huggingface.co/learn/deep-rl-course/unit8/hands-on-sf.md)
- [How Huggy works [[how-huggy-works]]](https://huggingface.co/learn/deep-rl-course/unitbonus1/how-huggy-works.md)
- [Conclusion [[conclusion]]](https://huggingface.co/learn/deep-rl-course/unitbonus1/conclusion.md)
- [Play with Huggy [[play]]](https://huggingface.co/learn/deep-rl-course/unitbonus1/play.md)
- [Introduction [[introduction]]](https://huggingface.co/learn/deep-rl-course/unitbonus1/introduction.md)
- [Let's train and play with Huggy 🐶 [[train]]](https://huggingface.co/learn/deep-rl-course/unitbonus1/train.md)
- [Live 1: How the course work, Q&A, and playing with Huggy](https://huggingface.co/learn/deep-rl-course/live1/live1.md)
- [An introduction to Multi-Agents Reinforcement Learning (MARL)](https://huggingface.co/learn/deep-rl-course/unit7/introduction-to-marl.md)
- [Hands-on](https://huggingface.co/learn/deep-rl-course/unit7/hands-on.md)
- [Conclusion](https://huggingface.co/learn/deep-rl-course/unit7/conclusion.md)
- [Designing Multi-Agents systems](https://huggingface.co/learn/deep-rl-course/unit7/multi-agent-setting.md)
- [Introduction [[introduction]]](https://huggingface.co/learn/deep-rl-course/unit7/introduction.md)
- [Self-Play: a classic technique to train competitive agents in adversarial games](https://huggingface.co/learn/deep-rl-course/unit7/self-play.md)
- [Additional Readings [[additional-readings]]](https://huggingface.co/learn/deep-rl-course/unit7/additional-readings.md)
- [Quiz](https://huggingface.co/learn/deep-rl-course/unit7/quiz.md)
- [Language models in RL](https://huggingface.co/learn/deep-rl-course/unitbonus3/language-models.md)
- [RLHF](https://huggingface.co/learn/deep-rl-course/unitbonus3/rlhf.md)
- [Generalization in Reinforcement Learning](https://huggingface.co/learn/deep-rl-course/unitbonus3/generalisation.md)
- [Interesting Environments to try](https://huggingface.co/learn/deep-rl-course/unitbonus3/envs-to-try.md)
- [(Automatic) Curriculum Learning for RL](https://huggingface.co/learn/deep-rl-course/unitbonus3/curriculum-learning.md)
- [Student Works](https://huggingface.co/learn/deep-rl-course/unitbonus3/student-works.md)
- [Godot RL Agents](https://huggingface.co/learn/deep-rl-course/unitbonus3/godotrl.md)
- [Introduction](https://huggingface.co/learn/deep-rl-course/unitbonus3/introduction.md)
- [Model Based Reinforcement Learning (MBRL)](https://huggingface.co/learn/deep-rl-course/unitbonus3/model-based.md)
- [Decision Transformers](https://huggingface.co/learn/deep-rl-course/unitbonus3/decision-transformers.md)
- [An Introduction to Unreal Learning Agents](https://huggingface.co/learn/deep-rl-course/unitbonus3/learning-agents.md)
- [Brief introduction to RL documentation](https://huggingface.co/learn/deep-rl-course/unitbonus3/rl-documentation.md)
- [Offline vs. Online Reinforcement Learning](https://huggingface.co/learn/deep-rl-course/unitbonus3/offline-online.md)
- [Hands on](https://huggingface.co/learn/deep-rl-course/unit4/hands-on.md)
- [The advantages and disadvantages of policy-gradient methods](https://huggingface.co/learn/deep-rl-course/unit4/advantages-disadvantages.md)
- [Conclusion](https://huggingface.co/learn/deep-rl-course/unit4/conclusion.md)
- [(Optional) the Policy Gradient Theorem](https://huggingface.co/learn/deep-rl-course/unit4/pg-theorem.md)
- [Diving deeper into policy-gradient methods](https://huggingface.co/learn/deep-rl-course/unit4/policy-gradient.md)
- [Introduction [[introduction]]](https://huggingface.co/learn/deep-rl-course/unit4/introduction.md)
- [Glossary](https://huggingface.co/learn/deep-rl-course/unit4/glossary.md)
- [Additional Readings](https://huggingface.co/learn/deep-rl-course/unit4/additional-readings.md)
- [What are the policy-based methods?](https://huggingface.co/learn/deep-rl-course/unit4/what-are-policy-based-methods.md)
- [Quiz](https://huggingface.co/learn/deep-rl-course/unit4/quiz.md)
- [Hands-on [[hands-on]]](https://huggingface.co/learn/deep-rl-course/unitbonus2/hands-on.md)
- [Introduction [[introduction]]](https://huggingface.co/learn/deep-rl-course/unitbonus2/introduction.md)
- [Optuna Tutorial [[optuna]]](https://huggingface.co/learn/deep-rl-course/unitbonus2/optuna.md)
- [Advantage Actor Critic (A2C) using Robotics Simulations with Panda-Gym 🤖 [[hands-on]]](https://huggingface.co/learn/deep-rl-course/unit6/hands-on.md)
- [Advantage Actor-Critic (A2C) [[advantage-actor-critic]]](https://huggingface.co/learn/deep-rl-course/unit6/advantage-actor-critic.md)
- [Conclusion [[conclusion]]](https://huggingface.co/learn/deep-rl-course/unit6/conclusion.md)
- [Introduction [[introduction]]](https://huggingface.co/learn/deep-rl-course/unit6/introduction.md)
- [Additional Readings [[additional-readings]]](https://huggingface.co/learn/deep-rl-course/unit6/additional-readings.md)
- [Quiz](https://huggingface.co/learn/deep-rl-course/unit6/quiz.md)
- [The Problem of Variance in Reinforce [[the-problem-of-variance-in-reinforce]]](https://huggingface.co/learn/deep-rl-course/unit6/variance-problem.md)
- [The Pyramid environment](https://huggingface.co/learn/deep-rl-course/unit5/pyramids.md)
- [Hands-on](https://huggingface.co/learn/deep-rl-course/unit5/hands-on.md)
- [(Optional) What is Curiosity in Deep Reinforcement Learning?](https://huggingface.co/learn/deep-rl-course/unit5/curiosity.md)
- [Conclusion](https://huggingface.co/learn/deep-rl-course/unit5/conclusion.md)
- [Bonus: Learn to create your own environments with Unity and MLAgents](https://huggingface.co/learn/deep-rl-course/unit5/bonus.md)
- [An Introduction to Unity ML-Agents [[introduction-to-ml-agents]]](https://huggingface.co/learn/deep-rl-course/unit5/introduction.md)
- [The SnowballTarget Environment](https://huggingface.co/learn/deep-rl-course/unit5/snowball-target.md)
- [Quiz](https://huggingface.co/learn/deep-rl-course/unit5/quiz.md)
- [How do Unity ML-Agents work? [[how-mlagents-works]]](https://huggingface.co/learn/deep-rl-course/unit5/how-mlagents-works.md)
- [Getting started:](https://huggingface.co/learn/deep-rl-course/unitbonus5/getting-started.md)
- [Conclusion:](https://huggingface.co/learn/deep-rl-course/unitbonus5/conclusion.md)
- [The environment](https://huggingface.co/learn/deep-rl-course/unitbonus5/the-environment.md)
- [Introduction:](https://huggingface.co/learn/deep-rl-course/unitbonus5/introduction.md)
- [(Optional) How to customize the environment](https://huggingface.co/learn/deep-rl-course/unitbonus5/customize-the-environment.md)
- [Train our robot](https://huggingface.co/learn/deep-rl-course/unitbonus5/train-our-robot.md)
- [The certification process](https://huggingface.co/learn/deep-rl-course/communication/certification.md)
- [Congratulations](https://huggingface.co/learn/deep-rl-course/communication/conclusion.md)
- [Train your first Deep Reinforcement Learning Agent 🤖 [[hands-on]]](https://huggingface.co/learn/deep-rl-course/unit1/hands-on.md)
- [The “Deep” in Reinforcement Learning [[deep-rl]]](https://huggingface.co/learn/deep-rl-course/unit1/deep-rl.md)
- [The Exploration/Exploitation trade-off [[exp-exp-tradeoff]]](https://huggingface.co/learn/deep-rl-course/unit1/exp-exp-tradeoff.md)
- [Conclusion [[conclusion]]](https://huggingface.co/learn/deep-rl-course/unit1/conclusion.md)
- [Summary [[summary]]](https://huggingface.co/learn/deep-rl-course/unit1/summary.md)
- [Introduction to Deep Reinforcement Learning [[introduction-to-deep-reinforcement-learning]]](https://huggingface.co/learn/deep-rl-course/unit1/introduction.md)
- [Glossary [[glossary]]](https://huggingface.co/learn/deep-rl-course/unit1/glossary.md)
- [What is Reinforcement Learning? [[what-is-reinforcement-learning]]](https://huggingface.co/learn/deep-rl-course/unit1/what-is-rl.md)
- [Additional Readings [[additional-readings]]](https://huggingface.co/learn/deep-rl-course/unit1/additional-readings.md)
- [Quiz [[quiz]]](https://huggingface.co/learn/deep-rl-course/unit1/quiz.md)
- [The Reinforcement Learning Framework [[the-reinforcement-learning-framework]]](https://huggingface.co/learn/deep-rl-course/unit1/rl-framework.md)
- [Two main approaches for solving RL problems [[two-methods]]](https://huggingface.co/learn/deep-rl-course/unit1/two-methods.md)
- [Type of tasks [[tasks]]](https://huggingface.co/learn/deep-rl-course/unit1/tasks.md)
- [Setup [[setup]]](https://huggingface.co/learn/deep-rl-course/unit0/setup.md)
- [Welcome to the 🤗 Deep Reinforcement Learning Course [[introduction]]](https://huggingface.co/learn/deep-rl-course/unit0/introduction.md)
- [Discord 101 [[discord-101]]](https://huggingface.co/learn/deep-rl-course/unit0/discord101.md)
