Skip to content
memoDwarves Foundation

Writers/Fellow

thanhpn

Former Blockchain

13 notes since 2022, 0 in the last 12 months.

Written at Dwarves

Latest
  • 3 Jul 2024
    Proximal policy optimization

    Proximal policy optimization (PPO) is an algorithm that aims to improve the stability of training by avoiding overly large policy updates. It is a popular and effective method used for training [ reinforcement learning](#wikilink:Reinforcement%20Learning) models in complex environments. To achieve this, PPO uses a ratio that indicates the difference between the current policy and the old policy and clips this ratio within a specific range, ensuring that the policy updates are not too large and the training process is more stable...

  • 23 Jun 2023
    Reward model

    A Reward model is a critical component in Reinforcement Learning for Large Language Models (LLMs), designed to evaluate and score the quality of generated responses. It plays a key role in aligning LLMs with human values and improving their output through iterative refinement.

  • 22 Jun 2023
    Q learning

    An introduction to Q-learning, a model-free reinforcement learning algorithm used to learn optimal policies in Markov Decision Processes.

All notes

13