Subscribe
Topic

PPO

Proximal Policy Optimization (PPO) is the reinforcement learning algorithm behind classic RLHF. Posts explain PPO's clipped surrogate objective and how reward models, PPO and KL penalties work together to align LLMs.

Articles

1-2