Alignment

RLHF and Model Alignment: Helpful and Safe Models, the Reward Model, and DPO

Why and how do we make a model "helpful and safe"? We explain the three steps of RLHF, the reward model, and the simpler alternative DPO using everyday analogies.