preference tuning

Preference tuning is nowadays often performed through RLHF (Reinforcement Learning From Human Feedback), which refines the supervised fine-tuning stage with preferred stylistic choices.