Update
GPT-4.1 models gain preference fine-tuning
OpenAI added direct preference optimization fine-tuning for the GPT-4.1 family.
The GPT-4.1 family gained direct preference optimization fine-tuning. More control moved from prompt wording into training examples and preferences, useful, but also another layer teams have to evaluate carefully.
Original sourceOpenAI : API changelog ↗