What is Instruction Tuning?
AI EngineeringLast updated:
Fine-tuning a language model on instruction-response pairs so it follows natural language directions reliably.
Instruction tuning transforms a raw pre-trained model into a helpful assistant by training on diverse instruction-following examples. Models like FLAN-T5, Alpaca, and Vicuna demonstrated that instruction tuning dramatically improves usability.