Skip to content

AI & ML

Fine-tuning

Further training a pre-trained model on a focused dataset so it performs better on a specific task or in a specific style.

Fine-tuning takes a model that already knows language in general and continues training it on a smaller, task-specific dataset so it specialises, in a domain’s vocabulary, a particular format, or a consistent tone. It changes the model’s weights, unlike retrieval, which changes only what you show the model at query time.

It is the right tool when you need consistent behaviour that prompting cannot reliably produce, and the wrong one when your real problem is access to current facts (that is retrieval) or when you have too little quality data to train on. Deciding between fine-tuning and retrieval (often the answer is retrieval), is one of the first real architecture calls in an AI project.

Working out whether you need Fine-tuning?

Definitions are the easy part. If you are trying to decide whether Fine-tuning belongs in your system, describe what you are building and a senior engineer will give you a straight answer, including when the answer is that you do not need it.

  1. 01A senior engineer reads it. Not a form queue, and not an account manager.
  2. 02We reply either with questions or with a straight answer that we are not the right fit.
  3. 03If it looks like a fit, a technical call with the person who would actually run the delivery.
  4. 04Then scope, effort and risk in writing, before anyone signs anything.

Two fields required. We reply to real enquiries. No list, no sequence.