Skip to content

AI & ML

Retrieval-Augmented Generation (RAG)

A technique that grounds a language model in your own data by retrieving relevant documents at query time and feeding them to the model.

Retrieval-augmented generation is the standard way to make a language model answer from your data rather than only from what it was trained on. Instead of fine-tuning the model, you store your documents in a searchable form, retrieve the most relevant pieces when a question comes in, and include them in the prompt so the model answers from that context.

The appeal is practical: it keeps answers current (update the documents, not the model), it lets the system cite its sources, and it is far cheaper and faster to change than retraining. The difficulty is entirely in the retrieval, if the wrong context is fetched, the model answers confidently and wrongly. Chunking, embedding choice, ranking and evaluation are where a RAG system is actually built.

Working out whether you need Retrieval-Augmented Generation (RAG)?

Definitions are the easy part. If you are trying to decide whether Retrieval-Augmented Generation (RAG) belongs in your system, describe what you are building and a senior engineer will give you a straight answer, including when the answer is that you do not need it.

  1. 01A senior engineer reads it. Not a form queue, and not an account manager.
  2. 02We reply either with questions or with a straight answer that we are not the right fit.
  3. 03If it looks like a fit, a technical call with the person who would actually run the delivery.
  4. 04Then scope, effort and risk in writing, before anyone signs anything.

Two fields required. We reply to real enquiries. No list, no sequence.