Should I fine-tune a model or use RAG to give an LLM my company's knowledge?

We recommend starting with RAG for new knowledge, and fine-tuning only after you have shown that prompting and retrieval fall short. In What We've Learned From a Year of Building with LLMs, we cite studies where RAG beat fine-tuning on both known and new facts. Retrieval indexes are also cheaper to update, easy to purge of bad documents, and can be split so each customer sees only its own data.

Sources: What We've Learned From a Year of Building with LLMs (O'Reilly Radar)

More questions on this topic

All questions about using AI for data and knowledge work