Chunking

Chunking is splitting source documents into smaller passages before embedding them, so retrieval returns focused, relevant text rather than an entire document. Chunk size and overlap are load-bearing decisions — chunks too large dilute relevance and blow the context budget, chunks too small lose the surrounding context a passage needs to make sense. Most RAG accuracy problems trace back to chunking, not the model.

← Back to the full glossary