← Dictionary

3. Getting facts right

Chunking

Slicing documents into passage-sized pieces before indexing them for retrieval — because search returns pieces, not whole books. Chunk too small and context is lost; too big and answers drown in irrelevant text.

Why it matters: an unglamorous decision with outsized impact on answer quality. If a RAG system keeps answering from half a thought, the chunking is wrong.

Related: Retrieval