What is Chunking?
AI EngineeringLast updated:
Splitting documents into smaller segments for embedding and retrieval in RAG pipelines.
Chunking strategy significantly impacts RAG quality. Common approaches include fixed-size chunks with overlap, sentence-based splitting, semantic chunking, and recursive splitting by document structure. Typical chunk sizes range from 256 to 1024 tokens.