Chunking by Document Type

ai Chunking by Document Type

Code

Document type

Max chunk size 400 tokens

each color is one chunk context attached to the selected chunk cut inside a sentence

Chunk

Exactly what gets embedded and returned to the model. Click any chunk in the document, or use the arrow keys, to inspect it.