The company supports training custom models on user data, continued learning in production, faster and cheaper inference, and ownership of model weights.
Chonkie introduces native chunking and embeddings support for LlamaIndex retrieval pipelines. The integration is powered by Chonkie libraries and brings those capabilities to LlamaIndex pipelines.
Chonkie’s engineering team builds Memchunk, a high-throughput text chunker for retrieval pipelines. It uses single-instruction-multiple-data (SIMD) delimiter search to process text at very high speeds.
Shreyash Nigam and Bhavnick Minhas are building Chonkie, an open-source library that splits large documents into semantically meaningful chunks for retrieval-augmented generation. The founders trace the project to context-window limits they encountered in industry, and Chonkie has progressed into a Y Combinator company.