Latest Open Source Projects

chonkie

2,300

chonkie

TLDR: Chonkie is a lightweight and fast RAG chunking library with various chunkers. It offers features like minimal default installs and supports multiple tokenizers. It has better size and speed compared to alternatives.

ai chunking rag retrieval-augmented-generation text-processing Python

2024-11-01 Github

FlagEmbedding

8,300

@FlagOpen

FlagEmbedding

TLDR: FlagEmbedding focuses on retrieval-augmented LLMs and consists of multiple projects including inference, finetune, evaluation, dataset, tutorials, and research. It offers various embedding and reranker models for different languages and tasks.

embeddings information-retrieval llm retrieval-augmented-generation sentence-embeddings text-semantic-similarity Python

2023-08-02 Github