RAG Frameworks, Parsers and Vector Databases

Codebase Memory MCP maps a repository's structure so AI coding agents can explore dependencies without repeatedly reading whole files. It's for developers using Claude Code, Codex CLI, Cursor or other MCP-compatible clients.

OpenDataLoader PDF is a PDF parser for developers building document search and retrieval-augmented generation systems. It preserves document structure and source locations so applications can retrieve passages and point readers back to the original page.

FalkorDB is a self-hosted graph database for developers building GraphRAG applications and AI agents that retrieve connected facts. It stores entities, relationships and their attributes, with Cypher queries and vector search for finding relevant information. Docker runs the database on your own hardware; a separate hosted cloud service is also available.

localGPT is a self-hosted document chat app for people who want to ask questions about files and summarise them on their own hardware. Its local processing keeps document content and chat data on the machine running the app.

xberg, formerly Kreuzberg, is a local document extraction engine for developers building AI search and document processing applications. It turns files into text and structured content that those applications can use.

Captain Memo gives developers a shared memory across coding assistants, so project decisions and lessons remain available between sessions and tools. Claude Code, Codex, Gemini CLI, Cursor and other MCP-compatible assistants can access the same corpus.

ColPali is a document retrieval library for developers and researchers building search or retrieval-augmented generation systems. It matches text queries to page images, using visual content alongside text. The colpali-engine package is deprecated, and maintainers recommend Sentence Transformers for new projects and production use.

Yuxi is a self-hosted AI agent platform for teams that need answers from their documents and agents that can carry out multi-step work. Its browser workspace brings knowledge sources, task progress and generated files into the same conversation.

Typesense is a self-hosted search engine for developers building site search, product catalogs or AI search over their own data. It combines keyword matching with searches based on meaning.

RESTai is a self-hosted AI platform for developers and teams building document assistants, agents and AI services for other applications. Its web interface manages projects with separate models, prompts and tools, plus a chat playground for testing them.

BotSharp is a C# framework for .NET developers building AI assistants into business applications. It coordinates agents with different responsibilities and keeps track of conversation state.

ParadeDB adds search to the Postgres database that holds your application data. It's for developers building search or AI retrieval who want to keep queries and data in one database without synchronizing a separate search service.

Kaito manages LLM inference, fine-tuning and document retrieval services in Kubernetes. It's for teams that want to run models in their own cluster with less manual work sizing GPU capacity and managing deployments.

DocsGPT helps teams search company documents and build AI assistants that answer from those materials. It can run inside your network with local models, including an air-gapped deployment where documents and questions stay within that network.

Gensim is a free, open-source Python library for developers and researchers working with large text collections on their own machines or servers. It trains models that capture topics and semantic relationships, then uses those representations to find related documents. It runs on Linux, Windows and macOS under the GNU Lesser General Public License v2.1 (LGPL-2.1).

Unstract is a self-hosted, no-code platform for teams that need structured data from documents whose layouts vary. It uses LLMs to extract JSON from PDFs, images, scans and office files without building a template for each vendor or form. Its use cases include finance, insurance, healthcare and KYC document processing.

HelixDB is a database for developers building AI agent memory and retrieval-augmented generation (RAG). It keeps entities, relationships, embeddings, and text together so applications can search both content and its connections.

MTPLX is a native Mac app, command-line tool and local LLM server for people running chat or coding models on Apple Silicon. It uses a model's own multi-token prediction heads to accelerate generation without a separate draft model.

Nougat is a local AI PDF parser for researchers and developers who need to extract content from academic papers. It handles LaTeX math and tables alongside the paper's text.

pgvector adds vector similarity search to Postgres for developers building applications that need to find related items. It keeps embeddings alongside application records, so vector searches can use the same database as the rest of your data.

haiku.rag lets you search your own documents and ask questions with answers you can check against the original pages. It's for people building a private document library or giving an AI assistant access to their files.

Xinference serves AI models on your own computer or servers for developers and researchers building applications around models they control. It brings chat, document search and media generation into one platform.

HippoRAG is a Python memory and retrieval framework for developers building LLM applications that need to connect facts across documents. It uses a knowledge graph to find related information for questions that require several pieces of evidence.

Cognee gives AI agents memory across sessions so they can reuse project context, decisions, and lessons from earlier work. It's for developers building agents and teams whose knowledge sits across documents, code, and conversations.

TabbyAPI is a self-hosted LLM API server for people who want to run ExLlamaV3 models on their own hardware. It’s built for personal projects and small groups; its maintainers don’t recommend it for production servers.

RAGatouille is a Python library for developers building retrieval-augmented generation (RAG) applications with ColBERT. It builds and searches document indexes on your own hardware or server, with compressed indexes stored on disk that your application can query directly.

RAG Web UI is a self-hosted app for asking questions about your own documents. It's a learning project, and its maintainers advise against commercial use and state that it isn't ready for production.

LightRAG is a self-hosted framework for developers building AI assistants that answer questions across documents. It connects related facts across files, including material where relationships matter, such as legal and financial records.

FlyMD is a Markdown editor for people who keep notes, write long documents or publish blogs. It stores documents locally and adds writing assistance and document tools through extensions.

DSPy is a Python framework for developers building language model applications with local backends such as Ollama on a laptop or SGLang on a GPU server. It connects application code to those model servers, which handle inference on your hardware. It also supports cloud providers, so where model requests go depends on the backend you choose.

DeepSeek-OCR is an OCR model for developers processing document images and PDFs on their own hardware. It also supports research into visual text compression, representing text-bearing images with compact sets of vision tokens.

Pyserini is an open-source Python toolkit for researchers and developers comparing document search methods or building the retrieval stage of a ranking or RAG system. It runs as a Python package on your own hardware and lets you search existing benchmark indexes or build indexes from your own documents. Its license is Apache 2.0.

Tiledesk is an AI chatbot and live chat platform for teams handling customer support and internal information searches. Its visual builder lets teams design conversations and automated workflows without writing code.

RubyLLM is an AI framework for Ruby and Rails developers building chat and agent features into their applications. Its shared API lets you switch between local and hosted models without writing a separate integration for each provider.