RAG Frameworks, Parsers and Vector Databases

What you need to build retrieval-augmented generation (RAG) yourself: pipeline frameworks, document parsers, embedding servers and vector databases.

Subcategories

100+ tools
A local-first AI e-book reader with offline-capable search, book chat through Ollama or cloud providers, and desktop and mobile apps.

3KUpdated 1 month ago

macOS · Windows · Linux · iOS · Android#Hybrid search#Multilingual#Ollama integration

A local embedding pipeline turns documents and media into search vectors with Candle and ONNX backends, GPU support and vector database adapters.

1.3KUpdated 3 weeks agoApache-2.0

Windows · Docker#Batch processing#Hugging Face integration#Multimodal input

A self-hosted multimodal retrieval engine that searches visual documents with ColPali and connects to AI applications through an API or MCP.

3.7KUpdated 3 weeks ago

Docker · Web#MCP#Multi-user access#Multimodal input

Favicon of MaxKB

MaxKB

1 video
A self-hosted AI agent platform that combines document Q&A, workflows and MCP tools with privately deployed models or cloud providers.

23.2KUpdated 2 days agoGPL-3.0

Docker · Web#MCP#Multimodal input#RAG

Favicon of PrivateGPT

PrivateGPT

1 video
An Apache 2.0 local AI API adds document retrieval, citations and agent tools to Ollama, llama.cpp and other OpenAI-compatible model servers.

57.6KUpdated 1 day agoApache-2.0

Docker · Web#Code execution#llama.cpp backend#MCP

Favicon of Onyx

Onyx

3 videos
A self-hosted AI search and chat platform that connects company knowledge to employees and agents, with local model support and air-gapped deployment.

33.4KUpdated 21 hours ago

Docker · Web · Browser Extension#MCP#Multi-user access#Ollama integration

A self-hosted AI assistant API that answers questions from project docs and GitHub issues, with Ollama support and Discord and Slack integrations.

260Updated 3 months agoMIT

Docker · Web#Hybrid search#LLM tracing#Ollama integration

Favicon of Open WebUI

Open WebUI

39 videos
A self-hosted AI chat interface that works offline with local models and connects to Ollama, OpenAI-compatible APIs and cloud providers.

158.6KUpdated 6 days ago

Docker · Web#Code execution#Human approval#Hybrid search

A Home Assistant integration that connects conversation agents and AI tasks to local OpenAI-compatible LLM servers, with streamed voice responses.

310Updated 2 days agoApache-2.0

#Home Assistant integration#Hybrid search#llama.cpp backend

Self-hosted document Q&A that runs locally with Ollama, including on Raspberry Pi. MIT licensed, with optional OpenAI and Anthropic backends.

0Updated 6 months agoMIT

macOS · Windows · Linux · Docker · Web#Ollama integration#RAG#Semantic search

A self-hosted LLM serving platform that uses llama.cpp for CPU and GPU inference, with load balancing and a web admin panel.

1.7KUpdated 1 week agoApache-2.0

Web#Distributed execution#llama.cpp backend#Multimodal input

A self-hosted web extraction API converts pages and documents to Markdown or JSON for LLMs, with Apache 2.0 code, Docker and a hosted service.

12.3KUpdated 6 months agoApache-2.0

Docker#Multimodal input#Structured output

An open-source AI development toolkit for OCR, computer vision and time-series models, with local CPU or GPU inference and self-hosted deployment.

6.3KUpdated 5 months agoApache-2.0

Windows · Linux · Docker#Multilingual#ONNX

Favicon of LangExtract

LangExtract

2 videos
A Python library extracts structured data from text with source links and visual review, using local models through Ollama or cloud models.

39.3KUpdated 5 days agoApache-2.0

Windows · Docker#Ollama integration#OpenAI-compatible API#Source citations

Self-hosted document chat that runs in Docker with Ollama or an OpenAI-compatible API, plus ChatGPT and Claude integrations. Open source under MPL-2.0.

1.1KUpdated 10 months agoMPL-2.0

Docker · Web#MCP#Ollama integration#OpenAI-compatible API

A self-hosted RAG framework for document Q&A, with offline Ollama support, interchangeable search backends and an OpenAI-compatible API.

125Updated 1 week agoMIT

Docker · Web#Hybrid search#Knowledge graphs#MCP

A self-hosted knowledge base that builds Markdown wikis and knowledge graphs, with an offline workflow and optional local LLMs through Ollama.

735Updated 5 months agoMIT

Web#Human approval#Hybrid search#Knowledge graphs

Favicon of OpenRAG

OpenRAG

1 video
Self-hosted AI document search and chat built on Langflow, OpenSearch, and Docling, with editable workflows and an Apache 2.0 license.

4.7KUpdated 3 days agoApache-2.0

Docker · Web#Hybrid search#MCP#Multi-agent workflows

A local AI resume scoring tool ranks PDF applications with editable role rubrics and evidence for each score, using Ollama or cloud models.

7.4KUpdated 1 month agoMIT

macOS · Windows · Linux#Ollama integration#OpenAI-compatible API#Structured output

Favicon of Surya

Surya

1 video
Local OCR software extracts multilingual text, page layouts and tables from documents on CPU, Apple Silicon or NVIDIA GPUs.

21.6KUpdated 2 days agoApache-2.0

macOS · Web#Batch processing#llama.cpp backend#Multilingual

Favicon of Genkit

Genkit

1 video
An open-source AI app framework connects to Ollama, Gemini and OpenAI, with self-hosted application logic, tool calling and structured output.

6.6KUpdated 1 day agoApache-2.0

Web#LLM tracing#Multimodal input#Ollama integration

An open-source image classification and recognition toolkit supports custom model training, image retrieval, and server or on-device deployment.

5.9KUpdated 1 month agoApache-2.0

Android#ONNX#Quantization#Semantic search

Favicon of Verba

Verba

1 video
Self-hosted document chatbot that uses Weaviate and supports local models through Ollama; the BSD-3-Clause project is archived and no longer maintained.

7.7KUpdated 5 months agoBSD-3-Clause

Windows · Docker · Web#Hugging Face integration#Hybrid search#Ollama integration

Favicon of Flowise

Flowise

3 videos
A self-hosted visual AI agent builder with knowledge retrieval, human review and application APIs; the project is archived and no longer maintained.

55.6KUpdated 3 months ago

Docker · Web#Human approval#LLM tracing#Multi-agent workflows

A self-hosted Python library for PostgreSQL RAG and semantic search with Ollama support; the open-source project is archived and no longer maintained.

5.8KUpdated 6 months agoPostgreSQL

Docker#Batch processing#Ollama integration#RAG

A self-hosted RAG framework answers questions about your documents using NVIDIA NIM models, with multimodal extraction and optional agentic search.

823Updated 2 weeks agoApache-2.0

Docker · Web#Agent Skills#Guardrails#Hybrid search

A self-hosted RAG framework answers questions from documents using Ollama and local embeddings; it's Apache 2.0 licensed, archived and no longer maintained.

4.4KUpdated 8 months agoApache-2.0

Docker · Web#Batch processing#Multimodal input#Ollama integration

A self-hosted chatbot builder turns a local file or web page into a question-answering agent, with OpenAI defaults and local Hugging Face model support.

6.5KUpdated 3 years agoMIT

Web#Hugging Face integration#RAG#Semantic search

Favicon of LogotyperLogotyper
Got an idea for an AI tool? I'm Eugene, the designer and developer behind Localhosted. I'll help you build it, from the first sketch to launch.
Start your project
Favicon of Logotyper
Favicon of LogotyperLogotyper
Got an idea for an AI tool? I'm Eugene, the designer and developer behind Localhosted. I'll help you build it, from the first sketch to launch.
Start your project
Favicon of Logotyper