LLPhant is an MIT-licensed PHP framework for adding language models, embeddings and vector databases to Symfony and Laravel applications. It requires PHP 8.1 or later and is installed through Composer.
Local model connections include Ollama, LM Studio and llmman. It also connects to LocalAI and other services with an OpenAI-compatible API. Cloud providers include OpenAI, Anthropic, Mistral and Atlas Cloud. Processing follows the selected backend: local connections can use your own hardware, while cloud connections send requests to that provider.
For retrieval-augmented answers, its QuestionAnswering class searches a vector store for relevant private documents and passes the retrieved material to a language model. The documented workflow reads files, splits them into chunks and embeds them before retrieval.
Its JevClassifier integration provides typed classification through the Jev API and requires an API key. It supports Noul and Choice questions and rubric-based Score questions, with input and output token usage returned alongside answers. Documentation is available in the repository and on Read the Docs.
Claim this page and we'll verify you by hand. LLPhant gets the verified badge, and you can upgrade the listing to be featured on localhosted. Proud to be listed? Put our badge on your site.
Want more people to find LLPhant?Promote it
Something wrong or outdated on this page?
4.4KUpdated 1 day agoMIT
#Human approval#Multi-agent workflows#Multimodal input
RubyLLM is an MIT-licensed AI framework for developers building Ruby and Rails applications with local or hosted models. Its shared API lets an application switch between Ollama, cloud providers such as Anthropic and OpenAI, and OpenAI-compatible endpoints without rewriting its model integration. The framework runs in your application; model processing happens at the local or hosted backend you choose.
26.6KUpdated 1 day agoApache-2.0
Docker#Guardrails#Hugging Face integration#Hybrid search
13.2KUpdated 1 day agoApache-2.0
#MCP#Ollama integration#RAG
9.7KUpdated 9 months agoMIT
#Ollama integration#RAG#Semantic search
52.4KUpdated 2 days agoMIT
#Ollama integration#RAG#Reranking
5.8KUpdated 4 months agoPostgreSQL
Docker#Batch processing#Ollama integration#RAG
Haystack is a Python framework for developers building self-hosted AI agents, document search, and apps that answer questions using their own data. Its modular pipelines let teams control which information reaches a model and inspect how retrieval, memory, tools, and generation contribute to an answer. It's open source under Apache 2.0.
LangChain4j is an Apache 2.0 open-source Java library for developers building chatbots, assistants and AI agents in JVM applications. It connects application code to local LLM backends such as Ollama as well as cloud providers such as OpenAI and Google Vertex AI. Where model requests go depends on the backend you choose.
LangChainGo is a Go implementation of LangChain for developers building LLM applications in their own software. It connects Go programs to model backends, including Ollama for local LLM use and cloud services such as OpenAI and Gemini. It's a library, so its audience is developers who want to build an application rather than use a ready-made chat interface.
LlamaIndex is an MIT-licensed Python framework for developers building AI agents and apps that answer questions using their own data. It connects documents and other sources to language models, then helps an app find the relevant material when a user asks something. Its open source framework can work with models served through Ollama.
pgai keeps search embeddings in sync with PostgreSQL data for developers building RAG applications and AI agents. It's a Python library with database components and workers you can self-host, including in Docker. The project is archived and no longer maintained or supported. Its code is open source under the PostgreSQL License.