
PocketFlow is a small Python LLM framework for developers who want to build agents and workflows while choosing their own model providers and supporting tools. Its core has no dependencies and uses the MIT license. It can work with models run locally or through vendor APIs, depending on the application you build.
The framework represents tasks as a graph, with a shared store for passing data between them. That gives developers a common foundation for decision-making agents, chained workflows, and retrieval-augmented generation (RAG), where a model answers using retrieved material. It also supports coordinated agents, structured output, and map-reduce patterns for splitting and combining data tasks.
Batch processing handles groups of inputs, while asynchronous and parallel flows support tasks that spend time waiting on external services. Examples cover chat with conversation history, research agents, document translation, and streaming responses that users can interrupt.
PocketFlow leaves model calls and supporting utilities to the application. It provides examples for web search, embeddings, vector databases, and text-to-speech rather than bundling vendor-specific integrations. This makes it a fit for developers who want control over those choices, though they'll need to supply the connections themselves. Where data goes depends on the models and services they choose.
The project includes guidance for building applications with coding agents such as Cursor AI. It also has TypeScript, Java, C++, Go, Rust, and PHP versions.
Claim this page and we'll verify you by hand. PocketFlow gets the verified badge, and you can upgrade the listing to be featured on localhosted. Proud to be listed? Put our badge on your site.
Want more people to find PocketFlow?Promote it
Something wrong or outdated on this page?
26.6KUpdated 9 hours agoApache-2.0
Docker#Guardrails#Hugging Face integration#Hybrid search
Haystack is a Python framework for developers building self-hosted AI agents, document search, and apps that answer questions using their own data. Its modular pipelines let teams control which information reaches a model and inspect how retrieval, memory, tools, and generation contribute to an answer. It's open source under Apache 2.0.
147.4KUpdated 11 hours agoMIT
#Human approval#RAG#Streaming inference
4.1KUpdated 1 week agoMIT
Docker#LLM tracing#MCP#Multi-agent workflows
3.9KUpdated 1 week agoApache-2.0
Docker · Web#Distributed execution#LoRA#MCP
4.4KUpdated 8 hours agoMIT
#Human approval#Multi-agent workflows#Multimodal input
13KUpdated 1 day agoApache-2.0
Docker#Agent Skills#Hugging Face integration#Knowledge graphs
LangChain is an MIT-licensed open-source framework for developers building AI agents and applications powered by LLMs. It provides a shared interface for models, tools and data connections, so developers can change providers or test workflows without rebuilding the whole application.
Langroid is a Python framework for developers building applications where several AI agents share a task. Each agent can keep its own conversation, use tools, and retrieve documents, while delegating work to other agents. It's open source under the MIT license.
LazyLLM is a Python framework for developers building multi-agent applications with locally deployed models or cloud services. It combines application assembly with data preparation, evaluation and model fine-tuning, so developers can test a prototype and improve the parts that perform poorly. It's open source under Apache 2.0.
RubyLLM is an MIT-licensed AI framework for developers building Ruby and Rails applications with local or hosted models. Its shared API lets an application switch between Ollama, cloud providers such as Anthropic and OpenAI, and OpenAI-compatible endpoints without rewriting its model integration. The framework runs in your application; model processing happens at the local or hosted backend you choose.
txtai is a Python framework for developers building search applications, chat with their data, and AI agents on their own hardware or servers. Its embeddings database combines sparse and dense vector search with graphs and relational data, so the same system can find related content and supply context to language models. It's open source under Apache 2.0.