Tools tagged with "Multimodal input"

UltraRAG is a self-hosted framework for researchers and developers building AI systems that answer questions using their own documents. Its Python application and Docker deployment provide a browser workspace for knowledge bases, workflow design and evaluation. Generation can use local models through vLLM or Hugging Face. Embeddings can use local Sentence Transformers or a configured OpenAI service; the OpenAI cloud connection sends embedding inputs to that service.

Agent QA is a source-available AI testing agent for developers and software teams testing web, Android and iOS apps. You describe a user journey and its expected results in plain English. It tests the real interface and carries observations from earlier runs into later ones, so it can account for how your app behaves.

Locally AI is a native assistant for people who want to use language and vision models on their own Apple devices. It handles text, images and spoken conversations without sending AI processing to a cloud service.

SimpleMem is a memory system for developers building AI agents that need to recall past conversations and stored media without passing the full history to a model each time.

New API is a self-hosted AI gateway for developers and teams sharing access to multiple model providers. It lets apps and agents keep one connection while administrators change upstream services.

WebVoyager is a Python AI agent that controls a browser on your machine or a Linux server to carry out tasks on live websites. It's a research project for developers studying browser automation. Model decisions depend on OpenAI's cloud API, which receives page observations and requires an API key and internet access; the local browser doesn't provide local model inference.

Director's Console is a self-hosted workspace for filmmakers and AI artists who want to develop shot prompts, generate media through ComfyUI, and organize the results by project.

Cherry Studio is a desktop AI chat app for people who use several model providers and want one place to manage their conversations. It supports local model connections as well as cloud services.

LatentSync is an open-source AI lip-sync tool for video creators and researchers who want a face's mouth movements to match supplied audio. It processes video on your own GPU, with demos covering filmed faces and anime characters.

TensorSharp runs local AI models for .NET developers and people who want chat, media generation and agent tools on their own hardware. You can embed it in a C# application or use its CLI, browser interface or companion app, TensorAgent.

AstrBot is an AI chatbot platform for personal assistants, customer support bots and team automation inside messaging apps. You can host it on your own computer or server and choose a local or cloud model backend.

LobeHub is an AI agent workspace for individuals and teams assigning ongoing work to multiple assistants. It keeps agents, their tasks and shared material together, with hosted and self-hosted options.

Procedura generates 3D assemblies for people who want to revise the resulting model in code. Each assembly is a parametric program with named parts and defined connections, so you can edit its source and compile the geometry again.

FramePack is a desktop app for creating AI video from a still image and a written motion prompt. It's for people who want to animate images on their own hardware and inspect the clip while generation is still running.

Prismos AI is a desktop assistant for people working with private documents and technical files. It uses local Ollama models to answer questions and retain knowledge for later conversations.

Meilisearch is a search engine for developers adding search and AI retrieval to websites, apps, catalogs or internal data. You can host the engine on your own server or use the separate managed Meilisearch Cloud service.

Kimi Code CLI is a locally installed AI coding agent for developers who want an agent to work directly on their projects. File edits and shell commands run on your computer; its default Kimi connection sends model requests to Moonshot AI's hosted API. That connection needs internet access and Kimi Code OAuth or an API key.

UFO³ is a self-hosted AI agent framework for developers and researchers automating tasks across Windows, Linux and Android devices. Its Galaxy coordinator splits a request into connected tasks, assigns them to suitable devices and tracks work that depends on results from another machine. The Python project is open source under the MIT license.

NVIDIA Dynamo is a self-hosted inference framework for teams serving generative AI models across multiple GPUs or server nodes. It coordinates inference engines so teams can manage capacity, response latency and cached context across a cluster.

Soul-of-Waifu is an AI companion app for creating characters and roleplaying with them. A character carries the same personality and memories between conversations, RPG campaigns and a desktop companion.

kotaemon is an open source document chat app for people who want to ask questions across their files and inspect the evidence behind an answer. Developers can also use it to build custom document question-answering applications.

Browser4 is a browser automation engine for developers building AI agents, web research tools, and data collection workflows. It controls real Chrome browsers and handles interactive pages that require clicks, forms, or JavaScript before their data is accessible.

RAG-Anything is a Python framework for developers building question-answering systems over documents that mix prose with visual or structured content. Built on LightRAG, it suits research papers, technical manuals and financial reports where answers depend on figures, tables or formulas.

Transformers.js is a JavaScript library for developers adding on-device AI to web apps. It runs models in the browser, so processing inputs doesn't require a separate inference server.

Llama Desktop runs language models on your computer for private chat and use in other apps. It's for people who want a local ChatGPT alternative and developers connecting coding agents, editors or scripts to their own models.

WebBrain is an AI browser agent for people who want to ask questions about pages or delegate web tasks from a sidebar. It works in your existing browser, including signed-in tabs, and starts in read-only Ask mode.

Screenpipe records computer activity so people can revisit past work and give AI agents context from screens and conversations. Capture history stays on your device by default.

Chatbox is an AI chat app for people who want to use local models and cloud providers in one interface. It supports Ollama for local LLM use, plus GPT, Claude, Gemini, Grok and DeepSeek with your own API keys.

FlagEmbedding is a Python toolkit for developers building semantic search and retrieval-augmented generation (RAG). It runs embedding models to find relevant text and rerankers to refine the order of retrieved results.

DEEIX Chat is a self-hosted AI workspace for individuals and teams that want one place to use multiple model providers. It combines everyday chat with controls for organizations managing shared model access and usage.

EchoMimic turns a portrait and an audio recording into a talking-head video on your own hardware. It's intended for academic research into speech animation and controlled facial movement.

vllm-mlx is a local LLM inference server for developers who want to connect AI apps and coding assistants to models running on an Apple Silicon Mac. One process exposes both OpenAI-compatible and Anthropic-compatible APIs. It's open source under Apache 2.0 and runs on macOS with at least 8 GB of unified memory.

Vibe-Research is a local financial research workbench for individual investors, with a Chinese-language browser interface and backend on your computer. It saves documents, research records and task state locally, while subscription services or model APIs supply AI reasoning. Relevant document passages go to the selected model, so local storage doesn't make the workflow offline.

Google AI Edge Gallery is a local AI app for people who want to use and compare generative models on their own devices. Model inference runs on-device, including offline chat and media tasks.