Tools tagged with "Multimodal input"

GenericAgent runs tasks on your computer using cloud models to decide what to do. It's for people who want an AI agent to work across websites, files and desktop apps, then save successful workflows for reuse. Model calls require API keys and an internet connection, with requests going to the selected provider. It supports Claude, Gemini, Kimi and MiniMax.

gptel is an Emacs LLM client for people who want model responses alongside their writing and code. It connects to local inference backends including Ollama, llama.cpp, Llamafile and GPT4All. The client runs in Emacs; cloud connections such as OpenAI, Anthropic and Gemini send requests to those providers and require their credentials.

CDAF saves reusable text descriptions alongside videos so AI agents don't have to analyze the same footage for every task. It's for developers building video agents and editors that repeatedly search or ask questions about a clip library.

XTuner is an LLM training engine for researchers working with very large mixture-of-experts (MoE) models. Its focus is reducing memory pressure and improving distributed training efficiency when model experts receive uneven workloads.

Mochi Diffusion is a native macOS app for people who want to generate images on their own Mac. Generation works fully offline, and the app sends no generation data to the cloud or collects telemetry.

Hollama is an LLM chat interface for people who want to use Ollama or OpenAI servers through a browser. It supports multiple server connections, so you can keep access to different model servers in one app.

LiveKit Agents is a framework for developers building voice assistants, phone agents and applications that combine speech, video and text. Python and Node.js agents interact with users through LiveKit rooms connected to web, mobile or telephone clients.

llama.cpp is a local LLM inference engine for developers building AI applications or running models on hardware they control. It supports language and vision-language models, with command-line tools and a server API for using the engine directly or connecting other software.

llama-cpp-python is for developers adding local LLM inference to Python applications or connecting existing API clients to models on their own hardware. It brings llama.cpp into a Python library and a self-hosted server.

Pictaria Server helps Immich users explore their photo library, choose photos to keep and organize albums through a browser dashboard on their own hardware.

OpenDev is an AI coding agent for developers who want concurrent work across a codebase and control over which models handle each task. It can plan changes, execute them and iterate autonomously, with a terminal interface and a browser interface for monitoring work.

Axolotl is a free, open-source LLM fine-tuning framework for developers and researchers adapting models to their own data. It supports training on local hardware or cloud infrastructure you control.

TagGUI is a desktop app for creators preparing image datasets for generative AI models. It brings automatic captioning and manual tag editing into one workspace so you can review and correct generated descriptions.

smolagents is a Python AI agent library for developers building software that uses tools and calculations to complete tasks. Its CodeAgent writes and executes Python actions, combining tool calls with loops and conditional logic.

jcode is a terminal AI coding assistant for developers who want to choose their model provider and carry useful context between conversations. It supports local and self-hosted model endpoints alongside cloud services.

codecompanion.nvim is an AI coding assistant for developers who want model chat, code edits, and coding agents inside Neovim. It lets you bring editor context into AI conversations and review agent changes in the editor.

Conduit is a native mobile AI client for people who want access to their self-hosted models and agents from an iPhone or Android phone. It can connect through Open WebUI or directly to a model endpoint.

Marginalia is a research agent for people whose papers, notes and working files are spread across a mixed document library. It reads relevant parts of the original files before writing answers with citations.

OpenRLHF is a self-hosted Python framework for researchers and teams training language models with human feedback or custom rewards. It supports fine-tuning and reinforcement learning on your own GPU hardware, including training agents that interact with an environment.

BERTopic is an open-source Python library for researchers and developers who need to find themes in document collections. It groups texts using transformer embeddings, then uses class-based TF-IDF to identify words that describe each group. Those keywords give you a way to inspect what a topic covers and which documents belong to it. The license is MIT.

HuggingChat UI is a browser-based ChatGPT alternative for people and teams who want to host their own chat service. It's the application behind Hugging Face's hosted HuggingChat, and it connects to a separate model backend.

InternVL is a family of vision-language models for developers and researchers building AI applications that interpret images and answer questions about them. Downloadable models let teams host inference themselves.

CoWork OS is an AI agent desktop for developers and people working with documents, research and email. It brings tasks and their outputs into one workspace, where you can review agent actions and control approvals.

NobodyWho Chat is an on-device AI assistant for people who want help with writing, brainstorming, coding and questions without sending their conversations to a hosted model. Language-model inference runs on the phone, and chat works offline without an account.

Unlimited-OCR is an OCR model for developers building document extraction workflows on their own hardware or servers. It handles individual document images and multi-page inputs, including PDFs converted to page images.

MOSS-Music is a local AI model for people who need to describe, transcribe, or analyze recorded music. It works with full tracks and combines sung lyrics with musical details in its responses.

FastDeploy is a self-hosted inference toolkit for teams deploying language and vision-language models on Linux servers. Built on PaddlePaddle, it supports offline inference and online serving.

IndexTTS is a local text-to-speech system for people creating spoken audio and developers adding speech generation to applications. It can reproduce a voice from a single reference recording.

Ludwig is a framework for developers and researchers training custom AI models without writing their own training loops. It handles preprocessing, training and evaluation from a model definition, covering LLMs as well as tabular and multimodal tasks.

Curator is a Python library for developers building LLM training datasets or extracting structured records from existing data. It supports pipelines that generate data in stages and process many model requests.

Hermes Browser Extension puts an existing Hermes Agent in a browser side panel for people who want to ask about the pages they're reading. Page context works through local or remote API connections; Hermes Cloud and dashboard-ticket connections are chat-only.

MOSS TTS generates speech for developers and creators working on narration, dubbing and other long audio content. It supports consistent voices across long passages and can clone a speaker from reference audio without separate training for that voice.

OpenVINO Model Server is a self-hosted inference server for developers and teams serving AI models on their own machines or servers. It uses OpenVINO to run workloads on x86 CPUs, including Xeon, with acceleration for Intel integrated and discrete GPUs and NPUs. It's open source under Apache 2.0.

Dia generates spoken English conversations from a written script. It's for developers and researchers who want to produce two-speaker dialogue on their own hardware, with audio references to guide the voices and delivery.