Tools tagged with "Multimodal input"

Thuki is a floating AI assistant for Mac users who want help with the text or screen they're already viewing. It appears above other apps, including fullscreen windows, and automatically brings selected text into the conversation.

GameStringer translates games for players and fan translators who want a language the game doesn't include. It detects the engine, extracts text and applies translated text to the game, with compatibility depending on the engine and title.

aionrs is a command-line AI agent for developers who want an assistant to work on local projects. It can carry out coding tasks across multiple steps using a model provider you choose.

txtai is a Python framework for developers building search, chat with their data, and AI agents on their own hardware. It combines a searchable knowledge store with model workflows, so applications can retrieve context and act on it.

LLaMA-Factory is a local model training platform for developers and researchers who want to adapt pretrained models to their own tasks. Its web UI lets you fine-tune models without writing code.

BrushNet fills selected areas of an image using a text prompt while retaining the surrounding content. It's for developers and researchers who want local image editing with pretrained diffusion models.

JoyCaption generates image descriptions for people preparing datasets to train or fine-tune diffusion models. It can caption images on your own GPU, reducing the work of writing training descriptions by hand.

NoteGen is an AI note-taking app for collecting research, meeting material and ideas before organizing them into finished documents. Notes remain ordinary Markdown files, with attachments stored on your device by default.

Kiln is a desktop workbench for teams building and testing AI applications. Engineers, QA staff and subject matter experts can work with the same tasks and datasets, including contributing ratings and examples without writing code.

Ferret is a local vision-language model for researchers studying how AI understands specific parts of an image. It supports questions about selected regions and can identify image regions in its answers. Its code and data are restricted to research use.

LLaVA is a vision-language model project for researchers and developers who want to ask questions about images on their own hardware.

llama.rn is a library for developers adding local LLM features to React Native apps on iOS and Android. It brings llama.cpp inference onto the device, so an app can process model requests on the user's hardware.

Pocket AI Lab runs AI models on an iPhone and helps you judge which ones the phone can handle. It's for people who want private chat on their device and want to check memory and storage before downloading model weights.

Cactus is an on-device AI engine for developers adding automation to mobile apps, wearables and other small devices. Its Needle model turns requests into tool calls locally, including when the device has no internet connection.

Open-LLM-VTuber is an AI companion for people who want to talk with a customizable animated character. Local language and speech models let it work fully offline, with conversations staying on your device.

MiniCPM-V is a family of local vision-language models for developers building applications that interpret images and video. It can run on phones and other hardware you control.

Onlook is a visual code editor for designers building websites and prototypes. Its open-source editor works on the app's code, so design changes become part of the working product rather than a separate mockup.

X-AnyLabeling is a desktop annotation workspace for researchers and teams preparing text, image, video, point cloud, and multimodal training datasets. Models generate initial labels, and reviewers correct them in the same workspace before exporting the data. It runs on Windows, Linux, and macOS under the GPL-3.0 open-source license.

Omodo is a macOS menu bar AI assistant for people who manage work through Apple Mail, Calendar, Reminders and Notes. It uses models running on your Mac to track requests and handle tasks in the background.

PAL MCP Server connects coding assistants to other AI models for second opinions, code review and planning. It's for developers who want to consult several models within the same coding session, using clients such as Claude Code, Codex CLI, Gemini CLI or Cursor.

Private Mind is a mobile AI assistant for people who want to chat and read documents without sending their content to a cloud service. It runs AI and document processing on your phone.

Phosphene is a generative media studio for people creating videos on their own Mac. It combines video, still images, music and character training in one interface, with generation running on-device.

Pipecat is an open-source Python framework for developers who want to run voice and video agent applications locally or on their own servers. It hosts the conversation pipeline, while speech and model processing depend on the services you choose. Integrations such as Soniox, OpenAI and Cartesia send the relevant requests to those providers.

My Neuro is a local AI desktop companion for people who want to create a character with their own choice of appearance, voice and personality. It supports spoken and typed conversations, with character expressions and movements that respond to the dialogue.

OlliteRT lets you use an Android phone as a private AI server for apps on your local network. It's for people who want to run models locally for chat clients or home automation without a cloud inference service.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

Wav2Lip changes a face's mouth movements in an existing video to match supplied speech. Its research version is for noncommercial projects, including experiments with lip-sync generation and model training.

IP-Adapter adds reference-image prompting to Stable Diffusion for artists and developers who want to guide generation with an image rather than describe every detail in words. It works with an existing text-to-image model and can combine image references with text prompts.

Seamless Communication is Meta's family of AI models for developers and researchers building multilingual speech applications. It covers translation and transcription, with dedicated models for conversations and expressive speech.

Sonar serves language and multimodal models for developers and teams running AI applications on their own hardware. It builds on vLLM and works with Hugging Face-compatible models.

OGX, formerly Llama Stack, is an AI application server for developers building chat apps, document search and AI agents. It brings model access and the services those applications need into a server you can host yourself.

Everywhere is a desktop AI assistant for people who want help with the app they're working in without copying its contents into a separate chat. It reads on-screen context to answer questions and carry out tasks across apps.

TensorRT-LLM is an inference library for developers serving LLMs on their own NVIDIA GPUs. It supports application-level inference and server deployments, with performance optimizations for workloads spread across one or several machines.

PhotoMaker generates personalized portraits and artwork from reference images and text prompts. It's for people creating photos or avatars that retain a person's recognizable features across different settings and styles.