Tools tagged with "Multimodal input"

Higgs Audio's Higgs TTS 2 is a downloadable speech model for developers building narration and conversational audio into applications. It adapts spoken delivery to the text and can generate conversations with distinct voices.

ControlNet adds visual guidance to Stable Diffusion for artists and developers who need generated images to follow a reference's layout or shape. It lets a sketch, pose or scene map guide the result alongside a text prompt.

TRELLIS is a local AI model for artists and researchers generating 3D assets from images or text. It supports several 3D representations and can edit generated assets as well as create them.

Llama is Meta's family of language models for developers, researchers and businesses building AI applications on their own hardware or servers. Downloadable weights let you choose a model for your application and available hardware.

AReaL is open-source reinforcement learning infrastructure for researchers and developers training LLMs and AI agents on their own compute. Its asynchronous training approach targets large reasoning models and agent applications, with support for single-node runs and distributed training. It uses the Apache 2.0 license.

llmcord is a self-hosted Discord bot for people who want to share AI conversations with friends or a community. It connects Discord chats to local models or remote providers. Conversation history stays in Discord, even when the model runs on your own hardware.

OpenChamber is a workspace for developers who want to run AI coding agents on their own computer or server and review the results. It uses OpenCode to run agents and keeps projects and sessions accessible across devices.

PicoClaw is a self-hosted personal AI assistant that can use local models through Ollama or vLLM. It's aimed at people who want an agent on their own hardware, including small Linux boards and Android phones. Hosted providers are optional, but choosing OpenAI, Anthropic, Google Gemini or DeepSeek sends model requests to those services and requires internet access and API keys.

Lap is a desktop photo manager for family albums, photographers, and large personal libraries. It works with photos in your existing folders and uses local AI to help you find images without uploading them to a cloud photo service.

Candle is a Rust machine learning framework for developers embedding local AI in applications or deploying models on their own servers. It supports inference and training, including small CPU deployments for serverless applications.

Personal LLM runs AI chat on your phone for people who want to ask questions without sending them to a cloud model. Chat, photo analysis and document questions work offline after you download a model and any required image support files.

FlashRAG is an open source Python toolkit for researchers and developers comparing retrieval-augmented generation (RAG) methods or building their own. It combines implemented research methods with prepared benchmark datasets and reported results, so experiments don't have to start with a separate codebase for each approach. It uses the MIT license.

NextChat is an AI chat interface for people who want to use self-deployed LLMs and cloud models in one application. It connects to LocalAI and RWKV-Runner, and supports OpenAI, Claude, Google Gemini and DeepSeek.

PrivateLM is an AI chat app for people who want to run models on their phone or tablet and choose when to use a cloud provider. It supports local inference on Android and iOS; the browser version requires cloud APIs.

Obsidian Local GPT is an AI writing assistant for people who keep their notes in Obsidian. It helps you work with selected text and related notes, using local models or a remote AI service.

IC-Light changes the lighting in existing images for people editing portraits, product shots, or other foreground subjects. It lets you explore different lighting conditions using a subject image as the starting point.

YuE is an AI music generation project for songwriters, musicians and developers who want to create songs with vocals and accompaniment. Its YuE2 models produce an editable composition before rendering the audio, giving you control over the music behind the recording.

Blades is an AI agent framework for Go developers building conversational applications and automated workflows. It lets developers combine model connections, application tools and conversation memory within their own software.

ContextGem is a Python framework for developers extracting structured information from documents such as contracts, invoices and reports. You describe what you need in natural language, and it handles extraction prompts and data modelling for text and image content.

OllamaSharp is a C# library for developers building .NET applications with Ollama. It gives those applications access to chat, embeddings and model management through the Ollama API.

Visions of Chaos combines generative AI tools with fractals and complex-system simulations in one application. It's for digital artists, educators and people who want to explore machine learning or mathematical patterns without working through the equations themselves. Its AI models run privately on your own hardware, without paid online APIs or backend usage logging and telemetry.

big-AGI is a browser-based AI workspace for developers, researchers and people who need to compare answers across models. It lets you examine separate responses and combine them while keeping control over model choice and reusable context.

NeMo Automodel is a Python library for researchers and developers who want to train or adapt AI models on their own GPU workstations or clusters. Its PyTorch-based training works with Hugging Face models without converting checkpoints.

PaperQA2 is a Python research assistant for researchers and developers who need answers grounded in scientific literature. It searches a local document collection and connects its answers to evidence through in-text citations.

NVIDIA NeMo Data Designer is a Python framework for developers and data teams creating synthetic datasets with controlled variation and relationships between fields. It can start with an empty dataset or build on your own seed data. The framework is open source under Apache 2.0.

FastVLM is a family of local vision-language models for developers and researchers building applications that answer questions about images. It focuses on reducing the delay before an answer starts, especially with high-resolution images.

LEANN is a local vector database for people building AI search over personal data or knowledge collections. It reduces index storage by computing embeddings on demand rather than keeping every embedding on disk.

NVIDIA Cosmos provides world models for developers building robots, autonomous vehicles and industrial vision systems. It supports reasoning about physical scenes, generating training data and learning actions before real-world deployment.

Sana is a local AI image and video generation framework for creators and developers who want to generate media on their own hardware. It includes training and inference tools for working with its diffusion models.

Phone Harness connects an AI agent to a real iPhone or Android to carry out tasks through app screens. It's for developers who want phone automation without relying on an app API.

Aiursoft Ollama Gateway gives teams controlled access to shared local LLM servers. It connects AI applications and coding assistants to Ollama or OpenAI-compatible backends through a central gateway.

VideoHighlighter is a desktop app for finding useful moments in long recordings without uploading footage for analysis. It helps creators cut highlights, reviewers inspect camera recordings, and interview editors locate material worth keeping.

jetson-containers is a Docker container build system for developers running local AI on NVIDIA Jetson. It assembles GPU software and its dependencies into containers for workloads that need a compatible CUDA stack.

Volyx Lens is an open-source desktop AI assistant for macOS, Windows and Linux that lets you choose which screen, microphone and system-audio inputs reach your AI provider. Linux support is experimental, with meeting audio captured on a best-effort basis. It's for people who want help with visible code, documents or meetings without continually copying context into a chat. A movable floating rail expands into chat and collapses when you don't need it.