Tools tagged with "Multimodal input"

BrainSoup is a desktop AI agent app for people who want to automate tasks with assistants that have distinct roles and access to their own documents. You direct the agents through conversation and can have them work together on a shared task.

Semantic Kernel is an SDK for developers building AI agents and coordinated workflows inside applications. It lets developers choose local model backends or cloud providers for those applications.

Vane is a self-hosted AI search engine for people who want answers backed by sources they can check. It combines web research with a choice of local or cloud models and saves search history locally.

GuideLLM benchmarks LLM deployments so engineering and ML teams can assess capacity and response times under expected traffic. It can test self-hosted servers through OpenAI-compatible or vLLM-native interfaces.

Super Agent Party is an AI companion platform for people who want a desktop character that can also carry out tasks. It combines character conversations with agents that operate applications and interact through messaging or live streams.

Slotstream runs Qwen3.8-Flash-Next on Apple Silicon Macs with too little RAM to hold the whole model. It's aimed at Macs with 16 to 64 GB of memory, for people who want local chat, answers about pictures or a backend for coding assistants.

HunyuanDiT is a local text-to-image model for people generating images from Chinese or English prompts. It handles detailed descriptions and Chinese cultural references, including poetry, idioms, food and architecture.

Nativ is a macOS app for people who want AI chat and coding tools to use models running on their own Mac. It combines a chat workspace, model library, and local inference server.

LiteRT is Google's framework for developers adding machine learning and generative AI to apps that run on users' devices. It succeeds TensorFlow Lite and supports local inference without a server round trip.

HunyuanCustom generates videos of specific people or objects for creators and researchers who need subjects to stay recognizable across frames. It builds on HunyuanVideo and supports generation on your own hardware.

KubeAI is a Kubernetes operator for teams serving AI models on their own infrastructure or cloud clusters. It manages model servers and adjusts capacity to demand, including starting models from zero running replicas.

TEN Framework is a self-hosted framework for developers building voice agents and multimodal conversational applications. Its default assistant example depends on external services even when the application runs on your hardware.

Ollama runs open models for people who want local AI applications, model chat or a backend for coding assistants. It provides a command-line interface and an API, with a choice between inference on your hardware and its cloud service.

Label Studio is a platform for teams preparing training datasets or reviewing AI outputs. It brings human annotation and evaluation into a browser interface that can run locally or on your own server.

II Agent is an AI agent for developers and teams who want an assistant to carry out research, build applications and handle documents. It can act through a browser, shell and files to complete tasks that need several steps.

AnimateDiff generates animations with personalized Stable Diffusion models for artists and developers who want motion in their chosen visual style. Compatible image models don't need separate animation training.

LLM is a command-line tool and Python library for developers who want to use language models in terminal workflows or applications. It supports models running on your machine alongside remote providers such as OpenAI, Anthropic and Google.

SeekerClaw runs a personal AI agent on Android phones for people who want recurring tasks, device control and Solana wallet actions through Telegram or Discord. The agent stays active in the background and uses Claude, OpenAI, OpenRouter or an OpenAI-compatible gateway for its AI engine.

Sentence Transformers is a Python library for developers building search and document retrieval on their own hardware. It helps match content by meaning and rank results against a query.

Siftly helps people with large Twitter/X bookmark collections find saved posts and organize them by topic. It runs on your own machine, with AI processing handled by the endpoint you choose.

Open Assistant is a self-hosted personal AI assistant for people who want it to act on their email, calendar, files, and notes. It runs in a single Docker container with a browser interface. A coordinator assigns requests to specialist agents, so a conversation can lead to finding an invoice, scheduling a meeting, or researching a topic.

Qwen2.5-VL is a vision-language model for developers building visual assistants, document processing applications and screen-based agents. It answers questions about images and video and can return structured data for software to use.

OWL is a Python framework built on CAMEL-AI for developers who want multiple AI agents to work together on tasks. It combines research, file analysis, and actions in a browser or terminal within one task workflow.

Agent Router is an open source AI gateway for teams connecting agents to model providers and MCP tools. It gives applications a shared entry point while platform teams manage access and routing.

Bifrost is an AI gateway for developers and teams building applications that use local LLMs or multiple cloud providers. It gives those applications a shared API for model access and a central place to manage usage.

Needle is an AI model for developers building device assistants that turn requests into actions. It prioritizes automation over general chat, with smaller model variants for devices that have limited resources.

MuseTalk is a local AI lip-sync model for video creators and developers building virtual avatars. It edits a face to match supplied speech, so you can dub existing footage or animate a portrait.

ms-swift is a Python framework for developers and researchers training and deploying language and multimodal models on their own hardware. It covers model adaptation through evaluation and serving, with support for Qwen3, DeepSeek-R1, Llama4, Mistral, Qwen3-VL and InternVL3.5.

DiffSynth-Studio is a diffusion model engine for developers and researchers generating media or training models on their own hardware. It combines inference and training, with memory-saving features for consumer GPUs.

Superior Trade Trading Terminal is for traders who want to turn a chart idea into an automated trade on Hyperliquid. You can sketch a price path or describe a strategy, then review the agent's proposed setup before deployment.

Newelle is a Linux desktop AI assistant for people who want to chat with local models and use AI to work with documents and files. It also supports external model providers.

FinRobot is an Apache 2.0 open-source equity research system for analysts and quantitative researchers. Its desktop app runs financial calculations locally and uses an LLM to interpret results and write reports. Built-in OpenAI and Anthropic connections send model requests to those providers; custom OpenAI-compatible connections can use a local vLLM backend. Research also needs external market data.

mistral.rs is an inference engine for developers who want to run AI models on their own computer or server. It supports browser chat and inference embedded directly in Python or Rust applications.

HanaAgent is an open-source desktop AI agent for everyday computer work and coding, with user data stored on your machine. It runs on macOS, including Apple Silicon and Intel, and Linux. It supports Ollama local models as well as OpenAI-compatible, Anthropic-style and OAuth provider connections. Local inference uses Ollama; requests to a cloud provider go to that service.