Tools tagged with "Multimodal input"

Transformers is a Python library for developers and researchers running pretrained AI models or training models on their own hardware. It covers text, images, audio, video and multimodal tasks through shared model definitions.

Orca is a desktop workspace for developers managing several AI coding agents on the same project. It keeps each task in a separate Git worktree so agents can edit independently while you compare their results.

Kai 9000 is a personal AI assistant for people who want remembered context and tools that can act on their requests. Its responses can include interactive screens such as quizzes, recipe cards and dashboards.

SGLang is a self-hosted inference framework for teams serving AI models to applications. It supports production workloads on a single GPU or across distributed clusters, including AI agents and reinforcement learning rollouts.

Free Claude Code lets developers use coding agents with local models or a choice of cloud providers. It connects existing clients to a shared model catalog rather than requiring a separate coding workflow.

PPT Master turns documents or topics into PowerPoint presentations for people who expect to edit the generated slides. It creates native PowerPoint objects that you can revise individually.

LangWatch helps AI teams test agent behavior before release and investigate production failures. Teams can reproduce a failed conversation and check how an agent handles it again.

vLLM serves language models on hardware you control. It's for developers and teams building model APIs that need to handle concurrent requests while using memory and compute efficiently.

LightLLM is a self-hosted LLM inference and serving framework for developers and teams running models on their own GPU servers. Its focus is serving requests efficiently: it schedules work around predicted memory use and handles text encoding, model inference and output decoding asynchronously to improve GPU utilization.

AIClient2API is a self-hosted AI API proxy for developers connecting chat apps and coding assistants to multiple model providers. It exposes services such as Antigravity, Codex, Grok, and Kiro through interfaces those apps already support.

text-generation-webui, also called TextGen, runs language models on your own hardware for chat, writing and application integrations. You can use it as a desktop app or a self-hosted browser interface.

Gemini CLI is a coding assistant for developers who want to work with an AI agent in their terminal. It can inspect a codebase and act on files and shell commands, with Gemini handling the model responses in Google's cloud.

ExecuTorch is an on-device AI runtime for developers adding PyTorch models to apps and embedded devices. It handles inference on the user's hardware across Android, iOS, macOS, Linux and Windows, as well as embedded systems and microcontrollers.

Pallaidium is a Blender add-on for filmmakers and AI artists who want to develop scenes with generated visuals and sound before shooting. It puts generation on the Video Sequence Editor timeline, where you can test dialogue timing and edit scenes alongside music.

Nemotron is NVIDIA's family of AI models for developers building agents that reason, write code and use tools. Teams can evaluate and adapt the models using published weights, training data and training recipes.

MTEB helps researchers and developers compare embedding models and retrieval systems for the tasks they need. Its benchmarks cover multiple languages and modalities.

VoxInput is an open-source dictation tool for Linux and macOS that types spoken words into the active application. It's for people who want speech input across their desktop, including applications without their own dictation feature. On Linux, it also works in the system console.

Lucebox is a local AI workstation for developers and teams who want to run models on their own hardware. Its inference engine is also available separately for supported AMD and NVIDIA machines.

Locally Uncensored is a desktop AI studio for people who want to chat, create media and work on code on their own PC. It includes mainstream models and variants with fewer refusal restrictions.

Edit Mind is a self-hosted AI video knowledge base for editors, creators and people with large footage archives. It helps you find a moment by what someone says or what appears on screen, without remembering the filename. The self-hosted project isn't production-ready and may have incomplete features or bugs.

ColPali is a document retrieval library for developers and researchers building search or retrieval-augmented generation systems. It matches text queries to page images, using visual content alongside text. The colpali-engine package is deprecated, and maintainers recommend Sentence Transformers for new projects and production use.

Open-Sora is an AI video generation project for researchers, developers and creators who want to run or adapt a model on their own GPUs. It focuses on animating reference images with text guidance and also accepts text alone.

OpenCLIP is a Python library for developers and researchers building image-text matching and zero-shot classification applications. It supports pretrained CLIP models and training models on your own hardware.

Qwen-Image generates images from text and edits existing pictures. It's for creators and developers who want to run an image model on their own hardware, especially for work that needs readable text within images.

Kerlig is a paid AI writing assistant for Mac that helps with emails, Slack replies and Jira tickets in the apps you already use. It combines text editing with document chat and an agent that can read your screen and use your apps.

Typesense is a self-hosted search engine for developers building site search, product catalogs or AI search over their own data. It combines keyword matching with searches based on meaning.

Open Cowork is a desktop AI agent for Windows and Apple Silicon macOS that uses cloud model APIs to carry out tasks on your computer. It's a Claude Cowork alternative for people who want a graphical interface for document work and app automation. The app is free and open source under MIT, but the agent needs an API key and internet access; model requests go to your chosen provider.

KoboldCpp runs language models on your own hardware for chat, creative writing and roleplay. It's a fork of llama.cpp with a bundled KoboldAI Lite browser interface.

Lollms WebUI is a local AI interface for writing, coding assistance and media generation through a choice of models. The project receives minimal maintenance, and its interface has no built-in user authentication.

4M is a framework for researchers and developers who want to train and run models that combine images, text and other visual information. A single model can perform vision tasks and generate images from mixed or partial inputs.

KTransformers is a research framework for developers running or fine-tuning large language models on their own hardware. It focuses on mixture-of-experts (MoE) models, using CPU resources alongside GPUs to work within limited GPU memory.

Reins is a chat app for people using self-hosted LLMs through Ollama. It gives you a mobile and desktop interface for comparing models and keeping different instructions for different conversations.

MTPLX is a native Mac app, command-line tool and local LLM server for people running chat or coding models on Apple Silicon. It uses a model's own multi-token prediction heads to accelerate generation without a separate draft model.

OpenVINO is an AI inference toolkit for developers deploying models in their own applications. It converts and optimizes models for local hardware or servers, covering generative AI and conventional machine-learning workloads.