Tools tagged with "Multimodal input"

Uni MoE is a family of multimodal AI models for researchers working with language, visual material and audio together. Its Omni model can reason across combined inputs and answer questions about their content.

DwarfStar is a local LLM inference engine for people who want to run large DeepSeek, GLM and Qwen models on their own computers or servers. It focuses on selected models and hardware setups, and requires the project's own GGUF files rather than accepting arbitrary GGUF downloads.

Mono Color Skill helps designers and publishers turn a theme, phrase, object or photograph into editorial artwork for posters, zines, covers and packaging. It focuses on limited ink palettes, visible paper and print textures.

Memex is an AI journal for people who capture scattered notes, photos, and voice recordings and want help organizing them. It turns those fragments into structured records and connects information across entries.

Janus-Pro is a multimodal AI model for developers and researchers who want to interpret images and generate pictures on their own hardware. It combines both tasks in one model.

HotClip turns long recordings into short vertical videos for creators editing livestreams, podcasts, courses and spoken presentations. It suggests highlights with reasons and scores, so you can review the selections before exporting.

Paperwise turns PDFs, scans and records into a searchable library for people managing private documents. It answers questions across files and links its answers to the source pages so you can check the evidence.

AgentField is a self-hosted AI agent platform for developers building services that need to coordinate tasks under shared access rules. It combines execution, identity and audit records in infrastructure you control.

Skill Seekers prepares documentation and code for AI assistants. It's for developers and teams who want reusable skills, coding context or retrieval-augmented generation (RAG) data without preparing the same sources separately for each tool.

TripoSG generates 3D meshes from visual references for people creating 3D assets or testing shape ideas. It accepts finished images as well as rough scribbles paired with a text prompt.

NeMo RL is NVIDIA's Python library for researchers and engineering teams adapting language and multimodal models on their own hardware. It supports experiments on a GPU workstation and distributed training across multiple nodes.

Nextcloud Assistant brings AI tasks into Nextcloud Hub for teams working with shared files, email and conversations. It lets an organization choose local processing on its own server or a hosted model provider.

Agentic Security is an LLM vulnerability scanner for developers, researchers and security teams testing AI models and agent workflows. It probes how systems respond to hostile inputs and attempts to bypass their safety controls.

quackd lets robot builders give language-based goals to robots with existing movement and manipulation skills. It runs the planning on a computer while the robot's own controllers carry out the actions. Real-hardware use covers the LeRobot SO-101 arm; the other adapters have only run in simulators or mocks.

Data Formulator is a local AI data analysis workspace for analysts who want to explore questions through charts and keep track of alternative investigations. This Microsoft Research project combines natural language requests with direct chart editing. You can revisit an earlier result and branch into a different analysis without losing the original path.

Bolt.diy is an AI coding assistant for building full-stack Node.js web applications with your choice of model. It's a fork of Bolt.new that combines generated code with an editable development workspace.

Aphelion is a desktop app for people who want character conversations, creative writing and coding help from models running on their own computer. It works offline after the first model download and doesn't require an account.

Claude Code Local lets developers use Claude Code with a model running on their own computer. It suits people who want to keep coding offline or continue working when they hit cloud usage limits.

Eclaire is a self-hosted AI assistant for people who want to ask questions about their saved information and act on it in one place. It brings documents, notes, photos, bookmarks and tasks into a shared library.

MLX Tune is a Python library for adapting AI models on an Apple Silicon Mac. Formerly unsloth-mlx, it is an independent project and is not affiliated with Unsloth. Its Unsloth-compatible API lets you prototype training locally with minimal changes to existing scripts, then move to NVIDIA hardware with Unsloth. Training runs through Apple's MLX framework and doesn't require a cloud GPU.

MaxText is an LLM training library for researchers and engineers building models from scratch or adapting existing ones. It provides a reference implementation teams can modify for their own model designs, with training that scales from a single host to large clusters.

Jina Embeddings is a family of models for developers building semantic search, retrieval-augmented generation (RAG) and AI agent applications. The models convert content into vectors that a search system can compare for relevance.

TypingMind is an AI chat frontend for people who want to use different model providers in one workspace. It brings conversations, project materials and custom AI agents into a shared interface.

Oriveo Community Edition is a free, open-source AI chat client for people who want local models and cloud providers in the same app, with their conversation history stored on their own device. It runs on iOS, Android and the web, and you can self-host the web client. It doesn't require an Oriveo account.

ReMe gives AI agents lasting memory across conversations. It's for developers who want coding assistants or personal agents to retain useful facts, preferences, and procedures in files they can inspect and edit.

Claude Code Router is a local gateway for developers using coding agents such as Claude Code, Codex and OpenCode. It keeps provider selection and request routing in one app, while the selected cloud provider processes model requests remotely. Those requests leave your machine.

MusicGen is Meta AI's model for generating music from written descriptions. It's part of AudioCraft, a PyTorch library for developers and audio researchers building music generation tools in their own computing environment.

AnythingLLM is an AI assistant for people who want document chat and agents on their own hardware. Its desktop app can work with local models without an account or cloud API key.

Hope Agent is a desktop AI assistant that can also run without a desktop interface on a NAS or cloud server. It's for people who want ongoing project work, memory and task state to carry across sessions and devices. It supports local model setup. Data stays on the hosting machine by default, while requests to remote models go directly to the selected provider.

Witsy is a desktop AI assistant for people who want to chat with models, work with documents and write across applications. You can choose local models or cloud providers, with feature availability depending on the backend.

InfiniteYou generates images from a reference face and a text prompt while preserving the person's facial identity. It's a local AI framework for researchers studying personalized image generation, with model use restricted to academic research.

Braina combines AI chat, dictation and computer control for people who want to work through spoken or typed commands. It can run language models on your own computer and help with writing, document research and repetitive desktop tasks.

Home Generative Agent is a Home Assistant integration for people who want to control their smart home through conversation and get alerts about security issues. It can use fully local models, so home data doesn't have to leave your network.

EmbedAnything is a local embedding pipeline for developers building semantic search and retrieval-augmented generation (RAG) applications. It turns documents and media into vectors for indexing in a vector database.