Tools tagged with "Multimodal input"

haiku.rag lets you search your own documents and ask questions with answers you can check against the original pages. It's for people building a private document library or giving an AI assistant access to their files.

Granite is IBM's family of AI models for developers and businesses building applications on their own hardware or servers. You can customize the models for enterprise tasks, including coding assistants and document analysis.

AIBrix provides infrastructure components for teams serving large language models on Kubernetes. It's aimed at organizations that need to manage inference capacity, request routing and models across a cluster.

Avibe gives coding agents a shared workspace for people who want to manage ongoing work and review results from their browser or phone. Agent execution stays on your machine, while inference uses your configured provider; OpenCode can also use local or OpenAI-compatible endpoints.

Xinference serves AI models on your own computer or servers for developers and researchers building applications around models they control. It brings chat, document search and media generation into one platform.

Voxta is an AI companion for people who want a character they can talk to, assign tasks to or use in interactive stories. You choose its personality, voice and optional avatar.

AIdea for Zotero is an AI assistant for researchers who want to ask questions about papers and translate reading material inside Zotero. Its side panel works in the library view and the PDF or EPUB reader.

MNN is a C++ framework for developers running AI models on phones, PCs and embedded devices. It supports inference and training on the device, with a small application footprint and hardware acceleration.

wllama lets developers add local LLM inference to browser apps without a separate inference server. It brings llama.cpp to JavaScript and TypeScript projects through WebAssembly, so models run on the user's device.

Moondream is a vision language model for developers building apps that interpret images, such as warehouse or manufacturing footage. Its downloadable models can run on your own hardware, including offline in an air-gapped environment.

LLM Farm is an app for on-device AI conversations and comparing language models on Apple hardware. It suits people who want offline chat or need to assess which model fits a project.

Agent S is a computer-use AI agent framework for developers and researchers building desktop automation. It takes natural-language tasks and operates desktop and web applications through their screen interfaces, without requiring an API integration for each app.

Fast Agent is a terminal coding assistant and Python toolkit for developers building AI agents and automated workflows. You can choose local LLMs or hosted providers and use the same toolkit for interactive work, scripting, and evaluation.

SpeakoFlow lets you dictate into other apps and ask an AI assistant for help without leaving your work. It's for people who want voice typing, spoken conversations and meeting notes with processing on their own computer.

Podcastfy turns source material into podcast-style audio conversations for creators and developers. It's an alternative to NotebookLM's podcast feature for people who want to customize the conversation or include podcast generation in their own software.

LightRAG is a self-hosted framework for developers building AI assistants that answer questions across documents. It connects related facts across files, including material where relationships matter, such as legal and financial records.

OpenMAIC is a self-hosted AI classroom platform for learners and educators building lessons from a topic or their own materials. AI teachers and classmates explain concepts and discuss questions during the lesson.

LLMII labels image collections with AI-generated captions and keywords for people who want searchable photos without uploading them to a cloud service. It processes folders on your computer and saves descriptions that other photo tools can read.

py-xiaozhi is a Python AI voice client for people who want to try Xiaozhi conversations on a computer or build voice interaction into hardware projects. It builds on the xiaozhi-esp32 project and lets you use a desktop microphone and speakers without dedicated Xiaozhi hardware.

OSWorld is a benchmark for researchers and developers testing AI agents that use computers. It measures task completion in real desktop environments, including workflows that cross application boundaries.

HunyuanVideo is an AI video generation model for creators and developers who want to generate clips on their own GPUs. Downloadable weights and inference code support generation from text prompts or an input image.

Lemonade is a local AI server for people who want to chat with models on their own hardware or use them in apps and agents. It includes a built-in interface for direct use and APIs for connecting other software.

Agnai is an AI roleplay chat app for people who want conversations with fictional characters, including shared chats with other people. It builds on early work from Galatea-UI by PygmalionAI.

DSPy is a Python framework for developers building language model applications with local backends such as Ollama on a laptop or SGLang on a GPU server. It connects application code to those model servers, which handle inference on your hardware. It also supports cloud providers, so where model requests go depends on the backend you choose.

Oumi helps ML researchers and teams build specialized AI models for their own tasks. It brings data preparation, training, evaluation, and deployment into one platform, with reusable recipes and components you can customize.

LLM Vision is a Home Assistant integration for people who want camera footage to inform smart home alerts and automations. It uses multimodal models to describe what cameras capture and extract data from images.

DeepSeek-OCR is an OCR model for developers processing document images and PDFs on their own hardware. It also supports research into visual text compression, representing text-bearing images with compact sets of vision tokens.

Ollama JavaScript is a library for developers adding model chat, generation or retrieval features to JavaScript applications. It connects those applications to an Ollama server, including one running locally.

MemFree is an open-source AI search tool that answers questions using both your own knowledge base and the internet. It's for people who want to search saved documents, bookmarks and web content together, with AI summaries instead of reading each result separately. You can self-host it or use the hosted website.

AI File Sorter helps people clear crowded Downloads folders, photo collections and stored archives. It proposes folders and filenames for you to review before it moves or renames files.

RubyLLM is an AI framework for Ruby and Rails developers building chat and agent features into their applications. Its shared API lets you switch between local and hosted models without writing a separate integration for each provider.

ModelScope is an AI model hub with a Python library for developers and researchers who want to run models locally or adapt them to their own data. It covers language, vision, speech, multimodal tasks and scientific computing.

InstantID generates personalized portraits from a single reference photo without training a model for each person. Creators and developers can retain a person's facial identity while changing the image through text prompts. Its required InsightFace face models are restricted to non-commercial research.

BoBe is an open-source desktop assistant that offers help based on what you're working on. It runs on Apple Silicon Macs with macOS 15 or later. Optional periodic screen captures give a vision model context about your work, while a floating overlay lets you chat with the assistant and review its suggestions.