Tools tagged with "Multimodal input"

Enchanted is a ChatGPT alternative for people who want an Apple app for chatting with models they host themselves. It requires your own Ollama server, which runs the models on your computer or a server you control.

SWE-agent is a command-line coding agent for developers and researchers attempting fixes in GitHub repositories. It runs the agent on your machine and supports local Ollama models through a configured endpoint, or cloud APIs such as OpenAI and Anthropic. Cloud-backed runs send model requests to the selected provider.

NativeMind is a local ChatGPT alternative for people who want AI help with reading and writing inside their browser. It processes prompts and page content on your device using local models.

ASUS MuseTree is an on-device AI image creation app for designers and people developing visual concepts. It works offline and brings prompts, sketches and reference images into a workspace for exploring and saving ideas.

Memvid gives AI agents persistent memory in a portable file. It's for developers who need agents to recall conversations or search documents without running a separate database server.

Raycast's AI assistant lets you chat with models running through Ollama on your computer. It's for people who want local AI conversations within Raycast's existing chat and command tools.

LabelMe is a desktop image annotation app for people preparing computer vision datasets. It combines manual drawing with model assistance for labeling objects and outlining image regions.

Aider is a terminal coding assistant for developers who want an LLM to make changes in a new or existing project. It works with local models and cloud services, and keeps code edits reviewable through Git.

Surf is an AI notebook for people researching across webpages, videos and documents. It brings source material and writing into one workspace so you can ask questions about what you've collected while taking notes.

Fish Speech is a self-hosted text-to-speech system for creators producing narration and developers building voice applications. Its S2 Pro model supports directed speech delivery and dialogue with multiple speakers.

ScribeDog is a Markdown editor for writers and note-takers who want AI help with documents they keep in their own folders. It shows formatted content while saving plain Markdown files that other editors can open.

LMMS Eval is a Python toolkit for researchers and model teams comparing AI models on text, image, video and audio tasks. It uses a shared evaluation pipeline to reduce differences caused by separate benchmark implementations.

Agentlas OS is an open-source AI agent framework for projects that need specialist teams and shared project context. It runs on macOS, Windows and Linux, with local document indexing, semantic search and memory retrieval. You supply the model. Using a cloud model sends requests to that provider and may incur charges.

Step1X Edit edits existing images from written requests. It's for developers and researchers who want to run image editing on their own hardware, with control over the model and specialized training.

Kady is an AI research assistant for scientists who want to turn plain-language requests into analyses, literature reviews and research outputs. It works in a desktop workspace where you can inspect its code and files, redirect ongoing work or stop a run.

Florence-2 is Microsoft's vision model for developers building applications that describe images, extract text or locate objects on their own hardware. One model handles several image tasks selected through text prompts.

EverOS is a Python library and memory runtime for developers building agents that need context across sessions and applications. It keeps conversations, files and task histories in readable Markdown that you can edit and version with Git.

M Flow is a self-hosted memory engine for developers whose AI agents need to recall past conversations and work preferences. It runs in Python or Docker and supports Ollama for local model use, alongside providers such as OpenAI and Anthropic. Choosing a cloud provider sends model requests to that service.

Memind gives AI agents long-term memory for projects, user preferences and past tasks. Developers can use it to carry context between sessions while keeping links to the material each memory came from.

LLM X is a browser chat interface for people running models on their own hardware. It brings multiple model servers into one place and lets you compare their responses within a conversation.

LiteRT-LM is Google's open-source framework for developers building apps that run language models on the user's device. It uses LiteRT for local inference across mobile devices, desktops and browsers, with GPU and NPU acceleration. The project uses the Apache 2.0 license.

biniou brings AI chat and media creation into one browser interface on your own computer or server. It's for people who want to work with several kinds of generative AI without switching between separate apps.

Auto Browser lets AI agents operate a live browser that a human can take over when a login or fragile page needs attention. It's built for internal dashboards, account workflows and operator-assisted browser QA.

Dingo combines rule checks, LLM judges and agent-based evaluation to assess AI training data, fine-tuning datasets and production systems. It's an open-source Python tool under Apache 2.0 for data engineers, ML practitioners and researchers who need to find data problems and compare model or application quality. Evaluation can run locally or across a Spark cluster.

VACE is an AI video model for creators and developers who want to generate footage or edit existing clips locally. It combines reference-based generation and video editing, including changes limited to masked areas.

Next AI Draw.io turns written descriptions and uploaded files into diagrams you can edit on a draw.io canvas. It's for people creating technical diagrams who want AI help with drafting and revisions while keeping control of individual shapes.

MinerU is a local document parser for people preparing files for AI workflows. It handles scanned PDFs, academic papers and other documents containing OCR text, tables, figures or complex layouts.

Gemma is Google DeepMind's family of open-weight AI models for developers building applications on their own hardware. It includes compact models for mobile and IoT devices and larger models for reasoning on personal computers and servers.

Off Grid AI is a local AI app for people who want chat, document analysis and media tools on their own phone or computer. Downloaded models work offline, and the core app doesn't require an account.

dots.ocr is a self-hosted OCR model for developers and teams that need text and page structure from multilingual documents. It combines text recognition and layout parsing in a single vision-language model you can run on your own hardware.

GPTQModel is a Python toolkit for developers compressing LLMs and running them on their own hardware or servers. It combines model preparation, quality evaluation and inference so you can assess compression choices within one workflow.

WindsurfAPI, also called DevinAPI, connects coding assistants and other AI clients to models through your own Devin account. The gateway runs on your hardware, but it sends prompts and images to Devin's cloud for inference, so it requires internet access.

SmolVLM is a compact vision language model for developers building applications that interpret images and answer questions about them. It can run on-device, including on laptops and smaller local setups.

Molmo is Ai2's family of vision-language models for working with images and text on your own hardware. It's aimed at developers and researchers who want to train models or evaluate them on visual tasks.