2,000+ AI tools you can run locally Add tool

MiniCPM-V

Local vision-language models interpret images, video and text on your own hardware, with mobile deployment and support for Ollama and llama.cpp.

MiniCPM-V is a family of local vision-language models for developers building applications that interpret images and video. It can run on phones and other hardware you control.

Image and video understanding. The models accept visual inputs alongside text for applications that need to interpret pictures or video content.
Mobile deployment. Support covers iOS, Android and HarmonyOS, with open-source adaptation code for on-device use.
Visual detail tradeoffs. Adjustable visual compression lets developers balance the detail retained in an image against the computation needed to process it.
Runtime compatibility. The models work with Ollama, llama.cpp, vLLM and SGLang, so developers can choose a runtime that fits their application.

Local deployment runs inference on your own hardware. The project's code is open source under Apache 2.0.

Vision-Language Models On-Device and In-Browser AI macOS iOS Android Web GGUF Hugging Face integration llama.cpp backend LoRA Multilingual Multimodal input Ollama integration Quantization

Similar to MiniCPM-V

Gemma

138 videos

An open-weight local LLM family for phones, PCs and servers, with Ollama and LM Studio support and a JAX library for fine-tuning.

5.8KUpdated 1 month agoApache-2.0

Android#LM Studio integration#LoRA#Multilingual

Gemma is Google DeepMind's family of open-weight AI models for developers building applications on their own hardware. It includes compact models for mobile and IoT devices and larger models for reasoning on personal computers and servers.

Edge and Embedded AIEmbedding and Reranker ModelsLLM Fine-TuningOpen-Weight LLMsVision-Language Models

Ollama

261 videos

An MIT-licensed local LLM runner and API for macOS, Windows, Linux and Docker, with optional cloud inference and coding agent integrations.

186.9KUpdated 21 hours agoMIT

macOS · Windows · Linux · Docker#GGUF#llama.cpp backend#Multimodal input

Ollama runs open models for people who want local AI applications, model chat or a backend for coding assistants. It provides a command-line interface and an API, with a choice between inference on your hardware and its cloud service.

Inference Servers and ClustersLocal Model Runners

FastVLM

1 video

Local vision-language models answer image prompts, with PyTorch checkpoints and on-device inference on iPhone, iPad and Apple Silicon Macs.

7.4KUpdated 2 months ago

macOS · iOS#Multimodal input#Quantization

FastVLM is a family of local vision-language models for developers and researchers building applications that answer questions about images. It focuses on reducing the delay before an answer starts, especially with high-resolution images.

LLM Fine-TuningOn-Device and In-Browser AIQuantization and Model ConversionVision-Language Models

SmolVLM

A local vision language model processes images and text with Hugging Face Transformers, supports multiple images per chat, and uses the Apache 2.0 license.

4KUpdated 1 month agoApache-2.0

#Hugging Face integration#LoRA#Multimodal input

SmolVLM is a compact vision language model for developers building applications that interpret images and answer questions about them. It can run on-device, including on laptops and smaller local setups.

On-Device and In-Browser AIVision-Language Models

Paperless-AI

3 videos

A self-hosted AI extension classifies Paperless-ngx documents and answers archive questions using Ollama or OpenAI-compatible APIs.

6KUpdated 3 days agoMIT

Docker · Web#Multilingual#Ollama integration#OpenAI-compatible API

Paperless-AI is an extension for Paperless-ngx users who want to sort incoming documents automatically and ask questions about their archive. The project is no longer maintained.

Automation and No-Code AIChat With Your Documents

Paperless-GPT

4 videos

A self-hosted AI add-on for paperless-ngx that organizes documents, links related records and performs OCR with local Ollama models or external services.

2.8KUpdated 4 weeks agoMIT

Docker · Web#Batch processing#Human approval#Multimodal input

Paperless-GPT adds AI document processing to an existing paperless-ngx archive. It's for people who want to reduce manual sorting and extract text from scanned paperwork.

OCR and Document Scanning