Moondream

Moondream is a vision language model for developers building apps that interpret images, such as warehouse or manufacturing footage. Its downloadable models can run on your own hardware, including offline in an air-gapped environment.

• Image questions and captions: Ask questions about a picture or generate a written description, with support for visual reasoning and long-context queries.
• Object detection and segmentation: Locate objects, identify points and segment regions within an image.
• Models for smaller hardware: Compact models run on CPUs, GPUs and edge devices, with a smaller fine-tuning base for hardware with limited resources.
• Task-specific fine-tuning: Lens is a hosted service that adapts models through supervised or reinforcement learning without requiring dataset uploads; you keep the resulting weights and can run them locally with Photon or through Moondream Cloud.

Photon is the local inference engine for Mac, Windows and CUDA hardware, including NVIDIA Jetson devices. You can also self-host inference on a server. Optional Moondream Cloud inference processes requests remotely through an OpenAI-compatible API.

The repository code is open source under Apache 2.0. The downloadable model weights are free for commercial use.