Tools tagged with "Quantization"

diffusion-pipe trains image and video diffusion models on your own GPU hardware. It's for people fine-tuning models that are too large to fit on a single GPU or who want to distribute training across several GPUs.

Easy Diffusion generates and edits images on your computer through a browser interface. It's for people who want to use Stable Diffusion without assembling its software components themselves.

Lexicon is a writing assistant and rich-text editor for people who want to proofread and revise drafts on their own computer. Grammar checks work without an AI model, while optional local AI tools help rewrite longer passages and whole documents.

ComfyUI is a visual AI workflow editor for creators who want control over generation and editing. Its node canvas lets you connect models and processing steps, inspect their settings and reuse the resulting workflows without writing code.

NeuTTS is a collection of on-device text-to-speech models for developers building voice assistants and speech-enabled apps. It generates audio on your own hardware rather than sending speech generation to a cloud API.

MLX VLM is a Python package for developers and researchers who want to run multimodal models on their own Mac. It supports local inference and fine-tuning through MLX.

Falcon-H1 is a family of language models from the Technology Innovation Institute for developers building AI applications on their own hardware. Smaller models suit edge devices, while larger variants target server deployments.

MLX Audio is a Python library for developers building speech and audio applications on Apple Silicon Macs. It runs models locally using Apple's MLX framework, with support for generated speech, transcription and audio processing.

OpenVINO AI Plugins for GIMP adds image generation and AI editing to GIMP 3 for people who want to work within their existing image editor. Models run on Intel devices through OpenVINO.

HunyuanWorld generates explorable 3D environments from text prompts or images. It's for game developers, VR creators and researchers who need scene geometry for interactive content or physical simulation.

OfflineLLM is an on-device AI chat app for Android users who want to run models locally without sending conversations to a cloud service. It works fully offline and has no network permissions.

HunyuanDiT is a local text-to-image model for people generating images from Chinese or English prompts. It handles detailed descriptions and Chinese cultural references, including poetry, idioms, food and architecture.

LiteRT is Google's framework for developers adding machine learning and generative AI to apps that run on users' devices. It succeeds TensorFlow Lite and supports local inference without a server round trip.

MOSS is a conversational language model from Fudan University for developers and researchers who want to run and adapt a local LLM. It includes model weights, dialogue datasets and fine-tuning code.

Qwen3 is a language model family from Alibaba Cloud's Qwen team for people building chat applications or running models on their own hardware. Its public weights include dense and mixture-of-experts models in smaller and larger sizes.

Nunchaku is a local diffusion inference engine for developers and image-generation users who want to run models such as FLUX with less GPU memory. It focuses on faster generation with compressed models on NVIDIA hardware.

exo is a local LLM runner for people who want to run models too large for a single machine's memory. It joins devices into a cluster and runs inference on your own hardware.

H2O LLM Studio helps teams adapt language models to their own datasets through a browser interface, without writing training code. It's aimed at organizations building models for specific tasks.

Transformer Engine is a library for developers building and running Transformer models on NVIDIA GPUs. It reduces compute and memory demands in training and inference through low-precision arithmetic and optimized model components.

Needle is an AI model for developers building device assistants that turn requests into actions. It prioritizes automation over general chat, with smaller model variants for devices that have limited resources.

Diffusers is a Python library for developers and researchers building image, video and audio generation into applications or running models on their own hardware. It supports pretrained generation pipelines as well as custom diffusion systems.

ms-swift is a Python framework for developers and researchers training and deploying language and multimodal models on their own hardware. It covers model adaptation through evaluation and serving, with support for Qwen3, DeepSeek-R1, Llama4, Mistral, Qwen3-VL and InternVL3.5.

Fullmoon is a local LLM chat app for people who want conversations to stay on their Apple devices. It runs models on-device and works fully offline, with chat history saved locally.

Meme Search is a self-hosted web app for finding images in your own meme collection by their content and text. AI-generated descriptions make the collection searchable without relying on filenames.

GLiNER is a Python framework for extracting named entities from text using small models that run locally on CPUs and consumer hardware. It's for developers building document processing, personal data detection or search systems who need to choose their own entity types without training a model for each task.

DiffSynth-Studio is a diffusion model engine for developers and researchers generating media or training models on their own hardware. It combines inference and training, with memory-saving features for consumer GPUs.

Pretype is a local AI writing assistant for people who want sentence suggestions across their Mac apps. It works in native apps, Electron apps and web text fields without separate plugins for each app.

mistral.rs is an inference engine for developers who want to run AI models on their own computer or server. It supports browser chat and inference embedded directly in Python or Rust applications.

Jamba is AI21's language model family for teams building document-based assistants and business applications on their own servers. The Large model targets lengthy context, but its hardware requirements put it in server territory: quantized deployment uses eight GPUs with 80GB of memory each.

DwarfStar is a local LLM inference engine for people who want to run large DeepSeek, GLM and Qwen models on their own computers or servers. It focuses on selected models and hardware setups, and requires the project's own GGUF files rather than accepting arbitrary GGUF downloads.

LitGPT is a Python toolkit for developers and researchers who want to train and deploy language models on their own hardware. Its directly editable model implementations suit custom applications and research experiments.

Open Wispr is a voice dictation tool for people who want to speak into Mac apps while keeping audio and text on their computer. It inserts transcribed speech at the cursor in editors, browsers, terminals, email and other applications.

HotClip turns long recordings into short vertical videos for creators editing livestreams, podcasts, courses and spoken presentations. It suggests highlights with reasons and scores, so you can review the selections before exporting.

NeMo RL is NVIDIA's Python library for researchers and engineering teams adapting language and multimodal models on their own hardware. It supports experiments on a GPU workstation and distributed training across multiple nodes.