Tools to Fine-Tune and Train AI Models Locally
Fine-tune an LLM or train a LoRA on your GPUs, shrink models with quantization, and prepare the labeled data that training needs.
Subcategories
Open-source Python library for compressing local or Hugging Face LLM checkpoints, with Apache 2.0 licensing and vLLM-compatible output.
3.8KUpdated 24 hours agoApache-2.0
#Hugging Face integration#Quantization
LLM Compressor is an open-source Python library for developers preparing models to run on their own hardware with vLLM. It reduces model size and memory requirements through quantization, and accepts local checkpoints or models from Hugging Face repositories. It's licensed under Apache 2.0.
LLM Libraries and SDKsQuantization and Model Conversion+0
A PyTorch library for training and inference on local machines or clusters, with CPU, GPU and TPU support. Open source under Apache 2.0.
9.9KUpdated 1 day agoApache-2.0
#Distributed execution
Accelerate is a Python library for developers and researchers who write their own PyTorch training loops and want to use the same code on a local machine or a distributed cluster. It handles the hardware-specific work while leaving the training logic under your control.
GPUs, Clusters and EdgeInference Libraries and BindingsTraining Frameworks+0
Open-source computer vision library for local detection, segmentation and tracking, with AGPL-3.0 licensing and exports to ONNX, TensorRT and CoreML.
62.1KUpdated 24 hours agoAGPL-3.0
#ONNX
Ultralytics YOLO is an open-source Python computer vision library for developers building applications that analyze images and video on their own hardware. It supports local and edge deployment, including NVIDIA Jetson, Raspberry Pi and mobile phones. A separate hosted platform provides browser-based annotation, cloud GPU training and managed prediction endpoints.
Computer Vision ModelsEdge and Embedded AIInference Libraries and BindingsTraining Frameworks+0
Python library for running and training embedding and reranker models locally, with Apache 2.0 licensing and pretrained models on Hugging Face.
19.1KUpdated 1 week agoApache-2.0
#Hugging Face integration#Multilingual#Multimodal input
Sentence Transformers is an open-source Python library for developers building semantic search and document retrieval on their own hardware. It runs embedding and reranker models locally, turning content into numerical representations for similarity comparisons and scoring results against a query. The library uses the Apache 2.0 license.
Inference Libraries and BindingsRAG and Vector SearchTraining Frameworks+0
Open-source Rust ML framework for running models locally on CPUs, NVIDIA GPUs or in browsers, with Apache 2.0 licensing and quantized LLM support.
21.1KUpdated 2 days agoApache-2.0
macOS · Web#GGUF#Hugging Face integration#Multilingual
Candle is a Rust machine learning framework for developers who want to embed local AI in applications or deploy models on their own servers. It produces lightweight binaries that don't need Python in production, making it a candidate for serverless inference where a large runtime can slow startup. Its API uses tensor operations familiar to PyTorch developers.
Inference Libraries and BindingsOn-Device and In-Browser AITraining Frameworks+0
A local LLM merging toolkit that combines model weights without extra training. Runs on CPU or GPU and supports Llama, Mistral and PyTorch checkpoints.
7.4KUpdated 3 weeks agoLGPL-3.0
#Hugging Face integration#LoRA
mergekit combines existing language models into a single model on your own hardware, without additional training or access to the original training data. It's for developers and researchers who want to combine fine-tuned capabilities or adjust the balance between model behaviors. The Python toolkit is open source under LGPL-3.0.
Fine-Tuning and TrainingLLM Libraries and SDKs+0
Local AI image manager for photo culling and dataset curation. Run it as a desktop app or self-hosted server, with on-device models and ComfyUI integration.
89Updated 22 hours agoGPL-3.0
macOS · Windows · Linux · Docker · Web#Batch processing#Hugging Face integration#ONNX
PixlStash is an open-source image manager for photographers, AI creators and people curating image datasets. It combines library search with tools for reviewing tags, ranking images and sending selected work through ComfyUI. You can use a desktop app or a self-hosted server with a browser interface.
AI Photo LibrariesData Labeling and AnnotationPhoto Search and Auto-Tagging+0
