Tools to Fine-Tune LLMs Locally
Fine-tune a language model with LoRA, QLoRA or full training on your GPUs, using Unsloth, LLaMA-Factory or TRL.
2.1KUpdated 2 hours agoApache-2.0
Docker#Distributed execution#Hugging Face integration#LoRA
NeMo RL is NVIDIA's Python library for researchers and engineering teams adapting language and multimodal models on their own hardware. It supports experiments on a GPU workstation and distributed training across multiple nodes.
9.4KUpdated 1 day agoApache-2.0
Docker#Distributed execution#LoRA#Multimodal input
Oumi helps ML researchers and teams build specialized AI models for their own tasks. It brings data preparation, training, evaluation, and deployment into one platform, with reusable recipes and components you can customize.
12.7KUpdated 8 hours agoMIT
macOS · Windows · Linux · Web#Hugging Face integration#Image-to-image#LoRA
AI Toolkit (ostris) is a training suite for people fine-tuning image and video generation models on their own hardware or rented servers. It provides a browser interface and command-line access to training jobs.
19.8KUpdated 4 hours agoApache-2.0
#Distributed execution#LoRA#Quantization
TRL is a Python library for researchers and developers adapting foundation models with their own datasets. It builds on Hugging Face Transformers and supports training on a single GPU or across multiple machines.
1.5KUpdated 1 day agoMIT
macOS · Windows · Linux#Code execution#Knowledge graphs#llama.cpp backend
npcpy is a Python library for developers and researchers building AI agents and applications with language models. It supports local LLM backends as well as cloud providers, so projects can choose where model requests run.
47.7KUpdated 3 months agoAGPL-3.0
macOS · Windows · Linux · Docker · Web#GGUF#llama.cpp backend#LoRA
text-generation-webui, also called TextGen, runs language models on your own hardware for chat, writing and application integrations. You can use it as a desktop app or a self-hosted browser interface.
1KUpdated 4 hours ago
#Distributed execution#Hugging Face integration#LoRA
Kaito manages LLM inference, fine-tuning and document retrieval services in Kubernetes. It's for teams that want to run models in their own cluster with less manual work sizing GPU capacity and managing deployments.
16KUpdated 2 months agoApache-2.0
Web#MLX#Multi-user access
Kubeflow is a self-hosted AI platform for teams developing and running machine learning workloads on Kubernetes. Its modular projects cover interactive development, training and the work of moving models into production.
39.5KUpdated 1 year agoApache-2.0
macOS · Linux · Web#Batch processing#Distributed execution#Hugging Face integration
FastChat is a self-hosted LLM platform for developers and researchers who want to serve chat models on their own hardware and compare their responses. It powers Chatbot Arena and includes a locally hosted side-by-side comparison interface. The Python code is open source under Apache 2.0; model licenses apply separately, including Llama's license for Vicuna.
1.5KUpdated 5 months agoApache-2.0
macOS#GGUF#Hugging Face integration#LoRA
MLX Tune is a Python library for adapting AI models on an Apple Silicon Mac. Formerly unsloth-mlx, it is an independent project and is not affiliated with Unsloth. Its Unsloth-compatible API lets you prototype training locally with minimal changes to existing scripts, then move to NVIDIA hardware with Unsloth. Training runs through Apple's MLX framework and doesn't require a cloud GPU.
15.7KUpdated 1 year agoApache-2.0
macOS · Windows · Linux · Docker · Web#llama.cpp backend#MLX#Multi-agent workflows
Second Me is an open-source prototype for people who want to train and host an AI representation of themselves. It uses personal memories to shape a model around their identity and context.
19.7KUpdated 6 days agoApache-2.0
Docker#LoRA#Multimodal input#Prompt caching
KTransformers is a research framework for developers running or fine-tuning large language models on their own hardware. It focuses on mixture-of-experts (MoE) models, using CPU resources alongside GPUs to work within limited GPU memory.
971Updated 12 hours agoApache-2.0
Linux#Distributed execution#Hugging Face integration#LoRA
AgileRL is an open-source Python framework for teams training AI agents on their own tasks, including LLM agents and agents for robotics, finance or logistics. Its evolutionary hyperparameter tuning adjusts training settings during a run, reducing the need for separate tuning trials. The framework uses the Apache 2.0 license.
5.8KUpdated 1 week agoBSD-3-Clause
#Hugging Face integration#LoRA#Quantization
torchtune is a Python library for developers and researchers who want to adapt LLMs on their own hardware with editable PyTorch training code. The project is no longer actively maintained.
2.1KUpdated 3 years agoApache-2.0
#Hugging Face integration#LoRA#Quantization
StarCoder2 is a family of code generation models for developers who want code completion on their own hardware. These models predict continuations of code; they aren't instruction models, so conversational requests aren't their intended use.
21.6KUpdated 14 hours agoMIT
Web#Hugging Face integration#LoRA#Multilingual
FinGPT is a financial LLM framework for researchers and developers building tools that interpret market news and company information. It includes trained models, financial datasets, and tools for adapting models to specific finance tasks.
MLX VLM
8 videos5.9KUpdated 9 hours agoMIT
macOS · Web#Agent Skills#Batch processing#Hugging Face integration
MLX VLM is a Python package for developers and researchers who want to run multimodal models on their own Mac. It supports local inference and fine-tuning through MLX.
12.4KUpdated 2 months agoApache-2.0
Linux · Web#Distributed execution#Hugging Face integration#Multilingual
MOSS is a conversational language model from Fudan University for developers and researchers who want to run and adapt a local LLM. It includes model weights, dialogue datasets and fine-tuning code.
14.8KUpdated 11 hours agoApache-2.0
macOS · Windows · Linux · iOS · Android · Web#Hugging Face integration#LoRA#Multilingual
Needle is an AI model for developers building device assistants that turn requests into actions. It prioritizes automation over general chat, with smaller model variants for devices that have limited resources.
5.9KUpdated 17 hours agoApache-2.0
#Distributed execution#Hugging Face integration#LoRA
AReaL is open-source reinforcement learning infrastructure for researchers and developers training LLMs and AI agents on their own compute. Its asynchronous training approach targets large reasoning models and agent applications, with support for single-node runs and distributed training. It uses the Apache 2.0 license.
41.4KUpdated 12 hours agoApache-2.0
#Distributed execution
Colossal-AI is a Python framework for developers and researchers training or serving large AI models on their own GPUs. It provides tools to spread workloads across GPUs and work within available memory.
6.9KUpdated 2 weeks agoApache-2.0
Docker · Web#Code execution#Git integration#Multi-user access
ClearML is a self-hostable MLOps platform for researchers and engineering teams managing model development and production. It connects experiment records with datasets, training jobs and model deployment so teams can trace results back to the work that produced them.
15.4KUpdated 2 months agoMIT
Linux · Web#Code execution
RD Agent is a self-hosted AI research agent for data scientists, researchers and quantitative developers. It runs experiments on a Linux machine or server, while chat and embedding requests use providers through LiteLLM, including OpenAI and Azure OpenAI. Those remote configurations require API credentials and internet access; hosting the agent yourself doesn't move their inference onto your hardware.
2.5KUpdated 9 hours agoApache-2.0
Docker#Code execution#Distributed execution#Tool calling
SkyRL is a Python library for researchers and developers who want to train LLMs with reinforcement learning on their own hardware. Its Tinker API support lets you run existing Tinker training scripts against a server you control without changing the scripts. It's open source under Apache 2.0.
79.7KUpdated 1 day agoApache-2.0
macOS · Windows · Linux · Docker · Web#Code execution#GGUF#Image-to-image
Unsloth is a desktop app for people who want to chat with models, train them on their own data, and create media on their own hardware. Its no-code interface brings these tasks into one workspace.
39.1KUpdated 13 hours agoMIT
#Code execution#MCP#Multimodal input
DSPy is a Python framework for developers building language model applications with local backends such as Ollama on a laptop or SGLang on a GPU server. It connects application code to those model servers, which handle inference on your hardware. It also supports cloud providers, so where model requests go depends on the backend you choose.
10.6KUpdated 4 hours agoApache-2.0
macOS · Windows · Linux · Docker · Web#Batch processing#Distributed execution#GGUF
Soup is a local LLM fine-tuning tool for developers and teams adapting models to their own datasets. It brings training, evaluation and export into one workflow that runs on your own hardware without requiring a cloud service.
13.8KUpdated 1 week agoApache-2.0
#Hugging Face integration#LoRA#Quantization
LitGPT is a Python toolkit for developers and researchers who want to train and deploy language models on their own hardware. Its directly editable model implementations suit custom applications and research experiments.
8.6KUpdated 2 months ago
Web#Multimodal input
Ferret is a local vision-language model for researchers studying how AI understands specific parts of an image. It supports questions about selected regions and can identify image regions in its answers. Its code and data are restricted to research use.
21.9KUpdated 12 hours agoApache-2.0
macOS#Distributed execution#Hugging Face integration#LoRA
PEFT is a library for developers adapting pretrained AI models on their own hardware. It trains a small portion of a model's parameters to reduce the compute and storage costs of full fine-tuning.
19KUpdated 1 week agoMIT
#Code execution#MCP#Multimodal input
Agent Lightning is a Python framework for developers and researchers training AI agents through reinforcement learning. It keeps the agent's existing tools, context and task environment involved in training, so feedback comes from the workflow the agent actually uses.
2.4KUpdated 2 weeks agoApache-2.0
Linux#GGUF#Guardrails#Hugging Face integration
Nemotron is NVIDIA's family of AI models for developers building agents that reason, write code and use tools. Teams can evaluate and adapt the models using published weights, training data and training recipes.
7.7KUpdated 2 days agoMIT
macOS#Batch processing#Distributed execution#Hugging Face integration
MLX LM is a Python package for developers and researchers who want to generate text and adapt language models on Apple Silicon Macs. It uses MLX for local inference and training, with access through Python or a terminal.
1.1KUpdated 8 hours agoApache-2.0
Docker#Distributed execution#Hugging Face integration#LoRA
NeMo Automodel is a Python library for researchers and developers who want to train or adapt AI models on their own GPU workstations or clusters. Its PyTorch-based training works with Hugging Face models without converting checkpoints.