Tools tagged with "LoRA"

MLX is a machine learning array framework for researchers and developers building and testing models on their own hardware. It supports model training and inference, with APIs for numerical work and neural networks.

SGLang is a self-hosted inference framework for teams serving AI models to applications. It supports production workloads on a single GPU or across distributed clusters, including AI agents and reinforcement learning rollouts.

vLLM serves language models on hardware you control. It's for developers and teams building model APIs that need to handle concurrent requests while using memory and compute efficiently.

text-generation-webui, also called TextGen, runs language models on your own hardware for chat, writing and application integrations. You can use it as a desktop app or a self-hosted browser interface.

Pallaidium is a Blender add-on for filmmakers and AI artists who want to develop scenes with generated visuals and sound before shooting. It puts generation on the Video Sequence Editor timeline, where you can test dialogue timing and edit scenes alongside music.

CogView4 is a text-to-image model for image creators and developers who want to generate images on their own hardware. It accepts Chinese and English descriptions and can include Chinese text in the results.

Locally Uncensored is a desktop AI studio for people who want to chat, create media and work on code on their own PC. It includes mainstream models and variants with fewer refusal restrictions.

ColPali is a document retrieval library for developers and researchers building search or retrieval-augmented generation systems. It matches text queries to page images, using visual content alongside text. The colpali-engine package is deprecated, and maintainers recommend Sentence Transformers for new projects and production use.

Qwen-Image generates images from text and edits existing pictures. It's for creators and developers who want to run an image model on their own hardware, especially for work that needs readable text within images.

Kaito manages LLM inference, fine-tuning and document retrieval services in Kubernetes. It's for teams that want to run models in their own cluster with less manual work sizing GPU capacity and managing deployments.

StarCoder2 is a family of code generation models for developers who want code completion on their own hardware. These models predict continuations of code; they aren't instruction models, so conversational requests aren't their intended use.

KTransformers is a research framework for developers running or fine-tuning large language models on their own hardware. It focuses on mixture-of-experts (MoE) models, using CPU resources alongside GPUs to work within limited GPU memory.

Guaardvark is a local AI studio for people who want document chat, task automation and media production on their own hardware. It brings those jobs into one interface and coordinates their use of the GPU.

InvokeAI is a free, open-source image generation application for artists who want to create and edit artwork on their own hardware. Its locally hosted browser interface combines direct canvas work with repeatable generation workflows.

AIBrix provides infrastructure components for teams serving large language models on Kubernetes. It's aimed at organizations that need to manage inference capacity, request routing and models across a cluster.

Paritok is a self-hosted gateway for developers whose coding agents send large file reads, tool output and conversation histories to an LLM. It reduces that input before the request reaches the upstream model.

DeePMD-kit is open-source software for molecular and materials researchers who want to train and run AI interatomic potentials on their own hardware. It learns atomic interactions from quantum-mechanical reference data, then uses those models in molecular dynamics simulations of molecules, solids and metals. It runs on CPUs and GPUs, with support for CUDA and ROCm source builds, and carries the LGPL-3.0-or-later license.

Mochi 1 generates video from written prompts for creators and developers who want to run a video model on their own hardware or adapt it to their own footage.

BentoML is a Python framework for developers who want to turn AI models into services on their own hardware or servers. It handles model serving and application logic for LLMs, image generation, audio, and embeddings.

DataDreamer is a Python library for researchers and developers who need to create training datasets and adapt LLMs to specific tasks. It connects data preparation and model training in reproducible workflows.

MOSS TTSD generates spoken dialogue from scripts for podcasts, audio dramas, dubbing and commentary. Its focus is maintaining distinct voices across long conversations, including speaker changes and overlapping speech.

TRL is a Python library for researchers and developers adapting foundation models with their own datasets. It builds on Hugging Face Transformers and supports training on a single GPU or across multiple machines.

Oumi helps ML researchers and teams build specialized AI models for their own tasks. It brings data preparation, training, evaluation, and deployment into one platform, with reusable recipes and components you can customize.

HQQ is a Python library for developers compressing language and vision models to fit the memory available on their own hardware. Its Half-Quadratic Quantization method doesn't require a calibration dataset.

Voice-Clone-Studio brings voice cloning and speech production into one browser interface for people making podcasts, audiobooks and dialogue recordings. It combines several engines with tools for preparing samples and training custom voices.

Ollama JavaScript is a library for developers adding model chat, generation or retrieval features to JavaScript applications. It connects those applications to an Ollama server, including one running locally.

Orpheus TTS generates speech for developers building voice applications or creating custom voices. Its Llama-based models support local inference and let you control how spoken text sounds.

InstantID generates personalized portraits from a single reference photo without training a model for each person. Creators and developers can retain a person's facial identity while changing the image through text prompts. Its required InsightFace face models are restricted to non-commercial research.

TTS-Audio-Suite is a ComfyUI extension for creators producing narration, character dialogue and speech matched to subtitles on their own hardware. It brings several speech engines and audio editing tools into the same workspace.

sd-scripts is a collection of Python scripts for people who want to train image models on their own hardware. It suits users comfortable working with scripts who need to adapt a model to their own images or subjects.

Musubi Tuner provides training scripts for people who want to adapt image and video generation models with their own datasets. It's aimed at users comfortable with a script-based workflow.

Front Porch AI is a desktop app for character chat and roleplay with local LLMs. It's for people who want to keep their conversations on their own machine while building stories with characters that retain memories and changing emotional states.

AReaL is open-source reinforcement learning infrastructure for researchers and developers training LLMs and AI agents on their own compute. Its asynchronous training approach targets large reasoning models and agent applications, with support for single-node runs and distributed training. It uses the Apache 2.0 license.

OpenPipe ART is a Python framework for developers who want to train multi-step AI agents on the tasks their applications actually perform. It uses reinforcement learning through GRPO (Group Relative Policy Optimization) to improve model behavior based on experience and task rewards. It's open source under Apache 2.0.