Tools tagged with "Hugging Face integration"

OpenVINO is an AI inference toolkit for developers deploying models in their own applications. It converts and optimizes models for local hardware or servers, covering generative AI and conventional machine-learning workloads.

ChatTTS generates conversational speech for developers and researchers building spoken LLM assistants or dialogue experiments. The released model is restricted to academic use and cannot be used commercially.

Granite is IBM's family of AI models for developers and businesses building applications on their own hardware or servers. You can customize the models for enterprise tasks, including coding assistants and document analysis.

FastLLM is an open-source inference engine for people running large language models on their own machines or self-hosted servers. Its main draw is hardware flexibility: large mixture-of-experts (MoE) models can spread their weights across GPU memory, system RAM and disk when they don't fit entirely on a graphics card.

AutoTrain supports model training on your own hardware through AutoTrain Advanced, a no-code application for people fine-tuning LLMs or building models from their data. Advanced can run locally or on cloud infrastructure. The project is no longer maintained, and it won't receive bug fixes or new features.

WritHer is a voice dictation app for people who want to write in Windows desktop apps and manage everyday tasks by speaking. It works offline after the initial model downloads, without an account.

Distil-Whisper is a family of speech recognition models for developers who want to transcribe English audio on their own hardware. The models build on Whisper, reducing model size and processing time with some differences in accuracy.

wllama lets developers add local LLM inference to browser apps without a separate inference server. It brings llama.cpp to JavaScript and TypeScript projects through WebAssembly, so models run on the user's device.

Moondream is a vision language model for developers building apps that interpret images, such as warehouse or manufacturing footage. Its downloadable models can run on your own hardware, including offline in an air-gapped environment.

Paritok is a self-hosted gateway for developers whose coding agents send large file reads, tool output and conversation histories to an LLM. It reduces that input before the request reaches the upstream model.

Mochi 1 generates video from written prompts for creators and developers who want to run a video model on their own hardware or adapt it to their own footage.

whisper.cpp runs OpenAI's Whisper speech recognition models on your own hardware. It's for developers adding transcription to applications and people who need offline speech-to-text.

BentoML is a Python framework for developers who want to turn AI models into services on their own hardware or servers. It handles model serving and application logic for LLMs, image generation, audio, and embeddings.

Wyoming Piper provides local speech generation for Home Assistant and other Wyoming-compatible clients. It's for people building a voice assistant who want speech synthesis to run on their own machine or server.

PocketPal AI runs language models on phones and tablets for people who want an assistant they can use without sending conversations to a server. Core chat works offline after a model download and doesn't require an account.

TabbyAPI is a self-hosted LLM API server for people who want to run ExLlamaV3 models on their own hardware. It’s built for personal projects and small groups; its maintainers don’t recommend it for production servers.

RAGatouille is a Python library for developers building retrieval-augmented generation (RAG) applications with ColBERT. It builds and searches document indexes on your own hardware or server, with compressed indexes stored on disk that your application can query directly.

Podcastfy turns source material into podcast-style audio conversations for creators and developers. It's an alternative to NotebookLM's podcast feature for people who want to customize the conversation or include podcast generation in their own software.

Mamba is a Python library for researchers and developers building sequence models, including language models. Its selective state space architecture processes sequences in linear time and is designed for efficient GPU execution.

Priv AI is an on-device assistant for people who want to chat with AI and use it to examine personal health and financial information. It works offline after a model download and doesn't require an app account.

DataDreamer is a Python library for researchers and developers who need to create training datasets and adapt LLMs to specific tasks. It connects data preparation and model training in reproducible workflows.

MOSS TTSD generates spoken dialogue from scripts for podcasts, audio dramas, dubbing and commentary. Its focus is maintaining distinct voices across long conversations, including speaker changes and overlapping speech.

mxbai-embed is Mixedbread's text embedding model family for developers building semantic search and retrieval systems. The downloadable mxbai-embed-large-v1 model converts queries and documents into vectors that applications can compare by meaning.

Lemonade is a local AI server for people who want to chat with models on their own hardware or use them in apps and agents. It includes a built-in interface for direct use and APIs for connecting other software.

LLM Compressor prepares models for deployment with vLLM by reducing their storage and memory requirements through quantization. It's for developers working with local checkpoints or models from Hugging Face repositories.

HQQ is a Python library for developers compressing language and vision models to fit the memory available on their own hardware. Its Half-Quadratic Quantization method doesn't require a calibration dataset.

SoniTranslate is an AI video dubbing app for people translating spoken videos into other languages. It can run locally, with a Gradio interface in the browser.

Argmax OSS Swift is a speech AI SDK for developers building iOS and macOS apps that process audio on the user's device. Its separate libraries cover transcription, identifying speakers and generating spoken audio.

DeepSeek-OCR is an OCR model for developers processing document images and PDFs on their own hardware. It also supports research into visual text compression, representing text-bearing images with compact sets of vision tokens.

Wan2.2 is a family of local AI video models for creators and developers who want to generate clips on their own hardware. Different models handle text, still images, speech and character animation.

VibeVoice is a family of voice AI models for developers and researchers building transcription and speech generation applications. It can capture who spoke and when, or produce spoken responses from incoming text.

ESPnet is a speech AI toolkit for researchers and developers who want to run pretrained models on their own hardware or train speech systems. Its recipes cover data preparation through evaluation, with published results for comparison.

Show 1 generates video from text prompts on your own hardware. It's aimed at researchers and developers who want to experiment with video generation while keeping the depicted scene and motion close to the prompt.

Orpheus TTS generates speech for developers building voice applications or creating custom voices. Its Llama-based models support local inference and let you control how spoken text sounds.