Tools tagged with "ONNX"

Piper generates spoken audio from text on local hardware. It's for developers who need a text-to-speech engine for their applications or self-hosted services.

RTranslator helps people hold spoken conversations in different languages using their Android phones. It runs translation locally and works offline.

llm-fw inspects model requests for developers and teams using AI tools, SDKs and agents. It blocks suspected prompt injection and removes outgoing secrets before forwarding approved traffic to the model endpoint.

PyTorch Lightning is a Python framework for researchers and developers pretraining or fine-tuning AI models. It handles recurring training infrastructure while leaving the model logic in your PyTorch code.

RVC WebUI is a local AI voice conversion tool for people who want to change the voice in recordings or use a live voice changer. It also lets you train a voice model from your own recordings.

SenseVoice is a local speech recognition model for developers building voice apps or analyzing recordings. Its SenseVoiceSmall model adds information about the language, emotion and surrounding sounds to speech transcriptions.

icefall is a speech model training toolkit for developers and researchers building recognition systems on their own hardware. Its Python recipes use k2 and lhotse to train, fine-tune, and evaluate models across speech datasets.

jetson-containers is a Docker container build system for developers running local AI on NVIDIA Jetson. It assembles GPU software and its dependencies into containers for workloads that need a compatible CUDA stack.

Nomic Embed Text v1.5 is an English text embedding model for developers building search and RAG applications. It represents text numerically so applications can find passages with similar meanings.

RealtimeSTT is a Python library for developers building voice assistants, dictation tools and apps that turn live audio into text. It can show text while someone speaks and produce a final transcript when they finish.

X-AnyLabeling is a desktop annotation workspace for researchers and teams preparing text, image, video, point cloud, and multimodal training datasets. Models generate initial labels, and reviewers correct them in the same workspace before exporting the data. It runs on Windows, Linux, and macOS under the GPL-3.0 open-source license.

ncnn is a C++ inference framework for developers adding on-device AI to mobile, desktop and embedded applications. It focuses on a small memory footprint and doesn't require third-party runtime dependencies.

ALH Pro processes images, video and audio on your own computer. It's for people restoring older footage, enlarging photos or illustrations, and preparing media without uploading their files.

QualityScaler is a local AI upscaler for people who want to enlarge photographs and videos and reduce noise through a Windows desktop app. It processes media on your PC without an internet connection.

funes gives coding agents a searchable memory of past work. It's for developers who want earlier decisions, reasoning and findings to remain available when they start another session or switch agents.

RealtimeTTS is a Python text-to-speech library for developers building voice assistants and other apps that need spoken responses before the full text is ready. It accepts both complete text and incoming LLM output.

Triton Inference Server, offered by NVIDIA as Dynamo-Triton, is a self-hosted AI inference server for teams deploying models in applications. It brings models from different frameworks into one serving system across on-premises, cloud and edge hardware.

InsightFace is a face and person analysis toolkit for developers building identity verification, access control and media applications. Its Python tools and recognition server can process data on your own hardware.

Soup is a local LLM fine-tuning tool for developers and teams adapting models to their own datasets. It brings training, evaluation and export into one workflow that runs on your own hardware without requiring a cloud service.

SD.Next is a self-hosted web interface for artists and researchers who want to create and edit AI images and videos on their own hardware. It supports Stable Diffusion and other diffusion models.

PaddleSeg is an image segmentation toolkit for developers building computer vision applications on their own hardware. It covers annotation, training and deployment for tasks such as medical image analysis, industrial inspection and portrait effects.

fcitx5-vinput adds voice typing to Fcitx5 on Linux. It's for people who want to dictate text and use spoken instructions to edit it, with a choice between local speech recognition and cloud services.

PaddleOCR is an OCR and document parsing toolkit for developers turning PDFs and images into data for document search, RAG systems and AI agents. Its local models cover both structured pages and text found in photographs.

BiRefNet is an AI image segmentation model for developers and image workflow builders who need to separate subjects from backgrounds. It produces foreground masks for cutouts and has dedicated models for matting, where edges can include partial transparency.

Ludwig is a framework for developers and researchers training custom AI models without writing their own training loops. It handles preprocessing, training and evaluation from a model definition, covering LLMs as well as tabular and multimodal tasks.

FastEmbed is a Python library for developers building semantic search and retrieval-augmented generation (RAG). It turns text into vectors and evaluates search results on your own hardware without requiring a cloud embedding API.

OpenVINO Model Server is a self-hosted inference server for developers and teams serving AI models on their own machines or servers. It uses OpenVINO to run workloads on x86 CPUs, including Xeon, with acceleration for Intel integrated and discrete GPUs and NPUs. It's open source under Apache 2.0.

Memvid gives AI agents persistent memory in a portable file. It's for developers who need agents to recall conversations or search documents without running a separate database server.

KServe serves LLMs and predictive machine learning models on your own Kubernetes infrastructure. It's for teams that need to put models from different frameworks into production through one serving platform.

Wyoming Faster Whisper converts speech to text on your own hardware for Home Assistant and other Wyoming-compatible clients. It's for home voice systems that need local transcription and better recognition of household names.

MinerU is a local document parser for people preparing files for AI workflows. It handles scanned PDFs, academic papers and other documents containing OCR text, tables, figures or complex layouts.

PaddleDetection is a computer vision toolkit for developers building image and video analysis systems. It covers training, adapting and deploying models for uses such as inspection and traffic analysis.

Infinity Embeddings is a self-hosted model server for developers building semantic search and retrieval-augmented generation applications. It runs retrieval models on your own hardware and can serve several models together.

PixlStash is an image manager for photographers culling shoots, creators reviewing AI images and people preparing datasets. It helps you find relevant pictures and review which ones to keep in large collections.