Tools tagged with "Batch processing"

FastChat is a self-hosted LLM platform for developers and researchers who want to serve chat models on their own hardware and compare their responses. It powers Chatbot Arena and includes a locally hosted side-by-side comparison interface. The Python code is open source under Apache 2.0; model licenses apply separately, including Llama's license for Vicuna.

FunASR is a speech-to-text toolkit for developers building transcription services and voice applications. It supports offline recordings and live speech on local hardware or self-hosted servers, with capabilities that depend on the model and runtime.

Dolphin Document Parser converts PDFs and document images into structured content for developers working on document extraction. It handles digitally created and photographed pages, including documents that mix text with tables, formulas, and code.

SkinTokens is an AI rigging project for 3D artists and researchers preparing meshes for character animation or simulation. Its TokenRig model generates a skeleton hierarchy and the skin weights that control how the mesh moves with its bones. Local inference requires an NVIDIA GPU with at least 14 GB of memory.

MDFlux is a desktop app for turning documents into structured Markdown for AI workflows, research, or text editing. It suits people who need usable text from mixed files and scanned archives while keeping conversion on their own machine.

KeyBERT is a Python library that extracts keywords and phrases by comparing their meaning with the document they come from. It's for developers and researchers who want to add keyword extraction to text processing projects without training a model from scratch. The library is open source under the MIT license.

lm-evaluation-harness is a Python framework for researchers and developers comparing language models on shared benchmarks. Public prompts help make results comparable across model checkpoints and research papers.

Fish Speech is a self-hosted text-to-speech system for creators producing narration and developers building voice applications. Its S2 Pro model supports directed speech delivery and dialogue with multiple speakers.

PowerInfer is a local LLM inference engine for developers and researchers running large models on a PC with a consumer GPU. Its performance gains depend on sparse models, which use only part of their network for each input.

ThunderAI is an AI email assistant for Thunderbird users who want help writing messages and managing their inbox. You can process email text with a local model or send it to a cloud provider.

LMMS Eval is a Python toolkit for researchers and model teams comparing AI models on text, image, video and audio tasks. It uses a shared evaluation pipeline to reduce differences caused by separate benchmark implementations.

Real-ESRGAN is a local AI upscaler for people enlarging images or restoring degraded images and video. It builds on ESRGAN, with dedicated models for general images, anime illustrations and animated video.

Bisheng is a self-hosted AI application platform for teams working with business documents and processes. It supports tasks such as document review, support ticket assistance and fixed-layout report generation, including workflows that need human judgment during execution.

tiny-cuda-nn is a neural network framework for developers and researchers building small models, NeRF renderers and neural graphics applications. It handles training and inference on local NVIDIA GPUs.

QuPath is a free, open source desktop application for researchers analyzing whole slide pathology and microscopy images on their own computers. It combines image viewing and annotation with cell segmentation and interactive machine learning, so researchers can examine tissue and classify what they find within the same application. It runs on Windows, macOS and Linux.

LocalText2Voice is an MIT-licensed desktop app for people producing audiobooks, lessons and podcasts from long texts. Its local speech engines work offline after model downloads, keeping your text and generated audio on your computer. It runs on Windows and Linux; macOS isn't officially supported.

Dingo combines rule checks, LLM judges and agent-based evaluation to assess AI training data, fine-tuning datasets and production systems. It's an open-source Python tool under Apache 2.0 for data engineers, ML practitioners and researchers who need to find data problems and compare model or application quality. Evaluation can run locally or across a Spark cluster.

TaxHacker is a self-hosted AI accounting app for freelancers, indie hackers, and small businesses that need to turn receipts and invoices into searchable transactions. The project is in early development. Its open source edition runs on your own infrastructure or home server through Docker and uses the MIT license.

Photomator is a paid photo editor for Mac, iPhone, iPad, and Vision Pro that combines manual color controls with machine learning tools. It's for photographers who want to edit RAW files, retouch individual shots, and apply consistent adjustments across a photo collection within Apple's native apps and file system.

Trainable Weka Segmentation is a local image segmentation plugin and Java library for Fiji. It's for researchers and image analysts who want to teach a classifier which image regions belong to each class, then apply that model to other images or stacks. It's free and open source under GPL-3.0.

OpenCodeReview is a locally installed AI code review CLI for developers who want findings tied to specific code lines. It sends code to a configured LLM endpoint through OpenAI- or Anthropic-compatible APIs. The local CLI handles the review process; model inference depends on that endpoint.

EvalScope is a Python evaluation framework for teams comparing AI models or assessing a model service before deployment. It connects scores to the prompts, predictions and reviews behind them so you can examine individual results.

rclip searches folders by what their images contain, without requiring tags or a separate photo library. It's for people who keep image collections on their own computers or servers and want to search them from a terminal.

Infinity Embeddings is a self-hosted model server for developers building semantic search and retrieval-augmented generation applications. It runs retrieval models on your own hardware and can serve several models together.

PixlStash is an image manager for photographers culling shoots, creators reviewing AI images and people preparing datasets. It helps you find relevant pictures and review which ones to keep in large collections.

WhisperJAV generates subtitles for Japanese adult videos on your own computer. It targets difficult audio with quiet dialogue, loud vocalisations and long stretches that can cause speech recognition models to invent or repeat words.

faster-whisper is an open source Python library for developers adding speech transcription to their software. It uses CTranslate2 to run OpenAI's Whisper models, with faster transcription and lower memory use than the original implementation in the project's benchmark comparisons.

USearch is a vector similarity search library for developers building semantic search and recommendation systems within their own apps or servers. Its compact C++ core supports custom similarity rules and has no mandatory dependencies.

Paperless-GPT adds AI document processing to an existing paperless-ngx archive. It's for people who want to reduce manual sorting and extract text from scanned paperwork.

OpenWhispr is a dictation and meeting transcription app for people who want to write by voice and keep searchable records of conversations. It lets you choose local processing or cloud providers.

Ollama Python is a client library for developers adding model conversations to Python applications. It connects to a running Ollama service for local use or to Ollama's cloud service for larger models.

ExLlamaV2 and V3 are local LLM inference libraries for developers building AI applications or hosting models on consumer GPUs. V2 is archived for now and isn't currently maintained; development continues in V3.

Vibe is a desktop app for people who need transcripts or subtitles from recordings without uploading them to a transcription service. It handles audio and video locally, including interviews, meetings and material in different languages.

Data-Juicer is a Python framework for researchers and teams preparing datasets for AI training, evaluation, agents or document retrieval. It processes data on your own machine or across a Ray cluster.