Tools tagged with "Batch processing"

llm-d is a distributed LLM inference stack for infrastructure teams serving models across a Kubernetes cluster. It coordinates model servers such as vLLM and SGLang to handle production traffic across multiple machines.

GFPGAN is an AI face restoration tool for repairing low-quality photos and adding restoration to image workflows. It reconstructs facial detail using a pretrained generative model, so results can alter a person's likeness.

PhotoLife, formerly Phototheca, is a paid photo and video manager for people organizing large collections on a PC. Its AI face recognition runs locally using the computer's CPU and GPU, without sending photos to the cloud for recognition. It groups photos of the same person into named albums, so you can browse a collection by who's in it.

LMDeploy is an open-source toolkit for developers who want to run language and vision-language models on their own GPU hardware. It supports offline batch processing and model servers for applications.

Stirling PDF is a PDF workspace for editing individual documents and automating larger document workflows. It runs through a browser on your own server, with Docker deployment, or as a desktop application for Windows, macOS and Linux.

Kition is a desktop AI workspace for writing, research, and project planning. Its agent works directly with editable project files, so you can inspect proposed changes in the documents and boards they affect.

Surya is a local OCR toolkit for developers who need text and page structure from document images. It handles multilingual documents and preserves reading order for use in document-processing applications.

Whisper Desktop turns audio and video recordings into transcripts and subtitles on your computer. It's for people working with interviews, lectures, podcasts or videos who want a desktop interface for transcription and captioning.

miel is a self-hosted Gmail client for people who want AI help sorting mail while keeping the app and its database on their own machine or server. It ranks messages by priority and proposes labels, including new ones. You review suggestions before applying changes to Gmail.

Mosec is a self-hosted model serving framework for developers turning trained machine learning models into APIs. It runs on Linux and macOS, on your own hardware or cloud servers, and is open source under the Apache 2.0 license. Its main focus is handling concurrent requests while making better use of CPU and GPU resources.

Parakeet is NVIDIA's speech recognition model family. The linked English model, parakeet-tdt-0.6b-v2, is for developers building transcription services, subtitles and voice applications with a model they can run locally.

Wan2GP generates media on your own computer for creators who want to work with several AI models in one browser interface. It builds on Wan-Video/Wan2.1 and focuses on making generation accessible on GPUs with limited memory.

Lumina-Image 2.0 generates images from text on your own hardware. It's for developers, researchers and people who want a model they can use in visual workflows or adapt with their own image collections.

DeepEthogram assigns predefined behavior labels to individual video frames. It's designed for neuroscience researchers measuring animal activity, and can also serve other projects that need action detection at frame level.

Text Generation Inference (TGI) serves LLMs on your own hardware for developers building chat apps and text generation services. The project is archived and no longer receives updates.

pgai is a Python library for developers building RAG applications and AI agents around PostgreSQL data. The project is archived and no longer maintained or supported.

TensorZero is a self-hosted platform for developers who need to compare and improve models in LLM applications. The project is archived and no longer maintained.

Cognita is a self-hosted RAG framework for developers building applications that answer questions from their own documents. The project is archived and no longer maintained.