Tools tagged with "Batch processing"

Wan2GP brings video, image, music and speech generation to your own computer, with particular attention to GPUs with limited memory. It's for creators who want several media models in one browser interface. The project builds on Wan-Video/Wan2.1.

Firecrawl helps developers give AI agents and applications access to current web content. It searches for pages, extracts their contents, and returns data in forms an application can use. The project is open source under AGPL-3.0 and can run on a self-hosted server. Firecrawl also offers a hosted service that requires an account and API key and includes additional features. Reaching live websites requires an internet connection.

vLLM is an open source engine for serving large language models on hardware you control. It suits developers and teams that need to handle many requests through an API while making efficient use of memory and compute. It's licensed under Apache 2.0 and can run with GPUs or on a CPU.

InvokeAI is a free, open-source image generator for artists and production teams who want to create and edit images on their own hardware. Its locally hosted web interface brings image generation, canvas editing and workflow tools into one application. With local models, prompts and artwork stay on the machine you control.

Fish Speech, currently featuring Fish Audio S2 Pro, is a self-hosted text-to-speech system for creators producing narration and developers building voice applications. It combines voice cloning with control over emotion and delivery within a script. Code and model weights use the custom FISH AUDIO RESEARCH LICENSE.

SGLang is a self-hosted inference framework for teams that need to serve language and multimodal models on their own hardware. It runs on a single GPU or across distributed clusters and exposes an OpenAI-compatible API. The project is open source under the Apache 2.0 license.

Qwen3 is a family of language models from Alibaba Cloud’s Qwen team for people who want to run models locally or on their own servers. It spans smaller and larger dense models as well as mixture-of-experts models. The weights are publicly available.

rembg removes image backgrounds on your own hardware, with batch processing and a Python library for developers building image workflows. It's also useful for people preparing product cutouts or portraits who want control over processing and model choice. Local models keep images on your machine and can work offline once downloaded.

PicApport is a self-hosted photo server for families and businesses that want a searchable media archive on their own hardware. Its AI tagging add-on recognizes image content without sending photos to a cloud service and saves the resulting tags in image metadata. The server runs on Windows, Linux or macOS, with a Docker image available, and you access the gallery through a browser.

OpenWhispr is a free, MIT-licensed dictation and meeting transcription app for people who want voice input across their apps with control over where processing happens. It's available on macOS, Windows, Linux and iOS. Local transcription works offline and keeps audio on your device; optional cloud transcription sends audio to the selected provider, whose retention policies apply.

Waifu2x-Extension-GUI is a local AI upscaler for Windows users working with anime, photos and video. It combines image enlargement, noise reduction and video frame interpolation in a desktop interface. Media processing stays on your PC; the app doesn't upload your files or collect user data.

Aiko is a paid, native transcription app for macOS, iOS and visionOS that processes speech on your device with OpenAI's Whisper model. It's for people turning meetings, lectures or other recordings into text while keeping the audio local, including sensitive recordings.

Bisheng is an open source, self-hosted platform for teams building AI applications around business documents and processes. Its visual workflow editor combines automated tasks with human feedback, including intervention during multi-turn conversations. It's suited to document review, support ticket assistance and report generation that need more control than a single chatbot exchange.

Demucs separates a finished song into vocals, drums, bass and the remaining accompaniment on your own computer. It's for musicians who need individual stems or a vocal-free backing track, and developers building audio tools. The project is archived and no longer maintained. Its Python code is open source under the MIT license.

AI Render is a Blender add-on that uses your scene and a text prompt to generate an image with Stable Diffusion. It's for Blender artists who want to use their 3D work as the basis for AI images and explore different treatments within the application they already use.

digiKam is a local photo manager and image editor for photographers who need to organize large collections of photos, RAW files and videos. It runs on Linux, Windows and macOS and is open-source software under GPL-2.0. Its archived GitHub mirror points contributors to the maintained KDE repository.

Nougat is a local AI PDF parser for researchers and developers who need scientific papers as usable text, including their equations and tables. It converts academic PDFs into Markdown-style documents with LaTeX notation, so the output retains structure that plain text extraction can lose.

Qwen3-Embedding is a family of text embedding models for developers building search and document analysis on their own hardware or servers. It turns text into numerical representations that applications can compare by meaning. Its multilingual support covers languages including English, Chinese, Arabic and Ukrainian, as well as programming languages.

NMKD Stable Diffusion GUI is a local AI image generator for people who want to create and edit images on a Windows PC. It combines Stable Diffusion generation with inpainting, LoRA training and image post-processing in a desktop interface. It's open source under GPL-3.0.

insanely-fast-whisper is a command-line tool for people who want to transcribe audio on their own hardware, with a focus on processing long recordings quickly. It runs OpenAI's Whisper locally on NVIDIA GPUs or Apple Silicon Macs, including support for Windows with CUDA. The project is open source under the Apache 2.0 license.

Stable Fast 3D turns a single object image into a textured 3D mesh on your own hardware. It's aimed at game and VR developers, designers and people creating product models for e-commerce. Built on TripoSR, it uses a retrained model designed to produce meshes and textures suitable for use in games and other 3D projects.

AudioLDM 2 generates sound effects, music and speech on your own hardware. It's a Python tool for people experimenting with synthetic audio, including sound designers and researchers who want to work with pretrained models. A Gradio browser interface and command-line tools provide access to local generation; a hosted Hugging Face demo is also available.

TripoSR reconstructs a 3D object from a single image on your own hardware. Developed by Tripo AI and Stability AI, it's an open-source model for researchers, developers, and artists who want image-based 3D generation they can use in their own projects. The MIT license covers both the source code and pretrained models.

Nomic Embed Text v1.5 is an English text embedding model for developers building semantic search, document retrieval, and RAG applications on their own hardware or servers. It turns text into numerical representations that applications can compare by meaning. Its main distinction is adjustable embedding size: you can use smaller vectors when storage matters, with a tradeoff in retrieval quality.

LMQL is a programming language for developers who need model calls and ordinary Python logic in the same program. It lets you define rules for generated text, including types, length limits, allowed answers and stopping phrases. Those rules apply during generation, so you can constrain intermediate responses as well as the final output.

DataTrove is an open-source Python library for teams preparing large text datasets, including LLM training corpora. It runs on your own machine or on Slurm and Ray clusters, with processing steps that carry across those environments. It uses the Apache 2.0 license.

Stable Audio Open is a text-to-audio model you can run on your own hardware to generate sound effects, field recordings and music samples. It's aimed at artists and machine learning practitioners experimenting with audio generation, and it performs better on environmental sounds and effects than on music.

GTE (General Text Embedding) is Alibaba’s family of downloadable models for representing text as vectors. Developers use these representations to compare queries with documents, cluster related text or supply retrieval components for larger applications.

ColPali is a local AI document retrieval library for developers and researchers building document search or retrieval-augmented generation systems. It searches pages as images, using their text, charts and layout together rather than relying on a separate OCR pipeline. The colpali-engine package is deprecated; its maintainers recommend Sentence Transformers for new projects and production use.

AutoAWQ is a Python library for developers who want to compress and run LLMs on their own hardware using 4-bit Activation-aware Weight Quantization (AWQ). The project is archived and no longer maintained. It's open source under the MIT license. It installs as a Python package, with optional kernel or Intel CPU dependencies.

Higgs Audio is a family of text-to-speech models from Boson AI for developers building narration and conversational audio. Higgs TTS 2 can adapt pacing and intonation to the text and generate dialogue with distinct speakers across multiple languages.

TensorZero is a self-hosted platform for developers building LLM applications. The project is archived and no longer maintained. It combines a model gateway with tools for inspecting responses, evaluating workflows, and improving prompts using production data and human feedback.

pgai keeps search embeddings in sync with PostgreSQL data for developers building RAG applications and AI agents. It's a Python library with database components and workers you can self-host, including in Docker. The project is archived and no longer maintained or supported. Its code is open source under the PostgreSQL License.

Cognita is a self-hosted RAG framework for developers building applications that answer questions using their own documents. The project is archived and no longer maintained. It combines a browser interface for document Q&A with reusable components built on LangChain and LlamaIndex, under the Apache 2.0 open-source license.

CogView4 is a text-to-image model you can run on your own hardware, with support for Chinese and English prompts and Chinese text within generated images. It's aimed at developers and image creators who want local AI generation with native Chinese language support. The CogView4-6B model weights and repository code use Apache 2.0.

OGX, formerly Llama Stack, is a self-hosted AI application server for developers building chat apps, document search or AI agents. It brings model inference, file storage, vector search and agent orchestration into one process. You can run it on a laptop, in a datacenter or in the cloud. It's open source under MIT.