gpustat is a local command-line GPU monitor for people running AI models or other workloads on NVIDIA hardware. It puts GPU activity and the processes using each device into a compact terminal view, useful when you need to check memory use or see who’s occupying a shared GPU. It's open source under the MIT license.
The default display shows each GPU's name, temperature, utilization, and used versus total memory. It also shows running GPU processes and their memory consumption. Process details can include the owner's username, process ID, and full command, so you can connect resource use to a particular job rather than just see that a device is busy.
For longer-running workloads, watch mode refreshes the display at a chosen interval. You can inspect selected GPUs and include fan speed, power draw and limits, or video encoder and decoder utilization. Colored output helps separate the readings in the terminal, and you can hide process information when you only need device statistics.
The tool also fits into scripts: it can return JSON, and its Python API exposes GPU queries to your own code. It reads NVIDIA's monitoring data through NVML using the official nvidia-ml-py bindings. gpustat requires an NVIDIA driver and supports NVIDIA GPUs only; it doesn't support AMD hardware.
Claim this page and we'll verify you by hand. gpustat gets the verified badge, and you can upgrade the listing to be featured on localhosted. Proud to be listed? Put our badge on your site.
Want more people to find gpustat?Promote it
Something wrong or outdated on this page?
5.1KUpdated 20 hours agoApache-2.0
#Batch processing#Distributed execution#LoRA
AIBrix is open-source infrastructure for teams serving large language models on their own Kubernetes clusters. It focuses on the work around inference: directing requests, scaling capacity and managing models across servers. Enterprise infrastructure teams can use its components to build a self-hosted model service. It's licensed under Apache 2.0.
4.6KUpdated 4 years agoMIT
macOS
asitop is a terminal hardware monitor for Apple Silicon Macs, with separate views of CPU, GPU and Apple Neural Engine activity. Its README targets Apple Silicon on macOS Monterey; hardware-counter availability can differ on newer macOS releases. It runs locally and suits people who want to watch hardware use during demanding workloads, including local AI inference. It's free and open source under the MIT license.
6.9KUpdated 2 days agoApache-2.0
Docker · Web#Code execution#Git integration#Multi-user access
2.3KUpdated 1 day agoMPL-2.0
macOS · Windows · Linux · Docker#Agent Skills#Batch processing#Multi-user access
2.6KUpdated 1 week agoAGPL-3.0
Linux · Docker
jetson-stats monitors NVIDIA Jetson hardware and gives you control over its power and cooling settings. It runs locally on the board, with a terminal interface called jtop for people developing or running workloads on Jetson devices, including local AI applications.
1KUpdated 7 days ago
#Distributed execution#Hugging Face integration#LoRA
Kaito manages self-hosted LLM inference, fine-tuning, and document retrieval services in a Kubernetes cluster. It's for teams that want to run models on infrastructure they control while reducing the work of sizing GPU resources and managing model deployments. The project is open source under Apache 2.0.
ClearML is an MLOps suite for recording experiments, managing datasets and running ML workloads. Its Apache 2.0 Python SDK connects to a ClearML Server, available as a hosted service or open-source software you deploy yourself. ClearML Agent handles job orchestration and reproducibility.
dstack is a self-hosted orchestration tool for AI teams managing compute across GPU clouds and their own servers. It puts cluster management, training jobs and model inference behind one interface, so teams can use different providers and accelerators without maintaining a separate workflow for each environment. It's open source under the Mozilla Public License 2.0.