FreeLLMAPI setup and comparison with OpenRouter and LiteLLM

FreeLLMAPI is a self-hosted router for combining the free API tiers attached to your provider accounts. The tutorial covers Docker Compose setup, adding provider keys in a local dashboard, and connecting a Python client through an OpenAI-compatible endpoint. The speaker says credentials stay encrypted locally; inference requests still go to external providers.

After configuration, FreeLLMAPI builds a model catalog from the available providers. The dashboard shows token allowances and routing options, with a balanced strategy selected in the demonstration. The router tracks provider health, quotas and rate limits, then can move requests to another provider when one becomes unavailable. A Python coding example requests a CLI task manager, but the speaker creates the files manually from the returned terminal output.

The comparison describes OpenRouter as a hosted service with its own available capacity and LiteLLM as a broader, more configurable gateway. FreeLLMAPI focuses on pooling the user's existing free allowances. The speaker presents it as useful for experiments and AI agent workloads where variable latency is acceptable.

The opening token total is the speaker's claim, not a guaranteed allowance. Provider quotas can change, models can disappear, and routing may select a model the user would not have preferred. The speaker cautions against relying on these free tiers for production infrastructure or consistent access to the strongest models.