tashfeenahmed/freellmapi
- Source
- GitHub
- First trending
- Category
- Model inference
- GitHub stars
- 26,711
- Main language
- TypeScript
This page introduces an external open-source repository. It is not an HDATF product.

What it does
FreeLLMAPI puts free tiers from many LLM providers behind one OpenAI-compatible /v1 API. A router picks an available model, switches providers when one is rate-limited, and tracks usage per key to stay under free-tier limits.
How it helps ATF
Its switch to another provider on rate limits and its per-key usage tracking could be a reference for how Harness handles work across several executors. The project states it is for personal experimentation only.
License
MIT Permissive. Commercial use and changes are allowed if the copyright notice is kept.
More in this category
- google-research/timesfm
TimesFM is a pretrained foundation model from Google Research for time-series forecasting. The latest version, 3.0, adds multivariate forecasting and support for past and future covariates. - antirez/ds4
DwarfStar, a small native inference engine for running a few large language models such as DeepSeek V4 Flash and GLM 5.x on consumer hardware, targeting Metal, CUDA and ROCm. It uses only the GGUF files the project produces. - diegosouzapw/OmniRoute
OmniRoute is an MIT-licensed AI gateway that puts many model providers behind one endpoint for tools such as Claude Code, Codex, Cursor and Cline. It offers quota-aware fallback, token compression and a dashboard tracking provider free tiers. - decolua/9router
9Router is a router that connects AI coding tools such as Claude Code, Codex, Cursor and Cline to more than 40 providers. It falls back from subscription to cheap to free models and compresses tool results to save tokens. - deepseek-ai/DeepSpec
DeepSpec is a codebase for training and evaluating draft models for speculative decoding. It covers data preparation, draft model implementations, training against cached target model outputs and evaluation of acceptance on benchmark tasks.
Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.