tashfeenahmed/freellmapi

Source
GitHub
First trending
Category
Model inference
GitHub stars
26,711
Main language
TypeScript
Website
freellmapi.co (opens in a new tab)

This page introduces an external open-source repository. It is not an HDATF product.

tashfeenahmed/freellmapi

What it does

FreeLLMAPI puts free tiers from many LLM providers behind one OpenAI-compatible /v1 API. A router picks an available model, switches providers when one is rate-limited, and tracks usage per key to stay under free-tier limits.

How it helps ATF

Its switch to another provider on rate limits and its per-key usage tracking could be a reference for how Harness handles work across several executors. The project states it is for personal experimentation only.

License

MIT Permissive. Commercial use and changes are allowed if the copyright notice is kept.

More in this category

  • google-research/timesfm
    TimesFM is a pretrained foundation model from Google Research for time-series forecasting. The latest version, 3.0, adds multivariate forecasting and support for past and future covariates.
  • antirez/ds4
    DwarfStar, a small native inference engine for running a few large language models such as DeepSeek V4 Flash and GLM 5.x on consumer hardware, targeting Metal, CUDA and ROCm. It uses only the GGUF files the project produces.
  • diegosouzapw/OmniRoute
    OmniRoute is an MIT-licensed AI gateway that puts many model providers behind one endpoint for tools such as Claude Code, Codex, Cursor and Cline. It offers quota-aware fallback, token compression and a dashboard tracking provider free tiers.
  • decolua/9router
    9Router is a router that connects AI coding tools such as Claude Code, Codex, Cursor and Cline to more than 40 providers. It falls back from subscription to cheap to free models and compresses tool results to save tokens.
  • deepseek-ai/DeepSpec
    DeepSpec is a codebase for training and evaluating draft models for speculative decoding. It covers data preparation, draft model implementations, training against cached target model outputs and evaluation of acceptance on benchmark tasks.

Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.

View on GitHub (opens in a new tab)