JustVugg/colibri

This page introduces an external open-source repository. It is not an HDATF product.

What it does

An inference engine written in pure C with no engine dependencies that runs large mixture-of-experts models on consumer hardware. It treats VRAM, RAM and storage as one memory hierarchy and streams experts from disk.

How it helps ATF

A reference for AX consulting cases where a model has to run on hardware a customer already owns. The project says it gives no speed guarantee, so it is better treated as a study reference than something to use as is.

License

Apache-2.0 Permissive, with a patent grant. Commercial use is allowed; keep the notices and state your changes.

More in this category

• router-for-me/CLIProxyAPI
  A Go proxy server that wraps CLI tools such as Codex, Claude Code, Antigravity and Grok Build behind OpenAI, Gemini and Claude compatible APIs. Compatible clients and SDKs can then reach those models, including through multiple CLI accounts.
• deepseek-ai/DeepSpec
  DeepSpec is a codebase for training and evaluating draft models for speculative decoding. It covers data preparation, draft model implementations, training against cached target model outputs and evaluation of acceptance on benchmark tasks.
• Robbyant/lingbot-map
  A feed-forward model for streaming 3D reconstruction. Its Geometric Context Transformer uses anchor context, a pose reference window and trajectory memory to correct drift over long frame sequences.
• diegosouzapw/OmniRoute
  OmniRoute is an MIT-licensed AI gateway that puts many model providers behind one endpoint for tools such as Claude Code, Codex, Cursor and Cline. It offers quota-aware fallback, token compression and a dashboard tracking provider free tiers.
• lidge-jun/opencodex
  opencodex is a local proxy that translates the Codex Responses API into other providers' formats, including streaming and tool calls. It lets Codex, Claude Code, Claude Desktop and Grok Build run models such as Gemini, DeepSeek or Ollama models.

Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.