TheTom/turboquant_plus

Source
GitHub
First trending
Category
Model inference
GitHub stars
7,028
Main language
Python

This page introduces an external open-source repository. It is not an HDATF product.

TheTom/turboquant_plus

What it does

TurboQuant+ is a research implementation of TurboQuant that compresses the transformer KV cache using PolarQuant and Walsh-Hadamard rotation. It holds a Python reference implementation, validation papers and benchmark data.

How it helps ATF

Not related to our products. Listed because it appeared in the ranked lists.

License

Apache-2.0 Permissive, with a patent grant. Commercial use is allowed; keep the notices and state your changes.

More in this category

  • google-ai-edge/gallery
    An app that showcases on-device generative AI and lets people try open-source models locally and offline on mobile devices. It includes chat with a thinking mode and agent skills that add tools such as Wikipedia.
  • jundot/omlx
    A local LLM inference server for Macs with Apple Silicon, managed from the macOS menu bar. It uses continuous batching and keeps KV cache in memory and on SSD so past context can be reused across requests.
  • shiyu-coder/Kronos
    Kronos is a family of decoder-only foundation models pre-trained on financial candlestick (K-line) data. A tokenizer turns price and volume sequences into discrete tokens, and a Transformer trained on them is used for forecasting and other quantitative tasks.
  • karpathy/nanochat
    A minimal codebase for training and chatting with your own LLM on a single GPU node, covering tokenization, pretraining, finetuning, evaluation and inference. One depth setting determines the other hyperparameters.
  • Alishahryar1/free-claude-code
    A tool that connects coding agents such as Claude Code, Codex, OpenCode and Hermes to a shared catalog of free, paid, subscription and local model providers. After retries fail, it switches to the next configured model.

Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.

View on GitHub (opens in a new tab)