Niko1221/Strata

This page introduces an external open-source repository. It is not an HDATF product.

What it does

A local inference engine for Qwen3.8-Flash-Next on Windows and Linux PCs with NVIDIA GPUs. The repository describes OpenAI- and Anthropic-compatible localhost APIs and optional image input.

License

MIT Permissive. Commercial use and changes are allowed if the copyright notice is kept.

More in this category

• firelex/jeff
  Fine-tuned Qwen3.5 and Gemma 4 models classify situations against options described in plain language and return probabilities without generating text.
• Low-Zi-Hong/ESP32s3-LLM-Cluster
  A distributed language-model inference project using seven ESP32-S3 nodes and 1.58-bit quantization. A master handles tokenization and embeddings while SPI-connected nodes process model layers.
• basetenlabs/baseten-switch
  A local macOS app and gateway routing supported coding harnesses between native providers and Baseten models. It has a global routing switch and per-client model mappings and remains in beta.
• NVIDIA/Model-Optimizer
  A model optimization library with quantization, pruning, distillation and speculative decoding. It exports optimized checkpoints for downstream inference frameworks.
• deepopen-com/deepopen
  A non-autoregressive engine built on Laya for multilingual structured decisions. It performs multidimensional classification in a single forward pass.

Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.