Edge0-AI/Edge0

This page introduces an external open-source repository. It is not an HDATF product.

What it does

Edge0 is a streaming MoE inference framework using SSD expert offloading, Recover-LoRA and routing prediction. Its README distinguishes released platform engines from a unified framework planned for Q4 2026.

How it helps ATF

Harness can compare its SSD offloading approach when evaluating local inference executors. Platform-specific availability and the planned unified framework should be assessed separately.

License

Apache-2.0 Permissive, with a patent grant. Commercial use is allowed; keep the notices and state your changes.

More in this category

• Vibra-Ingenn/Janus
  A single Go binary that runs gguf models on a local machine, using llama.cpp through Vulkan on AMD, Intel or NVIDIA graphics with a CPU fallback, and exposes an OpenAI compatible API for chat completions and models. It swaps models without a restart, splits reasoning output into its own field, and reads the chat template from gguf metadata, with no Python and no Docker required.
• magnitudedev/magnitude
  An inference engine for agents that compiles and tunes kernels on the user's hardware. It runs open models on Apple Silicon, NVIDIA, AMD or CPU and connects to existing agents through a desktop app and CLI.
• ProjectDMX/DMI
  A decoupled, asynchronous observability backend for LLM inference and training that exposes internal model states. It is a research preview with HuggingFace, vLLM and Megatron-LM integrations, and its APIs may change.
• ninjahawk/livenerf
  A longitudinal benchmark for detecting model capability drift after release. It uses frozen prompts, a pinned CLI, fixed graders and retained raw logs.
• deepopen-com/deepopen
  A non-autoregressive engine built on Laya for multilingual structured decisions. It performs multidimensional classification in a single forward pass.

Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.