RunanywhereAI/runanywhere-sdks
- Source
- GitHub
- First trending
- Category
- Model inference
- GitHub stars
- 10,288
- Main language
- C++
This page introduces an external open-source repository. It is not an HDATF product.
What it does
SDKs built on one shared C++ core that run LLMs, vision, speech, voice agents, embeddings, RAG and image generation locally on phones, browsers, desktops and servers. A capability registry routes each call to an engine on the device.
How it helps ATF
Loosely related. Could be a reference if an AX consulting site needs AI features that run offline on local devices.
License
Custom license Custom or non-standard license. Read the license file before any reuse.
More in this category
- p-e-w/heretic
A command-line tool that removes refusal behavior, called safety alignment, from transformer language models using directional ablation. An Optuna-based optimizer picks parameters that reduce refusals while keeping the model close to the original. - microsoft/BitNet
bitnet.cpp is the official inference framework for 1-bit LLMs, with optimized kernels for CPUs and GPUs. The project has also released 1-bit embedding models and a guide for converting and running them. - AlexsJones/llmfit
llmfit checks a machine's CPU, RAM, GPU and VRAM and recommends which open-source LLMs and quantizations it can run. It offers a terminal UI, a web dashboard, a REST API, and local benchmarks of real tokens per second. - Lordog/dive-into-llms
A free series of Chinese hands-on LLM programming tutorials from Shanghai Jiao Tong University courses, with slides, guides and notebooks on fine-tuning and deployment, prompting and chain of thought, knowledge editing, math reasoning, GUI agents and alignment. - maderix/ANE
A research proof of concept that trains neural networks directly on Apple's Neural Engine through reverse-engineered private APIs, without CoreML training APIs, Metal or the GPU. The author states it is not a maintained framework.
Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.