PrismML-Eng/Bonsai-demo

Source
GitHub
First trending
Category
Model inference
GitHub stars
2,356
Main language
Shell
Website
prismml.com (opens in a new tab)

This page introduces an external open-source repository. It is not an HDATF product.

PrismML-Eng/Bonsai-demo

What it does

A demo for running Bonsai language models locally on GPUs or CPUs. Its Bonsai 2 demo includes vision inputs, tool calls and MCP server support.

How it helps ATF

Harness can compare its local inference and tool-calling setup as a reference for execution backends.

License

Apache-2.0 Permissive, with a patent grant. Commercial use is allowed; keep the notices and state your changes.

More in this category

  • TheoLeeCJ/openjev
    An open-model experiment that reads typed option probabilities directly instead of generating answer text. It explores Jev's interface pattern rather than reproducing its undisclosed model or training.
  • vinnylarouge/jevlike
    Jevlike is an independent starter model that reads a text and a changing list of text options and returns one probability per option in a single pass. Demos apply the same approach to Doom controller buttons and chess moves.
  • anthropics/uplifting-biomolecular-modeling
    A reference collection of inference optimization kits for protein and genomics machine-learning tools at pinned upstream versions. The release is not maintained and does not accept contributions.
  • modelscope/ms-cookbook
    ModelScope Cookbook is an open-source guide to building applications with open-source models, covering model selection, inference, fine-tuning, evaluation, RAG and agents. Its runnable examples include enterprise knowledge Q&A and customer-service quality analysis.
  • hr98w/jev-visual
    An educational Apple Silicon experiment using Qwen3.5 and MLX to answer multiple questions about one image by scoring candidate outputs. It includes a local browser interface, CLI and HTTP API.

Only repositories in the ranked Trendshift lists are included, and the lists are used only to find candidates. We do not copy their ranks. Descriptions, licenses and star counts come from each GitHub repository. The notes are our own reading. We have not tested these projects, and a place on a trending list does not prove quality.

View on GitHub (opens in a new tab)