MiniCPM-V 4.7 is a 35B vision model that OpenBMB says runs on a phone in 3 GB
OpenBMB's first mixture-of-experts MiniCPM-V is Apache 2.0 and downloadable now. The on-device trick is guessing which experts the next layer will need. Read more >>
Topics /
#local models
Posts
4 postsBitRun wraps BitNet in a single binary so 1-bit models run on a CPU without a compiler
An alpha-stage runner for ternary LLMs: a Go supervisor around a static C++ engine, with pull, run, and serve commands and an OpenAI-compatible endpoint. Read more >>
Apogee rebuilds a discontinued browser summarizer so the model runs inside the extension
A browser extension that summarizes pages, videos, and PDFs with small models on WebGPU or WebAssembly, with no account, API key, or backend. Read more >>
JetBrains Mellum2.1 is a 12B coding model that learned to use a terminal
The new Mellum is Apache 2.0, downloadable today, and went from 2 percent to 47 percent on SWE-bench Verified in one release. It still trails a smaller Qwen on agent tasks. Read more >>