Summary
Needle 2 is a compact agentic language model for tool calling, device use, and structured extraction on tiny devices. The complete model is a 14 MB binary that runs in about 28 MB of RAM.
Needle 2 is a compact agentic language model for tool calling, device use, and structured extraction on tiny devices. The complete model is a 14 MB binary that runs in about 28 MB of RAM.
It is built on the Simple Attention Network, compressed to CQ2-bit with Cactus Quants, and packaged in Cactus's own engine. The browser demo runs the model in WebAssembly and shows tool routing, parallel calls, multi-step actions, extraction, classification, and refusal behavior.
Needle 2 is useful for offline assistants, smart-home control, phones, wearables, robots, and embedded interfaces where memory, latency, and connectivity are constrained. Cactus reports up to 500 tokens per second on a Raspberry Pi 5 and high throughput on supported XR devices and phones.
Get more likes & reach the top of search results by adding this button on your site!


Get top updates in AI to your inbox every weekend. It's free!