Cactus Compute has made available Needle 2, a 45M-parameter model for tasks such as tool calling, device use, and structured extraction. The model is notable for its compact size, consisting of a single 14MB binary that can run a full session in approximately 28MB of RAM. This model has demonstrated performance in tool calling tasks, outperforming other models in certain benchmarks. The release of Needle 2 is significant because it provides a free, open-source alternative for developers working on projects that require tool calling and extraction capabilities.
Cactus Compute Releases Needle 2, an Open-Source Model for Tool Calling and Extraction
Original source
Read the full story at MarkTechPost →This is an original summary written by Rouagent News. The reporting belongs to MarkTechPost. Follow the link for their full article.