Engineering teams now have an open-source coding agent alternative to managed models like Claude Fable 5 with Cohere’s North Mini Code, designed to run efficiently on a single H100 GPU. Launched recently, the model excels in producing three times the output tokens compared to similar models, which may affect production efficiency in high-volume scenarios. North Mini Code is a 30 billion parameter mixture-of-experts model activating 3 billion parameters per token, featuring a vast 256,000 token context window and a 64,000 token max generation length. It supports agentic software engineering tasks such as sub-agent orchestration, architecture mapping, code review, and terminal operations, and is available on Hugging Face under an Apache 2.0 license.
Built specifically for agentic software engineering rather than adapted from a general-purpose model, it integrates tool-use capabilities and interleaved thinking for enhanced multi-step task performance. With a focus on architecture analysis and code review across large codebases, it processes multi-file projects efficiently and supports terminal-based tasks like shell interactions and command-line tool handling.
North Mini Code operates as a sparse mixture-of-experts model with 128 experts, activating 8 per token, requiring inference compute similar to a 3 billion parameter model despite its larger size. Cohere trained it through multiple fine-tuning stages and reinforcement learning with verifiable rewards over extensive coding tasks. It outperforms comparable models in output speed and latency while being designed for local deployment to promote cost-effective and sovereign AI use.
The model competes in a market alongside Mistral Devstral Small 2, GitHub Copilot, Cursor, and Claude Fable 5, each offering distinct tradeoffs in cost and deployment. North Mini Code offers a unique balance of local deployment, cost control, and high performance, making it an appealing option for enterprises focused on production agentic coding pipelines. The release highlights important considerations about agentic training specialization, verbosity trade-offs impacting pipeline costs, and strategic pricing decisions based on actual workload needs.
