Training foundation large language models (LLMs) traditionally costs millions and demands massive internet-scale datasets, making it inaccessible for most enterprises. Sapient has introduced HRM-Text, a novel approach using a Hierarchical Recurrent Model (HRM) architecture that sharply reduces training costs and data needs.
Unlike conventional Transformer models, HRM-Text splits computation into slow-evolving strategic and fast-evolving execution layers, training exclusively on instruction-response pairs rather than raw text. This targeted approach aligns better with real-world business requirements where specific, actionable responses are preferred.
Sapient’s team successfully trained a 1-billion-parameter HRM-Text model from scratch using just 40 billion tokens—far fewer than typical LLMs—and achieved competitive performance on major benchmarks like MMLU, GSM8K, and MATH. The model was trained in less than two days on a 16-GPU cluster, costing about $1,500, demonstrating up to hundreds of times greater efficiency in compute and data consumption than leading models.
This breakthrough means enterprises can now develop their own highly capable reasoning models without the need for massive infrastructure, enabling custom solutions with proprietary data while bypassing the need to memorize vast amounts of general internet data. HRM-Text’s design focuses on reasoning capacity rather than memorization, supporting applications such as financial reasoning, compliance logic, and scientific workflows.
Although still a proof-of-concept rather than a plug-and-play chatbot replacement, HRM-Text points toward a future where affordable, compact, and efficient AI models become critical tools in enterprise AI strategy. As training costs drop, companies can shift from asking if they can afford foundational AI to deciding how best to tailor models for their unique business needs.
