Just two weeks after releasing its first open source AI language model, Inkling, Thinking Machines, led by ex-OpenAI CTO Mira Murati, unveiled Inkling-Small. This new model delivers nearly the same performance as its larger predecessor while being about one-quarter the size. Inkling-Small is a 276-billion-parameter multimodal reasoning model with an Apache 2.0 license, supporting text, image, and audio inputs with a context window of up to one million tokens. Despite having fewer active parameters, it surpasses Inkling on several benchmarks, including coding and reasoning tasks. The model is designed to reduce compute requirements, inference costs, and deployment complexity, fitting enterprises with moderate GPU resources. Although it’s still too large for typical laptops or workstations, its smaller footprint enables easier operation on enterprise GPU servers or cloud clusters. The permissive Apache 2.0 license facilitates broad commercial use and customization. Thinking Machines also offers full weights on Hugging Face and fine-tuning support through its Tinker API. Inkling-Small exemplifies a more efficient, repeatable engineering pipeline, promising ongoing improvements and adaptability for diverse AI applications in coding, multi-modal workflows, and more.
Back
