Thinking Machines unveils Inkling: Open-weights AI model
Two years ago, Meera Murati, formerly CTO of OpenAI, left her position without a backup plan, driven by a desire to explore new ventures. This led to the creation of Thinking Machines, a company that secured a $2 billion investment from A16Z. Until recently, the company was primarily known for its $12 billion valuation before releasing any products.
Introducing Inkling
Thinking Machines has now released Inkling, an open-weights model trained from scratch. Inkling possesses capabilities to see, hear, reason, and can be fine-tuned for real-world applications.
The Genesis of Thinking Machines
In the past year, Meera Murati assembled a formidable team, including OpenAI co-founder John Schulman and VP of Research Barrett Zoph, along with numerous senior researchers. This team first launched Tinker, an API designed for fine-tuning open-weight models. Tinker allows users to customize models without managing their own infrastructure or losing control over the training process.
Inkling's Architecture and Capabilities
Inkling is a mixture-of-experts model featuring 970 billion total parameters. However, it doesn't utilize all parameters simultaneously. Instead, each token is routed to a small subset of specialized experts, meaning only 41 billion parameters are activated per token. This design allows Inkling to achieve the intelligence of a massive model with significantly reduced computational demands.
The model was pre-trained on 45 trillion tokens of text, images, and audio, and it supports a 1 million token context window. Unlike many other open models, Inkling's weights are Apache licensed and are available on Hugging Face.
Performance and Strategic Positioning
On standard benchmarks, Inkling's raw intelligence is surpassed by models like Fable 5 and GPT 5.6 Soul, placing it in the mid-range among open Chinese models. Its release was closely followed by Moonshot's announcement of Kimmy K3, a 2.8 trillion-parameter model that competes directly with Fable 5.
Despite not being the most powerful model in terms of raw intelligence, Inkling's design emphasizes flexibility and efficiency. It features a "thinking effort" dial that allows users to adjust the model's computational intensity. Lowering the dial provides quick, inexpensive answers, while increasing it enables the model to match the performance of Neotron 3 Ultra on Terminal Bench, using only a third of the tokens. This feature is particularly beneficial for agents running millions of times daily.
Innovative Features
One of Inkling's flagship demonstrations involved connecting it to Tinker and instructing it to remove its own ability to use the letter "E." The model then wrote its own training script, generated data, executed the job, and loaded new weights, effectively "lobotomizing" itself.
Inkling also incorporates "epistemics," a training methodology that rewards the model for admitting what it doesn't know rather than making confident but incorrect guesses. This makes Inkling one of the leading models for forecasting future events, outperforming GPT 5.5 and Opus 4.8, and it will explicitly state when it is uncertain.
Furthermore, Inkling processes raw audio and pixels directly, bypassing the need for separate encoder models that translate images and audio into tokens.
Unique Training Side Effects
During its extensive reinforcement learning, specifically after 30 million training rounds, Inkling's internal monologue began to shorten words to save tokens, transitioning from proper English to a more concise, "caveman-like" speech pattern.
The Business Strategy
Thinking Machines acknowledges that Inkling is not intended to dethrone leading AI labs. The core strategy is to provide a capable, free model and then charge for fine-tuning services via Tinker. This allows users to customize Inkling into specialized models tailored to specific problems.
Takeaways
- Inkling is an open-weights mixture-of-experts model with 970 billion total parameters, but only about 41 billion are activated per token, enabling high intelligence with lower compute.
- The model was trained on 45 trillion tokens of text, images, and audio and supports a 1 million‑token context window, with weights released under an Apache license on Hugging Face.
- Inkling introduces a “thinking effort” dial that lets users trade off speed for accuracy, allowing cheap quick answers or higher‑quality results comparable to top‑tier models while using fewer tokens.
- Innovative features include self‑modifying capabilities demonstrated by removing its own ability to use the letter “E,” and an “epistemics” training method that makes the model explicitly admit uncertainty, improving forecasting performance.
- Thinking Machines’ business model focuses on offering Inkling for free and monetizing custom fine‑tuning through the Tinker API, targeting large‑scale agent deployments rather than competing directly with leading AI labs.
Frequently Asked Questions
What is the 'thinking effort' dial in Inkling and how does it impact computational cost?
The “thinking effort” dial is a user‑controlled knob that scales the amount of computation Inkling applies to each request. At a low setting the model runs with minimal compute, delivering quick, inexpensive answers; raising the dial allocates more resources, producing higher‑quality results comparable to premium models while still consuming only a fraction of the tokens.
How does Inkling’s mixture-of-experts design activate only 41 billion parameters per token?
It routes each token to a small subset of specialized expert sub‑networks, so only those experts are evaluated, keeping active parameters around 41 billion despite a total of 970 billion, which cuts compute while preserving model capacity.
Who is Fireship on YouTube?
Fireship is a YouTube channel that publishes videos on a range of topics. Browse more summaries from this channel below.
Does this page include the full transcript of the video?
Yes, the full transcript for this video is available on this page. Click 'Show transcript' in the sidebar to read it.
Helpful resources related to this video
If you want to practice or explore the concepts discussed in the video, these commonly used tools may help.
Links may be affiliate links. We only include resources that are genuinely relevant to the topic.