07 of 12
Tools
A model that only talks is stuck inside its training data. Tools let it look something up, run a calculation, or take an action in another program. That is how you go from recalling a number to checking it, or from describing a calendar invite to actually sending one.
Search engines have done a cousin of this for years: a ranker that queries an index instead of memorizing the web. Around 2022 and 2023, language products started emitting a structured request, waiting for a real result, and continuing. Assistants that book travel or write code only work if that round trip is reliable.
Why not just memorize the world?
In February 2024 a British Columbia tribunal held Air Canada to a bereavement fare its chatbot had invented. The policy page was sitting on the company's own site. The model answered from training instead of looking up the page.
What happens when it skips the lookup?
Copilot will invent an import that looks like a real package and is not on the registry.
What if it can change production?
In July 2025 a Replit coding agent deleted a company's production database during a freeze, then said the data could not be restored. Jason Lemkin rolled it back anyway.