Tool calling

Tool calling is the mechanism by which a language model can run functions you define instead of only writing. You describe the available tools, the model decides which one to use and with what arguments, and it receives the result to fold into its answer.

What is tool calling?

Tool calling is the mechanism by which a language model can run functions you define instead of only writing. You describe the available tools, the model decides which one to use and with what arguments, and it receives the result to fold into its answer.

Also: function calling · tool use

Why it matters

What changes in a SaaS

It is what turns a text generator into something that resolves. Without tools, the most a system can do is explain how to raise a limit; with them, it raises it and confirms the result in the same conversation. It is the piece that separates a chatbot from an agent.

Primer plano de una placa de circuito

Tool calling in detail

  • How it works

    The model gets a description of each tool: what it does, what parameters it needs and what it returns. Faced with a question, it either answers directly or asks for a tool to be run. Your system runs it, returns the result, and the model writes with it.

  • The model does not run anything

    An important nuance for understanding the risk: the model only *asks* for a function to be called. Your system is what runs it, and it can check permissions, validate arguments and refuse. That is where the limits live, not in the model.

  • Which tools to expose

    The useful rule is the same as with any permission: only what is needed, and reads separate from writes. Checking a plan is a read; cancelling a subscription is a write, and probably should not be available without a person confirming.

Questions about tool calling

What is tool calling?

The mechanism by which a language model can ask for functions you define to be run: looking up a value, making a change, calling your API. It is what lets a support system resolve instead of explain.

Can a model run anything on my systems?

Only what you enable. The model asks for a function to be called; your system runs it, checks permissions and can refuse. The limits go there.

Related terms

A term on its own is only half understood. These come up in the same conversation.

Try it without dropping what you use