Tool calls: the model chooses, the program runs

In a tool call (function calling) the model, instead of answer text, names a tool and its arguments in a structured form, for example {"vosita": "qosh", "args": [2, 3]}. The program reads this text, runs the matching function and returns the result to the model.

import json

def qosh(a, b):
    return a + b

chaqiriq = json.loads("""{"vosita": "qosh", "args": [2, 3]}""")
print(qosh(*chaqiriq["args"]))

Output5

In the example below json.loads turns the call text into a dictionary, and * passes the values from the list to the function as separate arguments. If the tools are stored in a dictionary, they are easy to find by name.

Safety: run only tools that were registered in advance; reject an unknown name. Never run, without permission, an action that does not belong to the called function (for example, deleting files).