AI Glossary/Function Calling

What Is Function Calling?

Definition

Function calling is a capability of large language models that allows them to generate structured JSON outputs describing which external function or API to call and with what arguments, enabling AI to interact with real-world systems and data sources.

How Function Calling Works

Function calling bridges the gap between conversational AI and actionable software. Instead of simply generating text, an LLM with function calling can recognize when a user's request requires external data or actions — such as checking the weather, querying a database, or sending an email — and produce a structured function call with the appropriate parameters. The model does not execute the function itself; rather, it outputs a JSON object specifying the function name and arguments, which the application then executes and feeds the result back to the model for a natural language response. This pattern enables developers to build AI assistants that can perform real tasks, not just answer questions. OpenAI popularized the concept with their function calling API, and it has since been adopted by Anthropic, Google, and open-source models. Function calling is foundational to building AI agents, as it gives models the ability to take actions in the world rather than being limited to text generation.

Real-World Examples

1

A ChatGPT plugin calling a restaurant booking API when a user asks to reserve a table for dinner

2

An AI assistant calling a weather API with location and date parameters to provide a forecast

3

A customer support bot calling an internal order-tracking function to look up a customer's shipment status

V

Function Calling on Vincony

Vincony's multi-model platform supports models with function calling capabilities, letting developers test how different LLMs handle tool use across 400+ models.

Try Vincony free →

Recommended Tools

Related Terms