πŸ“„ Tool CallingΒΆ

Metric that evaluates tool call predictions with reference calls. Generate aggregated metrics on tool name, tool parameter selection , and tool parameter value type. Can supports multiple references.

metrics.tool_calling

Explanation about ToolCallingMetricΒΆ

Compares each predicted tool call with list of references tool call.

Read more about catalog usage here.