π Tool CallingΒΆ
Metric that evaluates tool call predictions with reference calls. Generate aggregated metrics on tool name, tool parameter selection , and tool parameter value type. Can supports multiple references.
metrics.tool_calling
Explanation about ToolCallingMetricΒΆ
Compares each predicted tool call with list of references tool call.
Read more about catalog usage here.