Constraint Tax in Open-Weight LLMs: An Empirical Study of Tool Calling Suppression Under Structured Output Constraints
Paper LLMs & Texto

Constraint Tax in Open-Weight LLMs: An Empirical Study of Tool Calling Suppression Under Structured Output Constraints

Tool Suppression occurs when JSON Schema constraints and tool calling are jointly enabled, preventing open-weight models from invoking tools despite maintaining schema compliance,…

Hugging Face · Daily Papers ·Fangzheng Li, Aimin Zhang ·

Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.

Autores: Fangzheng Li, Aimin Zhang, Chen Lv

  • 0 upvotes da comunidade
  • Temas: Tool Calling, Structured Output, Agent systems, Tool Suppression, JSON Schema constraints, grammar-based token masks

Resumo

Resumo original (em inglês), extraído do paper:

Tool Suppression occurs when JSON Schema constraints and tool calling are jointly enabled, preventing open-weight models from invoking tools despite maintaining schema compliance, with the issue stemming from grammar-based token masking that makes tool-call tokens unreachable during decoding.

Ler o paper completo no Hugging Face →

compartilhar: