CAVEWOMAN: How Large Language Models Behave Under Linguistic Input and Output Compression

CAVEWOMAN: How Large Language Models Behave Under Linguistic Input and Output Compression

Two-channel evaluation shows output compression reduces costs while input compression increases costs and degrades accuracy across models and datasets.

Hugging Face · Daily Papers ·Morayo Danielle Adeyemi, Ryan A. Rossi · ·▲ 4 upvotes

Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.

Autores: Morayo Danielle Adeyemi, Ryan A. Rossi, Franck Dernoncourt

  • 4 upvotes da comunidade
  • Temas: inference cost, output compression, input compression, task accuracy, realized cost, reference-text agreement

Resumo

Resumo original (em inglês), extraído do paper:

Two-channel evaluation shows output compression reduces costs while input compression increases costs and degrades accuracy across models and datasets.

Ler o paper completo no Hugging Face →

compartilhar: