hotai.news
← Back to AI Newsflash
AI News / Event details
x.com · Published

CMU and JetBrains paper finds token spending measures AI usage, not engineering output

Automated summary · Based on collected summaries; not individually verified
Prepared by HotAI

What happened

A study by Carnegie Mellon and JetBrains reveals that token consumption reflects how much engineers rely on AI agents rather than their actual productivity. The research linked agent token usage over five weeks among 404 JetBrains engineers with their code submission records, analyzed survey responses from 412 employees, and found that about 90% of technical roles evaluated using agents for tasks beyond coding.

Background

What is an AI agent? Compare it with a chatbot through a document task

This article focuses on LLM-powered AI agents: systems that choose an action for a goal, obtain external results through tools, and use those results to continue or stop. An agent organizing meeting records might search files, discover that a date is missing, and inspect another record. A basic Q&A interaction generates a response; an agent also dynamically directs execution. One tool call alone does not demonstrate that control. Check the tool records and final result.

What is a token? Its relationship to text length, usage, and context budgets

A token is a discrete unit used to process text, potentially a character, part of a word, or punctuation depending on the tokenizer. It is not a fixed number of Chinese characters or English words. Budgets and usage often use tokens, but accounting differs by model and interface. Use the target model’s counting method and inspect reported usage.

Reading notes

The event summary comes from collected excerpts. Background passages quote existing HotAI articles to explain terms and do not establish new facts about this event. Check the original sources for product results, conditions and subsequent updates.

Original source

Sources and collection timeline

SourceReport titleOriginal publication timeCollected by HotAI
x.comCMU and JetBrains paper finds token spending measures AI usage, not engineering output2026-11-12 01:132026-11-12 01:42