AI代理异步工具调用省40%成本
推荐指数 65.0 NO. 016 · 2026.09.23
发布2026/09/22Score50Comments38
为什么值得看
Unreal Agent推出异步工具调用框架,让模型无需等待轮询工具结果,直接降低40%运行成本。对部署生产级AI代理的团队,这是不牺牲性能就能大幅削减账单的可行路径。
编辑判断
当前主流方案如OpenAI的function calling、Anthropic的tool use都是同步模式,模型必须生成等待标记并占用上下文窗口跟踪工具状态,token burn严重。Unreal Agent的异步化思路类似把协程机制引入LLM推理层,模型只发指令、不阻塞等待,这和传统编程从同步IO到async/await的演进逻辑一致。
Codex这类官方方案在工具链深度集成上有优势,但成本结构对高频工具调用场景不友好。如果你在构建需要频繁调用外部API的agent(如数据分析、运维自动化),值得对比测试两者的实际token消耗和延迟表现,特别是长链路多步工具调用场景。
社区反馈
意见分歧 37 条评论
核心争论:异步工具调用是否真省token,以及AI代理架构应从聊天模型转向异步Actor系统
I don't really understand how async tool calls translate to token savings It says that it removes tokens wasted while a model is waiting on synchronous tool calls. What tokens exactly is Pi using when waiting?
I think a running agent periodically checks if a process it started has finished.
I think this is what I’ve been waiting for! Live interactions with models are fundamentally asynchronous! This will be great for interactivity. What a good time for harness design. Just while OpenCode is growing up a bit and focusing on their harness. I’m delighted to see people focusing on good gen