AMAZINGINDEX.COM 让生活多一点 Amazing
59.4
VOL. 2026.09
2026.09.23
← 返回 2026.09.23 日报
日报快照 · Daily Snapshot
NO. 016

AI代理异步工具调用省40%成本

#ARTICLE HackerNews 2026.09.23
推荐指数 65.0 NO. 016 · 2026.09.23
发布2026/09/22Score50Comments38

Unreal Agent推出异步工具调用框架,让模型无需等待轮询工具结果,直接降低40%运行成本。对部署生产级AI代理的团队,这是不牺牲性能就能大幅削减账单的可行路径。

当前主流方案如OpenAI的function calling、Anthropic的tool use都是同步模式,模型必须生成等待标记并占用上下文窗口跟踪工具状态,token burn严重。Unreal Agent的异步化思路类似把协程机制引入LLM推理层,模型只发指令、不阻塞等待,这和传统编程从同步IO到async/await的演进逻辑一致。

Codex这类官方方案在工具链深度集成上有优势,但成本结构对高频工具调用场景不友好。如果你在构建需要频繁调用外部API的agent(如数据分析、运维自动化),值得对比测试两者的实际token消耗和延迟表现,特别是长链路多步工具调用场景。

意见分歧 37 条评论

核心争论:异步工具调用是否真省token,以及AI代理架构应从聊天模型转向异步Actor系统

nylonstrung

I don't really understand how async tool calls translate to token savings It says that it removes tokens wasted while a model is waiting on synchronous tool calls. What tokens exactly is Pi using when waiting?

dumberquestions

I think a running agent periodically checks if a process it started has finished.

solarkraft

I think this is what I’ve been waiting for! Live interactions with models are fundamentally asynchronous! This will be great for interactivity. What a good time for harness design. Just while OpenCode is growing up a bit and focusing on their harness. I’m delighted to see people focusing on good gen

替代方案: OpenAI CodexOpenCodeAstra
查看原文 →