香农信道理论对AI系统的启示
推荐指数 50.0 NO. 017 · 2026.09.26
发布2026/09/25Score89Comments17
为什么值得看
Alan Kay 在视频中解读香农信息论如何应对噪声信道，这一底层框架正被重新审视用于提升大模型可靠性。对构建鲁棒AI系统的工程师有直接参考价值。
编辑判断
当前大模型的核心痛点不是生成能力而是错误传播——一次幻觉会像信道噪声一样级联放大。Kay 此时重提香农，暗示行业需要从"更大模型"转向"更好纠错机制"。
值得关注两个落地方向：一是 Anthropic 在 Constitutional AI 中隐含的纠错层设计，二是微软最近将 Reed-Solomon 编码引入 MoE 路由的尝试。做模型部署和可靠性工程的团队，应该把信道编码的成熟工具箱重新翻出来。
Kay 的提醒很尖锐：我们花了十年堆算力，却忽略了 1948 年就有的数学工具。
社区反馈
意见分歧 17 条评论
核心争论：香农理论是提供噪声信道极限量化还是实际纠错方法，以及AI可靠性如何借鉴该框架
The full talk seems to be at https://au.cloud.panopto.eu/Panopto/Pages/Viewer.aspx?id=fe0..., but with a confusing interface (text chat flying by at speed, and no actual video of Alan, though you do get a prolonged view of a whiteboard). Maybe there's another copy that exist
Yes it's a pretty klunky interface. Easy to miss that there are multiple camera icons to the right of the time slider, and you can switch to see different feeds like the speaker or their slides. It's still kind of hit or miss with some of the speakers, but at least Alan got a chance to test things o
Aha i saw this video in a comment on another HN thread this week: https://news.ycombinator.com/item?id=49791117 Avoiding the babbling-idiot failure in a time-triggered communication system