三星把算力塞进内存芯片
推荐指数 85.0 NO. 011 · 2026.08.30
发布2026/08/29Score222Comments77
为什么值得看
三星在LPDDR5X内存中集成MAC计算单元,无需修改内存控制器即可实现存内计算。这对AI推理的内存带宽瓶颈是实质性突破,边缘端大模型部署可能因此提速。
编辑判断
PIM最大的工程陷阱是内存和计算的热耦合问题,三星选择LPDDR5X而非HBM路线,说明他们优先瞄准手机、汽车等功耗敏感场景而非数据中心。这和其他玩家如SK海力士的HBM-PIM形成差异化。
值得警惕的是,存内计算的编程模型至今没有统一标准,三星保留标准内存控制器接口是聪明妥协,但开发者仍需面对数据划分和同步的新复杂度。做端侧推理框架的团队应该开始评估PIM-aware的算子调度策略。
社区反馈
意见分歧 71 条评论
核心争论:PIM技术能否突破LLM内存带宽瓶颈,还是缺乏杀手级应用和算法适配
相关内容
当三星把内存"种"在芯片上:zHBM 如何改写AI算力的物理规则 三星zHBM技术通过晶圆键合工艺,将存储层垂直堆叠在AI加速器之上,改变存储与计算的物理关系,实现数据"上楼即算"。 AI驱动存储持续迭代!三星PIM技术量产在即 或绕过CPU、GPU直接计算 存算一体架构将计算单元嵌入存储芯片,PIM技术使存储器具备计算能力,克服冯·诺依曼瓶颈,显著提升AI数据处理能效比。 三星、SK海力士世纪联手高通!HBC芯片专治AI"又慢又烫" 采用3D堆叠工艺,将专用计算芯片塞进DRAM内存堆栈底下,通过硅通孔(TSV)垂直连接,实现计算搬进数据旁边。 三星发布下一代AI内存技术,全球存储进入新一轮扩产周期 三星展示面向AI时代的下一代内存技术,包括超400层V10B V-NAND原型、垂直堆叠式高带宽内存zHBM等创新方案。
Interesting that Samsung still pursues PIM. IIRC they had a paper in ISCA21 or 22 where they showed HBM2 module with PIM, which back then impressed me quite a lot. That being said, I am not sure what’s the killer application for this technology, and without such application adoption is unlikely.
As I understand it, the killer app is llms. You could run MACs directly in RAM, offloading a lot of work from CPU and cutting down on insane (external) memory bandwidth required. Imagine (this is a fantasy pitch but potentially achievable for some use cases) wanting to run a larger llm and all you h
> Imagine (this is a fantasy pitch but potentially achievable for some use cases) wanting to run a larger llm and all you have to do is buy more RAM so it fits. Isn't this how it works today already? Granted you wanted to run it on RAM rather than VRAM.