🔮E14: The Real AI Bottleneck: High Bandwidth Memory (HBM)
![🔮E14: The Real AI Bottleneck: High Bandwidth Memory (HBM)](https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00a0380e-8177-4953-b240-5bea393c6955_678x451.webp)
Without HBM there are no LLMs
![](https://substackcdn.com/image/fetch/f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Fstateofthefuture.substack.com%2Fapi%2Fv1%2Fpost_preview%2F136781001%2Ftwitter.jpg%3Fversion%3D3)
🔮E14: The Real AI Bottleneck: High Bandwidth Memory (HBM)
![](https://lenovopress.lenovo.com/assets/images/LP1738/Flat%20Mode.png)
Implementing High Bandwidth Memory and Intel Xeon Processors Max Series on Lenovo ThinkSystem Servers > Lenovo Press
![](https://upload.wikimedia.org/wikipedia/commons/thumb/e/e7/AMD_Fiji_GPU_package_with_GPU%2C_HBM_memory_and_interposer.jpg/250px-AMD_Fiji_GPU_package_with_GPU%2C_HBM_memory_and_interposer.jpg)
High Bandwidth Memory - Wikipedia
High Bandwidth Memory (HBM) / Revolutionary HBM breaks the processing bottleneck : 네이버 블로그
![](https://i0.wp.com/semiengineering.com/wp-content/uploads/Fig01_Rambus_HBMstack.png?fit=1594%2C916&ssl=1)
HBM's Future: Necessary But Expensive
![](https://upload.wikimedia.org/wikipedia/commons/thumb/6/62/AMD%4028nm%40GCN_3th_gen%40Fiji%40Radeon_R9_Nano%40SPMRC_REA0356A-1539_215-0862120_DSC04466_%2829461603171%29.jpg/306px-AMD%4028nm%40GCN_3th_gen%40Fiji%40Radeon_R9_Nano%40SPMRC_REA0356A-1539_215-0862120_DSC04466_%2829461603171%29.jpg)
High Bandwidth Memory - Wikipedia
![](https://blocksandfiles.com/wp-content/uploads/2021/02/SAmsung-HBM-PIM.jpg)
Samsung embeds AI into high-bandwidth memory to beat up on DRAM – Blocks and Files
![](https://www.eetimes.eu/wp-content/uploads/2021/12/UbiquitousAI_ThinkEdge-SE70_EETimesEurope.png?w=640&resize=640%2C334)
Memory Bottlenecks: Overcoming a Common AI Problem - EE Times Europe
![](https://substackcdn.com/image/fetch/f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Fstateofthefuture.substack.com%2Fapi%2Fv1%2Fpost_preview%2F138916580%2Ftwitter.jpg%3Fversion%3D3)
💡E21: Can we make enough AI chips?
![](https://www.eetimes.com/wp-content/uploads/Cerebras-Pipelining.jpg)
How designers are taking on AI's memory bottleneck
High Bandwidth Memory (HBM) / Revolutionary HBM breaks the processing bottleneck : 네이버 블로그