Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Please note that 8 x 16 Gb DDR4 modules cost $480, and have a bandwidth of 200 Gb/s, the only problem you need 8 DRAM controllers.


> the only problem you need 8 DRAM controllers.

Which is a huge problem? Even using 2x memory controllers in typical consumer motherboard can make system very unstable.


Why is that so?


Running large MOE models won't saturate the EPYC memory.

You'll never see that 200 Gb/s running inference.


Because it'll bottleneck at the CPU? Or because 200 bB/s is overkill when running a model (that fits in memory)?




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: