AMD crafts custom EPYC CPU with HBM3 memory for Microsoft Azure – CPU with 96 Zen 4 cores and 450GB of HBM3 may be repurposed MI300C, four chips hit 7 TB/s [Updated]
www.tomshardware.com
This AMD chip with HBM3 is exclusive to Azure.
  • Alphane Moon@lemmy.worldOPM
    4·
    3 days ago

    “Why haven’t we seen EPYC+HBM sooner? EPYC has been focused on high volume markets, which is why you don’t see EPYC with more than 2 sockets,” Park posted on Bluesky. “You can’t swap out your DDR5 controllers and add HBM controllers/stacks and call it a day. HBM forces certain design choices (e.g., every HBM3 stack requires sixteen 64-bit channels).

    “Flexibility: with HBM, you can’t upgrade capacity or have lower cost versions with fewer channels populated," he added. "Generally, CPUs don’t require that much bandwidth.”

    Sounds like HBM equipped CPUs are a rather niche and specific use case. Surprised that it’s not clear whether this CPU has regular Zen 4 or Zen 4c cores.