Micron unveiled its massive 256GB DDR5-8800 MCRDIMM memory modules at the recent Nvidia GTC 2024 conference.
Micron RAM is available in tall and standard configurations
These high-capacity, double-high 20-watt modules are tailored for next-generation AI servers, such as those based on Intel’s Xeon Scalable ‘Granite Rapid’ processors, which require significant training memory.
The company displayed a ‘Tall’ version of the module at GTC, but also intends to offer standard MCRDIMMs suitable for 1U servers.
DIMMs with combined multiplexer ranks
Both types of 256GB MCRDIMMs are made using monolithic 32Gb DDR5 ICs. The high module has 80 DRAM chips on both sides, while the standard module uses 2Hi packages and will run at higher temperatures as a result.
MCRDIMMs, or Multiplexer Combined Rank DIMMs, are dual-rank memory modules that use a special buffer to allow both ranks to operate simultaneously.
The buffer allows the two physical tiers to act as two separate modules running in parallel, thus doubling performance by allowing 128 bytes of data from both tiers to be fetched simultaneously per hour, effectively doubling the performance of a single module. Meanwhile, the buffer works with the host memory controller using the DDR5 protocol, albeit at speeds above those specified by the standard, in this case 8800 MT/s.
Customers looking to get their hands on the new memory modules won’t have to wait long. In prepared remarks for the company’s business call last week, Sanjay Mehrotra, CEO of Micron, said: “We have begun distribution of our 256GB MCRDIMM module, which further improves performance and increases DRAM content per server.”
Source: Techradar
