Micron Technology has begun sampling a new 256GB DDR5 registered dual in-line memory module (RDIMM) to key partners in the server ecosystem, marking a step forward in memory performance for artificial intelligence (AI) and high-performance computing (HPC) applications.

The module is built on Micron’s latest 1-gamma DRAM technology and can reach speeds of up to 9,200 megatransfers per second (MT/s), representing an increase of more than 40% compared with memory modules currently in mass production.

The company said the new design aims to meet growing demand for faster data processing in large-scale computing environments.

To achieve this performance, the module uses advanced packaging techniques, including three-dimensional stacking (3DS) of multiple memory dies linked via through-silicon vias (TSVs). According to Micron, this approach enhances capacity, speed and energy efficiency, which are critical factors for AI infrastructure. A single 256GB module can reduce operating power consumption by more than 40% compared with using two 128GB modules, the company added.

Micron is working with server manufacturers and other industry partners to validate the new RDIMM across both current and next-generation platforms. The company said this collaborative testing is intended to ensure compatibility and support faster deployment once the product enters full production.

“Capacity, bandwidth, and power are the defining drivers of AI efficiency. With our 256GB DDR5 RDIMM, Micron is enabling servers to deliver significantly higher performance,” said Raj Narasimhan, senior vice president and general manager of Micron’s Cloud Memory Business Unit. He added that the module’s 1-gamma DRAM and advanced packaging deliver “industry-leading speed and power efficiency”, helping data centre operators scale AI workloads more effectively.

Demand for higher-capacity and more efficient memory has grown rapidly alongside the expansion of technologies such as large language models, real-time inference systems and high-core-count processors. These workloads place increasing pressure on server memory, requiring greater bandwidth and improved energy efficiency within existing power and thermal limits.

Micron said its 256GB DDR5 RDIMM is designed to address these challenges by enabling higher memory capacity per processor socket while maintaining operational efficiency. The product is currently in the sampling phase, with broader rollout dependent on successful validation by ecosystem partners.

By: DocMemory
Copyright © 2023 CST, Inc. All Rights Reserved