Samsung Connects 96 PIM-Modified AMD MI100 GPUs

Samsung has built the world’s first large scale computing system using GPUs with built in processing-in-memory (PIM) chips. These memory modules, which were loaded onto 96 AMD Instinct MI100 GPUs, increased AI training performance by 2.5x, according to a report by Business Korea.

Samsung originally demonstrated the PIM-modified GPUs in October, but only recently combined 96 PIM-modified GPUs in a cluster. Compared to normal video memory, these modified MI100 chips not only performed 2.5x better, they also cut power consumption by 2.67x, drastically increasing the GPUs’ efficiency at running AI algorithms.

Source link