Samsung has created the world’s first large-scale computing system using PIM technology to connect nearly 100 AMD Instinct MI100 GPUs. PIM chips combine a processor and RAM on a single chip. This technological development is expected to aid in the performance of AI tasks on a big scale.
In October, Samsung disclosed that it had demonstrated how the performance of a PIM processor could be paired with an AMD graphics processing unit.
When the company used this next-generation breakthrough to train the language model algorithm T5, the performance increased more than twice as much while consuming less power in a system without PIMs.
The world’s first large-scale computing system now incorporates 96 AMD Instinct MI100 GPUs with PIM ‘Processing-In-Memory’ technology, allowing for a boost in AI algorithms.
We have built a large computing system by combining 96 GPUs (MI100) from AMD of the United States, each loaded with a PIM chip. It is the only one of its kind in the world — Choi Chang-kyu, Vice President and Head of the AI Research Center, Samsung Electronics Advanced Institute of Technology
Artificial intelligence for science and technology has gained acceptance in today’s society, as well as widespread acceptance in semiconductor manufacturing processes. According to Choi, the company is also investigating strategies to connect the company’s engineers’ knowledge with inspection data and find a purpose for it in production.
As the head of the AI research center, I want to make Samsung a semiconductor company that uses AI better than any other company.
The current method of checking yields is limited, as testing can only be done every three to six months when wafers are put into and taken out of the fab. We need to move on to a stage where yields can be predicted using AI sensors and inspection data.
The AI Semiconductor Future Technology Conference brought organisations such as the AI Semiconductor Forum, the Next Generation Intelligence Semiconductor Foundation, the PIM Artificial Intelligence Semiconductor Project Group, and industry demonstrations such as DEEPX, Eyenix, ETRI, Furiosa AI, Nextchip, Nepes, Openedges Technology, SAPEON Korea, and Telechips to the Korea conference site.
Also Read:
