AMD patents a 3D-stacked machine learning accelerator design for its new CPU

AMD received a patent for a unique CPU with a machine learning (ML) accelerator vertically stacked on the I/O die, or IOD, on September 25, 2020. AMD could be working on a data centre-based system-on-chips (SoCs) with embedded FPGAs or machine learning accelerators for specialised GPUs. Similar to how AMD adds specialised cache to their newest CPUs, AMD may put an FPGA or GPU on top of its processor I/O chip.

The technology is critical because it will allow the company to include more accelerator classes in future processor SoCs. AMD’s patent does not guarantee that the newly designed chips will be available to consumers. Users can see what the future holds with proper research and development at the forefront thanks to the company’s newest effort. AMD hasn’t said anything about the fresh patent, so we can only guess what the company has planned for the new designs.

The patent for AMD’s ‘Direct-connected machine learning accelerator’ explains the probable applications for an ML-accelerator stacked onto the processor with the associated IOD. An FPGA or compute GPU will be used to process ML workloads, which will be stacked on an IOD with a specific accelerator connector. AMD can start this architecture by putting a unique accelerator in local memory, either utilising memory linked to the IOD or a separate part not connected to the IOD’s head.

When the term “machine learning” is used, it is frequently associated with data centres. With this new technology, the chip maker will need to increase the workloads of its chips. AMD’s invention would allow workloads to be increased in speed without the need for expensive and bespoke silicon in system CPUs. More power efficiency, data transmissions, and capacities would all be advantages.

Because the patent was filed so close to AMD’s acquisition of Xilinx, it appears to be strategically timed. Now that we’ve been a little over a year and a half after the filing and the patent was finally published at the end of March 2022, we could see the new designs as early as 2023 if they come to fruition. AMD’s fellow Maxim V. Kazakov is identified as the patent’s inventor.

AMD working on new EPYC processors

AMD
credit:source

AMD is working on new EPYC processors, codenamed Genoa and Bergamo, that use a design that combines the I/O die with an accelerator. AMD may be able to create AI-based processors with machine learning accelerators under the Genoa and Bergamo series.

In terms of AMD’s EPYC processor line, the company is looking for a better 600W cTDP or configurable thermal design power for the EPYC Turin processor line’s fifth iteration. EPYC Turin CPUs have twice the current EPYC 7003 Milan series’ cTDP. In addition, the company’s SP5 EPYC processors, which are in their fourth and fifth generations, may consume up to 700W of power in short bursts. The power consumption of the Genoa and Bergamo processors would increase if an ML accelerator was added to the processor. Vertically stacked accelerators, such as AMD’s recently patented ML-accelerated CPU architectures, would help future server chipsets.

The company can now offer compute-focused GPU designs, powerful FPGA designs, Pensando programmable processor series, and a solid x86 microarchitecture thanks to Xilinx technology. Multi-chipset designs are now a reality for the chip maker, similar to the AMD’s Infinity Fabric interconnective technology. By combining multi-tile APUs for datacenters and processors built with TSMC’s N4X performance nodes and rounding it out with either a graphics processor or an FPGA accelerator with an optimally enhanced N3E process tech, datacenter processors with vertical stacking will offer more options for enterprises.

Also Read:
Analysts predict of graphics cards to plummet in the coming years

source

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.

More like this

AMD

AMD Surges Ahead in 2025: Gains 16.6% CPU Market...

In a dramatic shift in the CPU landscape, AMD has pulled off one of its biggest wins...
AMD Ryzen Z2 AI Extreme

AMD Ryzen Z2 AI Extreme: A Game-Changing AI SoC...

AMD Ryzen Z2 AI Extreme: The battle for handheld gaming dominance is heating up — and AMD...
AMD Dominates AI Benchmarks: Instinct GPUs Shatter Records in MLPerf Tests

AMD Dominates AI Benchmarks: Instinct GPUs Shatter Records in...

The AI acceleration race has shifted into high gear, and AMD has just made a spectacular power...
AMD’s ZT Systems Acquisition: Strategic Move to Dominate the $500B AI Data Center Market

AMD’s ZT Systems Acquisition: Strategic Move to Dominate the...

In the high-stakes chess game that is the AI hardware industry, AMD just made a bold queen’s...
AMD Ryzen 9000G APUs

AMD Ryzen 9000G APUs with Zen 5 and RDNA...

AMD Ryzen 9000G APUs : AMD is reportedly gearing up to release its Ryzen 9000G APU...

LATEST NEWS

UEFA Champions League 2024-25: Bayern Munich vs Inter – Preview, Prediction and Where to Watch the Match LIVE?

We turn our attention to Tuesday’s UEFA Champions League quarter-final first leg at the Allianz Arena with our Bayern Munich vs Inter preview and...

ISL 2024-25: Apuia’s Screamer Seals ISL Final Berth for Mohun Bagan Super Giant

In a night that will be etched into Mohun Bagan Super Giant’s rich legacy, Lalengmawia Ralte, famously known as Apuia, delivered a thunderbolt in...

IPL 2025: RCB Break 10-Year Wankhede Jinx as Kohli, Patidar and Krunal Steal the Show

In what has become a year of jinx-breaking feats, Royal Challengers Bengaluru (RCB) secured a historic win over Mumbai Indians (MI) at the Wankhede...

Top 5 Celebrity-Approved Lightweight Sarees That Will Keep You Stylish in Summer Heat

The sweltering summer months often create a styling dilemma for fashion enthusiasts who love traditional Indian wear but dread the thought of heavy fabrics...

Featured