Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors–Fast Technology–Technology changes the future

In June, after AMD released the new Ryzen 9000 series desktop processors, X870/X870E series chipsets, and Ryzen AI 300 series mobile processor platforms for AI PCs, users' expectations for AMD's new platforms have been rising, and they are just waiting for the new platforms to be fully launched.

Just last week (July 9-10, US Pacific Time), AMD held an “AMD TECH DAY” technology sharing event, which gave us a deeper understanding of the new platform before it was launched.

AMD Ryzen 9000 series processors fully upgraded

On July 31, AMD Ryzen 9000 series desktop processors will meet the general public. It can provide a leading performance experience, extraordinary energy efficiency, ultimate overclocking experience and longer platform life. It is the culmination of AMD Zen architecture processors to date.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

The Ryzen 9000 series is built on the Zen 5 architecture, which brings excellent performance and energy efficiency. It also supports PCIe5.0 and higher-frequency DDR5 memory, and the use of the AM5 interface reflects a longer platform life. At the same time, AMD said that the AM5 platform will continue until after 2027, greatly reducing the cost of future user upgrades.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In the new product series that will be launched in July, the first launch mainly includes four models: Ryzen 9 9950X, Ryzen 9 9900X, Ryzen 7 9700X and Ryzen 5 9600X. The specific parameters are as follows:

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

AMD Ryzen 9 9950X is the highest model of this new product, with a 16-core 32-thread design, a frequency acceleration of up to 5.7GHz, a total cache (L2+L3) of up to 80MB, and a default TDP of 170W.

Ryzen 9 9900X, 12 cores and 24 threads design, 5.6GHz acceleration frequency, 76MB total cache, default TDP 120W.

The more cost-effective Ryzen 7 and Ryzen 5 families each have a new product, namely Ryzen 7 9700X and Ryzen 5 9600X. The former has an 8-core 16-thread design, and the latter has a 6-core 12-thread design. The acceleration frequencies are 5.5GHz and 5.4GHz respectively, the cache capacity is 40MB and 38MB respectively, and the default TDP is 65W.

The new Ryzen 9000 series is excellent in performance experience. Taking the Ryzen 9 9900X as an example, referring to the productivity, content creation performance and gaming performance of the Core i9-14900K, the Ryzen 9 9900X leads in productivity and content creation by at least 2% (UL Procyon Office) and at most 41% (HandBrake codec).

In terms of gaming, the Ryzen 9 9900X leads by at least 4% (Borderlands 3) and up to 22% (Horizon: Zero Dawn), and leads by more than 13% in quality-level masterpieces such as Cyberpunk 2077 and F1 2023. It is capable of handling heavier game loads and providing excellent picture smoothness.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

The Ryzen 7 9700X, which is positioned against the Core i7-14700K, also has better performance in productivity, content creation and gaming performance. In productivity and content creation performance, the Ryzen 7 9700X leads by at least 4% (7-Zip compression and decompression) and up to 42% (HandBrake encoding and decoding); in gaming, it leads by at least 4% (Borderlands 3) and up to 31% (Horizon: Zero Dawn).

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

The same is true for the Ryzen 5 9600X. When compared with the Core i5-14600K, its productivity and content creation performance is at least 8% ahead (UL Procyon Office), and up to 94% ahead (HandBrake codec); in terms of gaming performance, it is at least 5% ahead (Hitman 3), and up to 29% ahead (Horizon: Zero Dawn).

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

According to official data, the Ryzen 9000 series desktop processors have achieved extremely significant enhancements in video encoding and decoding performance. At the same time, they can also bring more stable and smooth frame rate performance when dealing with large-scale 3D games.

In addition to excellent performance, the new Zen 5 architecture brings even better energy efficiency to the Ryzen 9000 series, which means that the Ryzen 9000 series can achieve the same or higher performance as older processors while maintaining lower power consumption.

Taking the official Ryzen 7 9700X as an example, in terms of gaming performance, this processor is 12% faster on average than the first-generation 3D V-cache processor Ryzen 7 5800X3D with a power consumption of 105W at a power consumption of 65W!

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In general, the Ryzen 9000 series desktop processors have achieved a 15% improvement in thermal resistance, which has reduced the temperature by about 7°C at the same TDP, resulting in lower power consumption and better temperature and noise control.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Compared with the Ryzen 7000 series, the Ryzen 9000 reduces the TDP of all models below the Ryzen 9 9950X, but the performance is improved in all aspects, with a minimum of 11% and a maximum of 22%.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Of course, the Ryzen 9000 series is not just about upgrades in the performance and energy efficiency of the processor itself, but the performance improvement of the entire platform can bring a better experience to users.

Therefore, in terms of memory overclocking, the updated AGESA will support DDR5-8000 ultra-high-speed memory; at the same time, it will support new running memory overclocking and memory optimization performance profile functions.; and memory overclocking can be enabled on all AM5 consumer chipsets, with JEDEC supporting DDR5-5600.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In addition, the new platform has also been significantly improved in terms of Overdrive one-click overclocking accuracy. If users want to prioritize performance efficiency, especially multi-threaded workloads, enabling PBO can gain additional performance improvement space at a lower default TDP. The Ryzen 9 9900X is 6%, the Ryzen 7 9700X is 15%, and the Ryzen 5 9600X is 6%.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Corresponding to the Ryzen 9000 series, AMD has launched a new 800 series chipset, including X870E, X870, B850 and B840. The X870E and X870 chipsets integrate USB 4 controllers and support PCIe5.0; B850 supports PCIe5.0 NVMe interface and PCIe4.0 graphics interface, and supports USB 3.2 at 20Gbps. B840 supports PCIe3.0 and 10Gbps USB 3.2.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In addition, the AM5 platform has also greatly improved AI performance. It is defined as the ultimate AI platform for content creation, development, and productivity enthusiasts.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

The AM5 platform can provide excellent graphics performance to cope with the computing power requirements of large AI models, and it also has a higher storage bandwidth rate to provide faster storage capabilities. By comparing the Ryzen 9 9900X platform with the Core i9-14900K platform, it can be seen that the Ryzen 9 9900X has 1 times higher computing power for large AI models; the PCIe5.0 SSD write speed is 58% higher.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In terms of large language model AI acceleration, thanks to the excellent performance acceleration support of AVX512 and VNNI, the Ryzen 9 9900X is 17% faster than the i9-14900K in terms of Llama large model speed and 20% faster in Mistral, with excellent AI performance.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In general, the new Ryzen 9000 series desktop processors provide better performance while bringing better energy efficiency. At the same time, they have significantly improved AI acceleration, content creation and productivity performance, and gaming experience compared to the Ryzen 7000 series and competing products. At the same time, with better memory overclocking, the Ryzen 9000 series will provide users with a platform-level performance leap.

Flexible AMD Zen5 architecture

First of all, AMD Zen 5 architecture has made four major upgrades in the basic core architecture:

First, more instructions are delivered per cycle;

Second, the width of scheduling and execution has been expanded;

Third, cache data bandwidth is doubled;

Fourth, strengthen AI acceleration capabilities.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In terms of branch prediction, the Zen5 architecture has a pipelined instruction fetch feature with advanced branch prediction, which achieves lower latency, higher precision, and greater throughput. It improves instruction cache latency and bandwidth, and supports dual decoding pipelines.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In terms of scheduling and execution, the Zen5 architecture widens the width of dispatch/retire, integrates a more unified ALU scheduler and a larger execution window, thereby improving scheduling and execution efficiency.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

The Zen 5 architecture also increases data bandwidth, supports 48KB 12-way L1 data cache 4-cycle loads, doubles the L1 cache and floating point unit bandwidth, and improves data prefetching.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In addition, in order to improve the AI ​​performance of the entire processor, the AVX-512 instruction set of the Zen 5 architecture has a complete 512-bit data path, provides 6 dual-cycle delay FADD pipelines, and supports a larger number of FP instructions.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

With these features, the Zen 5 architecture has an average IPC improvement of 16% compared to the Zen 4 architecture. At the same time, its machine learning performance has increased by 32% (single-core), and the AES-XTS encryption algorithm performance has increased by 35% (single-core).

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In addition, the Zen 5 architecture has very good scalability. Faster, smaller, and lower-power transistors optimize performance and energy efficiency; at the same time, AMD and TSMC have further deepened their cooperation on 4nm and 3nm process technologies, thus covering various hardware platforms such as desktops, servers, clients, and embedded systems.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Therefore, the Zen 5 architecture not only includes the Ryzen 9000 desktop-level processor, but also the fifth-generation EPYC processor and the third-generation AMD Ryzen AI, which is the Strix Point mobile-level processor.

Ryzen AI 300 series uncompromising AI PC solutions

Strix Point, the new Ryzen AI 300 series mobile processor, is defined by AMD as a “complete, uncompromising AI PC solution.” The fact that the word “AI” is directly included in its model number shows AMD's emphasis on the field of AI.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Previously, we explained the naming conventions for the new processors, so let’s review them again:

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Take the AMD Ryzen AI 9 HX 370 processor as an example. AMD Ryzen AI is the brand name, and it is not difficult to see that AMD has focused on strengthening the AI ​​attribute. The following 9 HX represents the level of the processor. The larger the number, the stronger the performance. The suffix 37 represents the series, and 0 represents the SKU. In addition to the Ryzen AI 9 HX 370, another model in the Ryzen AI 300 series is the Ryzen AI 9 365.

At the Taipei Computer Show, AMD announced the Ryzen AI 300 series processors, which include two models: AMD Ryzen AI 9 HX 370 and Ryzen AI 9 365. No more new models were announced at this event, so these two processors are likely to be the first in the lineup.

The former adopts a 12-core 24-thread design, with a maximum acceleration frequency of 5.1GHz, a total cache of 36MB, and an NPU computing power increased to 50TOPS.The iGPU has been upgraded to Radeon 890M. The latter is a 10-core 20-thread processor with a maximum acceleration frequency of 5GHz, a total cache of 34MB, an NPU computing power of 50TOPS, and an iGPU model of Radeon 880M.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

The Ryzen AI 300 series processors will support mainstream devices such as thin and light notebooks, gaming notebooks, designer computers, business and SMB notebooks, and mobile workstations, reflecting the diversity of its device ecosystem.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In terms of performance, AMD Ryzen AI 9 HX 370 has obvious advantages over Intel Core Ultra 9 185H and Qualcomm Snapdragon X Elite X1E-84-100 in productivity performance such as PCMark10 and UL Procyon.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In terms of CINEBENCH single-core/multi-core performance, the Ryzen AI 9 HX370 also has a more impressive performance than its competitors, especially in multi-core performance. In addition, in terms of Blender 3D rendering performance, the Ryzen AI 9 HX 370 has achieved a huge lead of up to 3.8 times.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In terms of gaming performance, thanks to the new Radeon iGPU with RDNA 3.5 architecture, the Ryzen AI 300 series processors also have significant advantages over competitors. They perform well in mainstream games such as “Far Cry 6”, “Tomb Raider: Shadow”, “Borderlands 3”, “GTAV”, “Cyberpunk 2077”, etc., and can bring players a smoother gaming experience.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

As a “uncompromising AI PC solution”, the Ryzen AI 300 series processors work closely with industry partners to provide Copilot+ PC with powerful hardware solutions, deeply supporting various system-level AI applications, while better enabling various self-developed AI applications from OEM manufacturers such as Acer, ASUS, and HP.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In addition, the 2.0 Beta version of the very useful AIGC software AMUSE will also be launched on July 28. This is a super simple and easy-to-use AIGC tool that supports text-generated images, image-generated images, and painting-generated images. Its painting-generated image function will be adapted to the stylus function of the ASUS ZenBook 16 Air equipped with the Ryzen AI 300 series processor, making AI painting easier.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In general, the Ryzen AI 300 series processors have full ecosystem compatibility, a complete portfolio of PC types, full support for Copilot and third-party AI software, and excellent performance and all-weather battery life.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

RDNA 3.5 and XDNA 2 significantly improve iGPU and NPU performance

In the Ryzen AI 300 series processor platform, there are two very important architecture updates, one is RDNA 3.5 for iGPU, and the other is XDNA 2 for NPU. Together with Zen 5 for CPU, the three major architecture innovations make the Ryzen AI 300 series processors truly a “no-compromise AI PC solution.”

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

First of all, the new iGPU based on RDNA 3.5 architecture is highly anticipated. At present, it mainly includes two models: Radeon 890M and Radeon 880M. The new architecture has upgraded the computing units to 16, optimized the performance per watt, optimized the performance per bit, and brought longer battery life by optimizing power management.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

After the architecture optimization, the iGPU graphics performance of the Ryzen AI 300 series processors has been significantly improved. In the 3DMark TimeSpy and Night Raid tests, compared with the previous generation, at the same 15W power consumption, the graphics performance increased by 32% and 19% respectively.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

The XDNA 2 architecture brings an exponential performance improvement to the NPU of the Ryzen AI 300 series processors, which brings its computing power to 50 TOPS, an exponential increase compared to the 16 TOPS of the current Ryzen 8040 series.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

For AI PCs, the importance of NPUs has become increasingly important as the scale and diversity of large models grows. It has become an indispensable part of AI PC systems. The new NPU brings up to 35x performance per watt improvement in AI model computing power, which enables AI PCs built on Ryzen AI 300 series processors to have more efficient AI computing capabilities.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

According to AMD's official information, by 2024, there will be more than 150 AI-enabled ISVs in different application fields bringing new experiences to the new generation of AI PCs.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

In addition, the NPU of the Ryzen AI 300 series processors supports the Block FP16 data type. It takes into account the speed of INT8 and the precision of FP16, and has obvious advantages over the fast but inaccurate INT8 and the accurate but not fast enough FP16. At present, most AI applications use 16-bit design, and the Ryzen AI 300 series processors can provide these applications with a fast and accurate computing experience.

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Three major architectural innovations! Analysis of AMD Ryzen 9000/Ryzen AI 300 processors

Conclusion

Through the three core architecture innovations of Zen 5, RDNA 3.5 and XDNA 2, AMD has brought a new Ryzen processor platform covering desktop, mobile and server terminal devices to the industry with the flexibility and scalability of its architecture, bringing new experiences to users in productivity, content creation, gaming, AI computing, etc. At the same time, it has reached all walks of life through various forms of terminal devices, providing extremely rich choices for users in different fields and with different needs. These innovations based on the underlying architecture have shown us AMD's extraordinary technical strength in the chip field.