View attachment 51785
Qualcomm & Apple have some very compelling ARM-based solutions that are primed to tackle AMD & Intel in the AI PC segment in 2024.
Apple & Qualcomm Expected to Act as Catalysts For Progression of ARM In The AI PC Era, x86 Chips From AMD & Intel Face Heated Competition In 2024 & Beyond
We have seen a recent shift in the industry towards ARM-based solutions, especially with its potential adoption by newly emerging competitors. With Apple boosting the share of ARM architectures within the laptop segment, it looks like moving ahead, we might see widespread adoption of the chip architecture within the PC industry as well, mainly since ARM has been able to close the performance gap between the x86 architecture, along with being much more power efficient.
ARM has already seen a dominant position in the mobile industry, with Qualcomm and MediaTek utilizing the standard for quite some time now.
However, the market share of ARM in the PC industry is going to see a rapid rise in the coming years, since Qualcomm has already introduced its own PC SoC, known as the "Snapdragon X Elite", which boasts impressive performance and is expected to hit shelves by mid-2024. Moreover, it is rumored that NVIDIA and AMD might launch ARM-based CPUs by 2025 as well, which means that the x86 architecture will get tough competition.
The next-gen AI PC market is definitely something that all chipmakers are currently eyeing to succeed in. All companies include dedicated NPUs within their chips that accelerate AI workloads and bring additional capabilities through a robust software stack and ecosystem.
Qualcomm has currently announced its AI Engine to offer up to 75 TOPS on the fastest X Elite SOCs while AMD just announced its updated Ryzen 8040 "Hawk Point" APUs with up to 39 TOPS (16 TOPS from NPU). Its successor which arrives in 2H 2024, codenamed Strix Point, is expected to feature up to 3x uplift in AI TOPS, hitting almost 50 TOPS from the XDNA 2 NPU alone.
Apple also offers around 18 TOPS with its M3 SOCand while that's a lower number than the rest of the competition, Apple's software ecosystem which runs on its own OS offsets the requirement of a powerful AI NPU thanks to optimizations. Lastly, we have Intel who have also been making big claims about their NPU featured in Core Ultra "Meteor Lake" CPUs which debuts next week on the 14th of December.
ARM is making strides when it comes to aiding artificial intelligence through its CPU solutions, since just recently, the company has launched its Cortex-M52 SoC, which is equipped with the company's "Helium" or M-Profile Vector Extension that delivers a significant performance uplift for machine learning (ML) and digital signal processing (DSP) applications. Since the PC industry is going to see a large-scale influence of AI-based features, firms like ARM need to deliver performance in this domain.
It will be interesting to see how the influx of ARM-focused chips changes the dynamics of the PC industry, especially the AI PC segment, since it would not only bring in much more diversity but would result in a more competitive market.
2024 AI PC Platforms
BRAND NAME APPLE QUALCOMM AMD INTEL CPU Name M3 Snapdragon X Elite Ryzen 8040 "Hawk Point" Meteor Lake "Core Ultra" CPU Architecture ARM ARM x86 x86 CPU Process 3nm 4nm 4nm 7nm Max CPU Cores 16 Cores (MAX) 12 Cores 8 Cores 16 Cores NPU Architecture In-House Hexagon NPU XDNA 1 NPU Crestmont E-Core NPU AI TOPS 18 TOPS 75 TOPS (Peak) 16 TOPS (39 TOPS All) TBD GPU Architecture In-House Adreno GPU RDNA 3 Alchemist Arc Xe-LPG Max GPU Cores 40 Cores TBD 12 Compute Units 8 Xe-Cores GPU TFLOPs TBD 4.6 TFLOPS 8.9 TFLOPS ~4.5 TFLOPS Memory Support (Max) LPDDR5-6400 LPDDR5X-8533 LPDDR5X-7500 LPDDR5X-8533 Availability Q4 2024 Mid-2025 Q1 2024 Q4 2024
They mention ARM Helium, which is basically a DSP software enhancement, accepting 128 bit vectors over 2 clock cycles on a 64 bit bus.
There is no mention of ARM's Ethos hardware NPU which is based on MACs.
And let's not forget Akida is compatible with all ARM processors.
Unfortunately, if we take the article at face value, Apple has gone with software upgrades to handle AI - after all, the Apple hardware architecture would have been designed years before we cozied up to ARM.
We also know Qualcomm's Snapdragon has its in-house Hexagon 8.2 which includes support for transformer natural language models for speech to text and 4-bit data useful in image processing.
AMD were footling around with MemRistors (analog) as recently as at least 2018, but they now plug their Ryzen 7040 with XDNA AI, which is also built on MACs.
And Intel, of course has many irons in the Ai fire, but we are part of the IFS ecosystem.
So we are part of the ARM and Intel ecosystems, but we have no concrete links to AMD or Qualcomm that I recall.