Apologies in advance, particularly to dear Dodgy-Knees, whom I know loves it
whenever I attempt to link BrainChip with Qualcomm.
And, yes, I realise I'm probably going to have to go straight back to the naughty corner for asking this but is there any way we could be in the Snapdragon Elite X?
Look, I have been serously debating with myself this morning the significance of Shayamal Anadkat's (Applied AI @ OpenAI) blog in June 2023. In it he states "Earlier this year, Qualcomm AI Research successfully deployed a popular
1B+ parameter foundation model (stable diffusion) on an edge device through full-stack AI optimization."
He then goes straight on to talk about the the complexity and resource demands that foundational models pose deployment challenges on edge devices. and he says "To counter this, the focus will shift toward specialized hardware, optimization techniques, and neural processor architectures. Being able to run optimized versions of foundational models at the edge/on-device will open up endless possibilities. Recognizing these emerging requirements,
BrainChip has stepped forward with innovative solutions like the Akida processor, an advanced neural processing system for edge AI. It’s important to understand and assess edge AI technology to overcome deployment challenges and explore new potentials."
So, to me it sounded like Shayamal was suggesting that if Qualcomm were going to deploy larger foundational models (larger than 1 billion parameters for example) , they would need more sophisticated technology, like BrainChip's Akida processor.
Then this morning we find out that the NPU in Qualcomms Snapdragon Elite X is capable of handling large language models (LLMs) up to
13 billion parameters without processing in the cloud
. I know it says that Snapdragon Elite X has sprung out of Qualcomm's Nuvia acquisition, but...is it completely outrageous to think we may be involved in some way?
Remember when Nandan liked Qualcomm's Stable Diffusion announcement in February 2023? Surely he wouldn't have "liked" it because of the fluffy cat. I mean that's definitely something I would do, but I don't even think Nandan is a cat person!
View attachment 48029
View attachment 48028
Qualcomm's flagship next-gen processor for laptops, based on a new CPU core, looks to be a high-performance efficiency monster—if you believe the hype. We'll be checking it out this week at the company's annual Snapdragon Summit.
au.pcmag.com
Extract from Shayamal Anadkat's blog.
View attachment 48030