BRN Discussion Ongoing

White Horse

Regular
Nice article.

https://www.linkedin.com/pulse/lets-stop-messing-around-big-shots-join-edge-ai-community-iotstars-nwv6f/?trackingId=E7mxd9GDVk+rAelQrVQmZg==


The State of Edge AI – panel at IoT Stars

The State of Edge AI – panel at IoT Stars

Let’s stop messing around, big shots join the Edge AI community​







IoT Stars​



2,528 followers









March 14, 2025

It’s no secret that Edge AI is a hot topic, arguably the main theme of last week's embedded world Exhibition&Conference in Nuremberg, Germany.

The biggest buzz on the conference floor? Edge Impulse's acquisition by Qualcomm! Would this mean that the technology is moving beyond its infancy and into industry adoption?

The Edge AI space is moving fast​


This year’s insane!” cried Zach Shelby, reacting to the sheer number of real Edge AI projects on display. While Edge Impulse may be ahead of the curve, it’s clear that the Edge AI space is moving fast. A year ago, a conversation about “the state of Edge AI” might have felt like an echo chamber where people could only talk about a handful of Edge AI applications which barely moved beyond its POC stage. This year is different. It seemed like every exhibitor at Embedded World had a real Edge AI story to share, primarily focused on computer vision, built without powerful, energy-draining and expensive GPUs. Instead, exhibitors showcased low-resolution cameras connected to inexpensive, battery-powered microcontrollers, running ultra-fast models with minimal latency and energy consumption

Real data, real sensors​


The Edge AI community is flourishing, with more developers than ever gaining access to free AI models. But the real bottleneck to adoption isn’t the models, it’s the quality of the data.

Companies have been collecting data for decades, yet much of it can be completely thrown away. Many data sets are sampled, aggregated or lack clear context on what happened when that data was collected, making them useless for training AI models. “We need good data from real sensor as close to the real deployments as possible.” Shelby underscores the need for best practices to enable people to collect high quality data and more collaboration centered around data; we need to find better ways to crowdsource, collect and share data.

We don’t need more chatbots!​


The threshold to getting started might seem low, but we’re mostly talking to the same group of embedded developers who’re actually putting Edge AI to use. “It’s an engineering party, hosted in an ivory tower” as Fabio Violante, CEO of Arduino put it. We need to open up, bringing in more creativity.

“What’s the hello world of AI?” asked Brandon Satrom from Blues. “It’s chatbots!” And if there’s anything we don’t need more of, it’s chatbots, which won’t work on MCU-based devices anyway. Put that Raspberry Pi away and stop running Ollama. Look beyond chatbots and start implementing sensor-driven applications which solve real problems. As Violante nicely put it “Edge AI is there to solve problems, not the other way around”

Community, unite!​


The industry is at a turning point with big shots investing heavily. Now is the time to define best practices, share experiences and crowdsource high quality data. Could this be the moment for the EDGE AI FOUNDATION to take the lead?

Let’s stop messing around and start solving real problems using a technology that has proven itself.



Laurens Slats from IoT Stars

Based on the conversation with Pete Bernard, Zach Shelby , Brandon Satrom , and Fabio Violante.
 
  • Like
  • Fire
  • Love
Reactions: 20 users

Slade

Top 20
Happy to get a response from Tony Lewis and it gives me confidence that we are making an impact at trade fairs. Thanks also to the members that shared their experiences of trade fairs.

IMG_3374.jpeg
 
  • Like
  • Love
  • Fire
Reactions: 53 users

Guzzi62

Regular
Happy to get a response from Tony Lewis and it gives me confidence that we are making an impact at trade fairs. Thanks also to the members that shared their experiences of trade fairs.

View attachment 79373
On LinkedIn?

But nice nevertheless.
 
  • Like
Reactions: 2 users

Rach2512

Regular

Nice comment from Spencer Huang of Edge Impulse.
 

Attachments

  • Screenshot_20250315_121953_Samsung Internet.jpg
    Screenshot_20250315_121953_Samsung Internet.jpg
    621.5 KB · Views: 223
  • Like
  • Love
  • Fire
Reactions: 19 users

Slade

Top 20
On LinkedIn?

But nice nevertheless.
Yes on LinkedIn. Sorry I couldn’t figure out how to link it, no pun intended.
 
  • Like
  • Fire
  • Haha
Reactions: 6 users

7für7

Top 20

Nice comment from Spencer Huang of Edge Impulse.
“Nice?” is just a plain, generic comment. Or maybe I’m just so jaded that I’m missing the message.. could you give me a hint?
 
  • Like
Reactions: 1 users

View attachment 79180

Thanks for the link Supersonic. The irony of his presentation is that in his Linkedin post, Alf Kuchenbuch commented "Please excuse the poor sound quality of this clip, we took it at the show floor." while Tony was talking about, AND PRESENTING an AN AUDIO DENOISING solution that was denoising THE VERY SAME SHOWFLOOR COMMOTION.

Another missed opportunity for the company -- they could have started the clip with the ambient sound, and then denoised the rest of the clip to show its efficacy.
 
Last edited:
  • Like
  • Haha
  • Sad
Reactions: 12 users

Guzzi62

Regular
Thanks for the link Supersonic. The irony of his presentation is that in his Linkedin post, Alf Kuchenbuch commented "Please excuse the poor sound quality of this clip, we took it at the show floor." while Tony was talking about, AND PRESENTING an audio denoising solution that was denoising THE VERY SAME SHOWFLOOR COMMOTION.

Another missed opportunity for the company -- they could have started the clip with the ambient sound, and then they should have denoised the rest of the clip to show its efficacy.
Nope, it was fine, people in the know got the message.

Keep on with your negative crap, one day you might succeed finding something that sticks.
 
  • Like
  • Haha
  • Love
Reactions: 8 users

Rach2512

Regular
“Nice?” is just a plain, generic comment. Or maybe I’m just so jaded that I’m missing the message.. could you give me a hint?
They are all still friends even though Edge Impulse are being bought out by Qualcom. I took it as positive. Does anyone else agree or have I got it wrong 🤔
 
  • Like
  • Fire
Reactions: 15 users

7für7

Top 20
They are all still friends even though Edge Impulse are being bought out by Qualcom. I took it as positive. Does anyone else agree or have I got it wrong 🤔
Why should they not be friends? If they was bought out doesn’t mean they’re not talking together anymore.. they keep in touch it’s normal. I don’t mean it negative but I don’t think I will interpreting too much about it
 
  • Like
Reactions: 2 users

Diogenese

Top 20
They are all still friends even though Edge Impulse are being bought out by Qualcom. I took it as positive. Does anyone else agree or have I got it wrong 🤔
My reading is the Qualcomm/EI union is an open marriage.

They already have a lot of mutual friends. Perhaps it may involve a bit of partner-swapping, but that will involve more than the keys in a bowl, and more of the "You show me yours, ..." .
 
  • Haha
  • Like
  • Wow
Reactions: 23 users
Nope, it was fine, people in the know got the message.

Keep on with your negative crap, one day you might succeed finding something that sticks.

I'm glad you've got your blinkers on and live in your dreamland, and see only what you want to see, but I've only stated facts.

Learn to read the room... the overall sentiment here isn't positive toward the co's management.
 
  • Like
  • Haha
Reactions: 3 users

GStocks123

Regular
More relating to the Apple job advert I recently posted 🤞


Anticipated Innovations for the Apple M5 Chipset – The Next Frontier in Silicon​

Following the groundbreaking M4 chipset, Apple’s M5 is poised to push the boundaries of performance, efficiency, and artificial intelligence even further. While Apple has not officially confirmed details, industry trends, patent filings, and TSMC’s roadmap provide a compelling glimpse into what the M5 might bring. Here’s a speculative deep dive into its potential advancements:

Apple M4 and M5 Chipset


1. Manufacturing Process: TSMC’s 1.8nm (A14) Node

  • Shrinking to 1.8nm: The M5 could adopt TSMC’s next-generation 1.8nm (A14) process by late 2026, offering:
    • ~15% higher transistor density vs. 2nm (M4), enabling 50+ billion transistors.
    • 20-25% power efficiency gains and 10-15% faster clock speeds at matched power.
    • Backside Power Delivery (BSPDN): A new technology that moves power rails beneath the silicon, reducing signal interference and improving performance for high-frequency designs.
  • 3D Hybrid Bonding: Stacked cache or memory layers using TSMC’s 3D Fabric™ for ultra-low latency between CPU, GPU, and Neural Engine.
2. CPU and GPU: Performance Redefined

A. CPU Architecture:

  • Next-Gen “Hurricane” P-Cores:
    • 12-16 performance cores with SMT (Simultaneous Multi-Threading) support, enabling 24-32 threads for workstation-grade multitasking.
    • Clock speeds exceeding 4.5 GHz (up from M4’s ~4.2 GHz).
  • “Tempest” E-Cores:
    • Redesigned efficiency cores with 30% faster single-threaded performance than M4’s E-cores, closing the gap with Intel’s P-cores.
B. GPU Evolution:

  • Ray Tracing Pro Max:
    • Dedicated hardware for path tracing (cinema-quality lighting) and AI-upscaled frame generation (similar to NVIDIA DLSS 3).
    • Up to 64 GPU cores in M5 Ultra variants, targeting AAA gaming and 8K/120fps video workflows.
  • Apple Photon Architecture:
    • A rumored in-house GPU design replacing ARM’s Immortalis, with support for DirectX 12 Ultimate and OpenGL Next.
3. AI and Neural Engine: The Brain of the Future

  • 6th-Gen Neural Engine:
    • 128-core design (up from M4’s 24 cores), delivering 200+ TOPS (trillion operations per second).
    • Transformer Accelerators: Dedicated hardware for real-time inference of 100B+ parameter LLMs (e.g., ChatGPT-scale models on-device).
  • Autonomous AI Agents:
    • System-level integration for AI agents that automate workflows (e.g., drafting emails, editing videos) without cloud dependency.
  • Neuromorphic Computing:
    • Experimental support for spiking neural networks (SNNs), mimicking human brain efficiency for sensor data processing in Vision Pro
 
  • Like
  • Wow
  • Fire
Reactions: 34 users

Diogenese

Top 20
More relating to the Apple job advert I recently posted 🤞


Anticipated Innovations for the Apple M5 Chipset – The Next Frontier in Silicon​

Following the groundbreaking M4 chipset, Apple’s M5 is poised to push the boundaries of performance, efficiency, and artificial intelligence even further. While Apple has not officially confirmed details, industry trends, patent filings, and TSMC’s roadmap provide a compelling glimpse into what the M5 might bring. Here’s a speculative deep dive into its potential advancements:

Apple M4 and M5 Chipset


1. Manufacturing Process: TSMC’s 1.8nm (A14) Node

  • Shrinking to 1.8nm: The M5 could adopt TSMC’s next-generation 1.8nm (A14) process by late 2026, offering:
    • ~15% higher transistor density vs. 2nm (M4), enabling 50+ billion transistors.
    • 20-25% power efficiency gains and 10-15% faster clock speeds at matched power.
    • Backside Power Delivery (BSPDN): A new technology that moves power rails beneath the silicon, reducing signal interference and improving performance for high-frequency designs.
  • 3D Hybrid Bonding: Stacked cache or memory layers using TSMC’s 3D Fabric™ for ultra-low latency between CPU, GPU, and Neural Engine.
2. CPU and GPU: Performance Redefined

A. CPU Architecture:

  • Next-Gen “Hurricane” P-Cores:
    • 12-16 performance cores with SMT (Simultaneous Multi-Threading) support, enabling 24-32 threads for workstation-grade multitasking.
    • Clock speeds exceeding 4.5 GHz (up from M4’s ~4.2 GHz).
  • “Tempest” E-Cores:
    • Redesigned efficiency cores with 30% faster single-threaded performance than M4’s E-cores, closing the gap with Intel’s P-cores.
B. GPU Evolution:

  • Ray Tracing Pro Max:
    • Dedicated hardware for path tracing (cinema-quality lighting) and AI-upscaled frame generation (similar to NVIDIA DLSS 3).
    • Up to 64 GPU cores in M5 Ultra variants, targeting AAA gaming and 8K/120fps video workflows.
  • Apple Photon Architecture:
    • A rumored in-house GPU design replacing ARM’s Immortalis, with support for DirectX 12 Ultimate and OpenGL Next.
3. AI and Neural Engine: The Brain of the Future

  • 6th-Gen Neural Engine:
    • 128-core design (up from M4’s 24 cores), delivering 200+ TOPS (trillion operations per second).
    • Transformer Accelerators: Dedicated hardware for real-time inference of 100B+ parameter LLMs (e.g., ChatGPT-scale models on-device).
  • Autonomous AI Agents:
    • System-level integration for AI agents that automate workflows (e.g., drafting emails, editing videos) without cloud dependency.
  • Neuromorphic Computing:
    • Experimental support for spiking neural networks (SNNs), mimicking human brain efficiency for sensor data processing in Vision Pro
I think TENNS are a step beyond Transformers, but I don't have a reference to hand.
 
  • Like
Reactions: 8 users

Diogenese

Top 20
I think TENNS are a step beyond Transformers, but I don't have a reference to hand.
Found it!

https://www.wevolver.com/article/2024-state-of-edge-ai-report/generative-ai-at-the-edge

"Combining the new algorithms with some innovative hardware choices – especially those that make 3D convolutions very efficient – brings a big step in efficiency—demonstrating more than 100-500x improvement in energy efficiency without compromising accuracy. In terms of disruptive potential, TENNs could revolutionize LLMs and LVMs at the Edge. Tested on prior generation transformer-based models, a TENNs-equivalent has shown that for equivalent perplexity scores (an indicator of correctness), while reducing model size and MACs/token by 3-4 orders of magnitude. More importantly, the training of these models is similar to that of CNN training and yet takes less than 1/10th the time compared to the transformer equivalent."
 
  • Like
  • Fire
  • Love
Reactions: 35 users

7für7

Top 20
@Bravo WHAT THE HECK… I KNEW IT!!!

IMG_1895.jpeg
 
  • Haha
  • Like
Reactions: 12 users
Dont think this short video has been posted?

 
  • Like
  • Love
  • Fire
Reactions: 12 users
  • Like
  • Fire
Reactions: 14 users

Adam82

Member
  • Love
  • Fire
  • Like
Reactions: 4 users
Top Bottom