Smoothsailing
Regular
Go brainchip
BRN Discussion Ongoing
- Thread starter TechGirl
- Start date
Frangipani
Top 20
I’m happy to share that I’m starting a new position as Furber Chair of… | André van Schaik | 64 comments
I’m happy to share that I’m starting a new position as Furber Chair of Neuromorphic Systems Engineering at The University of Manchester! | 64 comments on LinkedIn
#icns | André van Schaik | 42 comments
My first day at school! At my new home at the University of Manchester to set up another International Centre for Neuromorphic Systems #ICNS. I’m very excited to be given this opportunity. So many possibilities and so much interest in applied neuromorphic systems. | 42 comments on LinkedIn
Last edited:
Bravo
If ARM was an arm, BRN would be its biceps💪!
Fraunhofer IIS Walks the Line for Edge AI
April 2, 2025 Pat BransThe institute’s development projects strike a balance between hardware and software to optimize AI model performance on small processors.
Advertisement
Before edge AI can deliver a full range of new applications, there is work to be done to improve the way models operate in a constrained environment—without sacrificing accuracy. As an applied research institute in the field of integrated circuits, Fraunhofer IIS develops small-form–factor AI processors and optimized AI software to address the challenges posed by the edge environment.
“When it comes to hardware, two research paths are given the highest priority,” said Nicolas Witt, machine intelligence department lead and leader of the edge AI special interest group at Fraunhofer IIS.
Fraunhofer IIS’s Nicolas WittOne is an analog deep neural network accelerator that uses in-memory computing based on analog signals from electric current. “We have our Adelia accelerator, which accelerates neural networks and does the processing in a very low-energy manner,” Witt said. “We need up to 1,000× less energy than what’s required by microcontrollers, because Adelia only uses power when it really computes.”
The other path is around spiking neural networks, which are inspired by what we know about the human brain.“We have accelerators for these types of neural networks too,” Witt said. “Having specialized hardware for that enables us to get to even smaller form factors and devices [with] less energy consumption.”
Fraunhofer’s Adelia accelerator (Source: Adobe Stock/Fraunhofer IIS)Hardware-aware deep compression of AI models
In addition to its work on hardware, Fraunhofer IIS develops software tools to optimize AI models for use in constrained edge devices without losing too much accuracy. The small devices have constrained computational and memory resources, and power consumption must be minimized. But thermal factors are also a big concern, because heat cannot be dissipated easily on densely packed hardware.“If you generate a lot of heat through processing, you hit a heat wall, which becomes a major problem,” Witt said. “We’re researching ways of scaling down processing at the edge, especially for sensor applications.”
Fraunhofer researchers use multi-objective optimization to address several metrics at once, working to maximize AI performance (for example, speed and accuracy) while minimizing the number of operations and the amount of memory needed to carry out AI functions. “After the multi-objective optimization, you get AI models that are small but also capable when it comes to processing data,” Witt said.
“One technique we use to reduce the size of a model is deep compression,” he said. “Deep compression denotes pruning, getting rid of redundant compute paths in a neural network. That makes the whole model smaller.
“Another technique is quantization, restricting the resolution of all the numbers. Typically, quantization is done down to 16- or 8-bit [resolution], but it can get down even lower than that. There are networks that can be processed with 1-bit resolution. You have to do some computation tricks, but it’s possible.”
Losses are generally low with quantization because it involves only a change in resolution, Witt said, but pruning a model often results in non-negligible loss of functionality. Fraunhofer and other institutes are conducting research on the redundancies in the neural networks and what gets lost when they’re removed. The work in this area is similar to research in explainable AI, which tries to map network structures to specific behaviors. Witt identified “the fundamental question” here as, “What is the minimal AI model that delivers the functionality and accuracy my application needs?” Finding out is an active field of research.
While these deeper questions remain unanswered, Fraunhofer IIS experts still use pruning to build prototypes, mitigating the potential loss of functionality on a case-by-case basis. “We usually start with an oversized network and apply deep compression to get it on smaller hardware,” Witt said. “And then you have to test quite carefully to find out which functionality is lost. Of course, the test functions have to be specific to the application.”
Fraunhofer IIS casts a large net in its AI research and applies its know-how to a range of projects with industrial partners. One application area is audio compression, transmission, and processing on wireless headsets. Another involves processing 5G data on small devices to determine position. Fraunhofer also worked on a demo involving cameras that can scan a crowd and count the people directly on the camera itself, without sending images to another device for further processing. And in the retail sector, the institute has worked on seamless shopping, which would enable shoppers to pay for their purchases without having to wait in a register line. Rather, a camera system would detect all of the items in a customer’s trolley, calculate the total, and complete the payment transaction wirelessly.
Perhaps the most unusual project Fraunhofer IIS has worked on involves the deployment of swarms of edge devices to monitor and detect disease in wildlife populations. Cameras are mounted on vultures, which congregate around the carcasses of other animals to feed. The cameras record video that is processed locally by AI agents, and then swarm processing is used to complete the vision tasks that would ordinarily require bigger neural networks.
Swarms of edge devices can be deployed to monitor wildlife populations. (Source: Fraunhofer IIS)While models built for edge AI are more efficient than the big AI models, Witt said work must be done to better understand how humans and other living creatures learn, because those biological learning processes are far more energy-efficient than today’s machine-learning tools. “Our brains process information with far less energy than we currently do with AI,” he said. “It’s very important to invest in research to get AI functions to use much less energy.”
Further refining the interplay between hardware and software
According to Witt, one caveat for current edge AI projects is that developers must make decisions about the hardware on which the models will run before the models can be built. Research is needed to help developers match the intended AI functionality with the appropriate hardware more efficiently. Another line of research is around automating the development process, so that once the hardware is decided, most of the steps needed to make a model work for that platform can be performed with little or no human intervention.Another hurdle is education. Data scientists and AI developers are highly trained to optimize the accuracy of AI models. Hardware and firmware developers are equally skilled at optimizing memory use and energy consumption. The challenge, Witt said, is “to find people knowledgeable in both areas, or even to get these two types of people to work together on edge AI.”
DingoBorat
Slim
I'm not sure whether to laugh or cry on seeing this..
I think it's relevant as we "want" to be involved with EVs and no "disturbing" mentions in it, so keeping my promise Larry
I did watch a 2019 short documentary called "Planet of the Humans" by Jeff Gibbs (Michael Moore was producer) which I recommend (it is filmed in a way of shock value and some outdated data, but the "message" is valid).
So I'm not "really" surprised...
TheDrooben
Pretty Pretty Pretty Pretty Good
I'm not sure whether to laugh or cry on seeing this..
I think it's relevant as we "want" to be involved with EVs and no "disturbing" mentions in it, so keeping my promise Larry
I did watch a 2019 short documentary called "Planet of the Humans" by Jeff Gibbs (Michael Moore was producer) which I recommend (it is filmed in a way of shock value and some outdated data, but the "message" is valid).
So I'm not "really" surprised...
View attachment 81720
Sure that is disturbing DB and it should be incumbent on the Indonesian govt to step in to protect it's citizens. On the overall environmental impact of EV's versus ICE's then you should take the whole production and operational effects to have a complete picture IMO...
Are electric vehicles definitely better for the climate than gas-powered cars?
Yes: although electric cars' batteries make them more carbon-intensive to manufacture than gas cars, they more than make up for it by driving much cleaner under nearly any conditions.
Happy as Larry
That is right. The paper written on 'roadscene'testing using the AVK4 showed AKIDA clearly the best.That’s right, the gesture demo used a PROPHESEE EVK4:
View attachment 81701
BrainChip Demonstrates Event-based Vision at Embedded World 2025
BrainChip Demonstrates Event-based Vision at Embedded World 2025 Laguna Hills, Calif. – March 10, 2025 – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), the world’s first commercial producer of ultra-low power, fully digital, event-based, brain-inspired AI, today announced that it...brainchip.com
DingoBorat
Slim
"Yes: although electric cars' batteries make them more carbon-intensive to manufacture than gas cars, they more than make up for it by driving much cleaner under nearly any conditions"Sure that is disturbing DB and it should be incumbent on the Indonesian govt to step in to protect it's citizens. On the overall environmental impact of EV's versus ICE's then you should take the whole production and operational effects to have a complete picture IMO...
Are electric vehicles definitely better for the climate than gas-powered cars?
Yes: although electric cars' batteries make them more carbon-intensive to manufacture than gas cars, they more than make up for it by driving much cleaner under nearly any conditions.climate.mit.edu
Happy as Larry
I'm calling Bullshit on that statement from that article
..It's not taking into consideration, things like increased tire wear and braking dust, because the things are so damn heavy, or the fact that EVs are designed to last just a handful of years..
Then there's things like recycling the batteries, I could go on and on..
Once they are in just a minor bingle, they are a complete write off apparently too, due to risk of damage to the battery.
Articles like that, are just selling the "Green Dream".
TheDrooben
Pretty Pretty Pretty Pretty Good
That's fine mate.......then shouldn't your mate Elon be called out on becoming the world's richest man by causing all this environmental and social destruction in becoming so rich.........go on say he is also to blame."Yes: although electric cars' batteries make them more carbon-intensive to manufacture than gas cars, they more than make up for it by driving much cleaner under nearly any conditions"
I'm calling Bullshit on that statement from that article
It's not taking into consideration, things like increased tire wear and braking dust, because the things are so damn heavy, or the fact that EVs are designed to last just a handful of years..
Then there's things like recycling the batteries, I could go on and on..
Articles like that, are just selling the "Green Dream".
I'm not sure whether to laugh or cry on seeing this..
I think it's relevant as we "want" to be involved with EVs and no "disturbing" mentions in it, so keeping my promise Larry
I did watch a 2019 short documentary called "Planet of the Humans" by Jeff Gibbs (Michael Moore was producer) which I recommend (it is filmed in a way of shock value and some outdated data, but the "message" is valid).
So I'm not "really" surprised...
View attachment 81720
Can you imagine someone would do this with a picture of Obama??? Nahhh of course you can’t
FabricatedLunacy
Regular
Sure... matter of fact we will explode up to AUD10.92... Nope, just kidding, we will get more "oh we could should would". Like every year. Go 2 years back here, as same conversations same questions and nothing.
Batten down the hatches, this will be a bumpy ride.
Careful what you wish for.
Fullmoonfever
Top 20
I see BRN presenting at this years Pitt St Conference amongst a number of others.
Obviously taking advantage of being in Sydney for the AGM.
stocksdownunder.com
DATE
Wednesday, 7 May 2025
TIME
9:00am – 3:00pm
IN-PERSON VENUE
Bell Potter Securities
Level 38, 88 Phillip Street Sydney NSW 2000
Despite Akida having such remarkable capabilities, it is less power-hungry compared to other neural networks, needing only fractions of a watt to operate. This means it can operate longer than other Edge devices, which is extremely beneficial in Edge applications where battery life is a major concern.
Obviously taking advantage of being in Sydney for the AGM.
Mark the Pitt Street Research Semiconductor Conference 2025 in your calendars!
Pitt Street Research in partnership with Bell Potter are thrilled to be hosting the Pitt Street Research Semiconductor Conference 2025.
stocksdownunder.com
The Pitt Street Research Semiconductor Conference 2025 is coming up!
Pitt Street Research in partnership with Bell Potter are thrilled to be hosting the Pitt Street Research Semiconductor Conference 2025. Join industry leaders, investors and innovators as we explore the future of Australia’s semiconductor sector. Taking place virtually and in-person in Sydney on Wednesday, 7 May 2025, this event will feature expert insights, emerging technologies and investment opportunities shaping the global semiconductor landscape.DATE
Wednesday, 7 May 2025
TIME
9:00am – 3:00pm
IN-PERSON VENUE
Bell Potter Securities
Level 38, 88 Phillip Street Sydney NSW 2000
Presenting companies
BrainChip (ASX:BRN)
BrainChip is commercialising and developing a neuromorphic processing technology known as Akida. Akida is proprietary intellectual property (IP) added to a chip that enables the chip to function in a similar way to the human brain instead of relying on externally-set software-based algorithms. It can operate and learn ‘in the field’ without a continuous internet connection and when it is already deployed. Akida, and any device it is used in by extension, can make decisions much faster as a consequence.Despite Akida having such remarkable capabilities, it is less power-hungry compared to other neural networks, needing only fractions of a watt to operate. This means it can operate longer than other Edge devices, which is extremely beneficial in Edge applications where battery life is a major concern.
Pom down under
Top 20
So they supply worker robots and I wonder if we are involved making them smarter
You’re right
I forgot to follow my own rules! A positiv price sensitive announcement of courseAKIDA/TENNS Prophesee roadscene tests
Prophesee GEN4 Roadscene Detection Dataset - LDM
The dataset used for the Prophesee GEN4 roadscene object detection task, containing recordings of road scenes with a 1 megapixel event camera.
TENNs-PLEIADES: Building Temporal Kernels with Orthogonal Polynomials
We introduce a neural network named PLEIADES (PoLynomial Expansion In Adaptive Distributed Event-based Systems), belonging to the TENNs (Temporal Neural Networks) architecture. We focus on interfacing these networks with event-based data to perform online spatiotemporal classification and...
Prophesee GEN4 Roadscene Detection Dataset
TENNs-PLEIADES: Building Temporal Kernels with Orthogonal Polynomia
Similar threads
