BRN Discussion Ongoing
- Thread starter TechGirl
- Start date
thelittleshort
Top Bloke
Interesting link via Edge Impulse to AI wearables and Rett Syndrome. Not sure if there are any BRN holders here who also hold NEU
www.linkedin.com
New study shows how machine learning can improve care for people with Rett syndrome | Emory University | Atlanta GA | Edge Impulse (a Qualcomm company)
A new study by researchers at Emory University and the Georgia Institute of Technology demonstrates how the use of a wearable electronic chest patch combined with advancements in machine learning could aid in the development of new treatments for Rett syndrome, as well as a number of other...
New study shows how machine learning can improve care for people with Rett syndrome | Emory University | Atlanta GA
Published in PLOS One, Gari Clifford and his research team at Emory University and the Georgia Institute of Technology used the MC10 Biostamp patch to analyze the movement and cardiac activity of people living with Rett syndrome.
news.emory.edu
jtardif999
Regular
I think from recollection SCALA2 is limited to speeds of 60km/hour; SCALA3 is supposed to double that limit due to being able to see further ahead. Level 3 certification is currently limited to 60km/hour speeds.
Fact Finder
Top 20
“Samsung, can “purchase a chipset and the software from [Qualcomm] and then, from Prophesee, they would also purchase the image sensor and the software… but they would have both been pre-tested by us.”EE Times- Posted an hour ago,
Experts Weigh Impact of Prophesee-Qualcomm Deal
By Sunny Bains 03.03.2023 0
Share Post
Share on Facebook
Share on Twitter
Prophesee this week announced a collaboration to “allow native compatibility” between its Metavision neuromorphic event-based cameras and Qualcomm’s Snapdragon mobile platforms in a multi-year deal to co-develop their tech.
Prophesee’s brain-inspired sensorsinherently compress data by only detecting pixels that change their brightness level at any given time. This means the sensors can work at very high, effective frame rates but, for most tasks, at very low power and bandwidth. The technology is already routinely used in automation and inspection applications to measure vibrations as well as count and track objects.
ADVERTISING
The data provided by the sensors can be used to enhance images from a conventional frame-based camera: removing blur where the light is low or the subjects are moving quickly. This is particularly important for small cameras that have less light-gathering power.
ADVERTISEMENT
SCROLL DOWN TO CONTINUE READING
Frédéric Guichard, CEO and CTO of DXOMARK, a French company that specializes in testing cameras and other consumer electronics, and that is unconnected with Paris-based Prophesee, told EE Times that the ability to deblur in these circumstances could provide definite advantages.
“Reducing motion blur [without increasing noise] would be equivalent to virtually increasing camera sensitivity,” Guichard said, noting two potential benefits: “For the same sensitivity [you could] reduce the sensor size and therefore camera thickness,” or you could maintain the sensor size and use longer exposures without motion blur.
By combining a conventional frame camera with data from an event-based imager, motion blur can be eliminated. See this video. (Source: Prophesee)
Judd Heape, VP for product management of camera, computer vision and video at Qualcomm Technologies, told EE Times that they can get this image enhancement with probably a 20-30% increase in power consumption to run the extra image sensor and execute the processing.
“The processing can be done slowly and offline because you don’t really care about how long it takes to complete,” Heape added.
A richer feature set
Concept of the dual event/frame sensor camera. (Source: Prophesee)
Event sensors, however, should make other functionalities possible, too.
Tobi Delbruck, a professor at the Institute of Neuroinformatics in Zurich, Switzerland, and founder of Prophesee competitor IniVation, told EE Times that a big group at Samsung was looking at “trying to integrate something like a DVS [event-based camera] into smartphones, and they successfully demonstrated a whole bunch of cool [features] like gesture recognition.”
At the time, Delbruck explained, it wasn’t technically feasible to execute the signal processing required to make an event-based camera work on a phone, but now, with the neural accelerators that have become increasingly powerful and efficient in mobile platforms (as on Qualcomm’s Snapdragon), this is no longer a barrier.
Qualcomm’s Heape said he is also aware of, and interested in, these other possibilities.
“We have many, many low-power use cases,” he said. Lifting a phone to your ear to wake it up is one example. Gesture-recognition to control the car when you’re driving is another.
“These event-based sensors are much more efficient for that because they can be programmed to easily detect motion at very low power,” he said. “So, when the sensor is not operating, when there’s no movement or no changes in the scene, the sensor basically consumes almost no power. So that’s really interesting to us.”
Eye-tracking could also be very useful, Heape added, because Qualcomm builds devices for augmented and virtual reality. “Eye-tracking, motion-tracking of your arms, hands, legs… are very efficient with image sensors,” he said. “In those cases, it is about power, but it’s also about frame rate. We need to track the eyes at like 900 frames per second. It’s harder to do that with a standard image sensor.”
Toward mass production
Heape explained how the collaboration will work: Qualcomm’s OEMs, such as Oppo, Vivo, Xiaomi, OnePlus Honor, and Samsung, can “purchase a chipset and the software from [Qualcomm] and then, from Prophesee, they would also purchase the image sensor and the software… but they would have both been pre-tested by us.”
Product lines, however, are not being combined. “We’re working together to pre-integrate them before they get incorporated into the final product,” he said.
This highlights another advantage of the collaboration with Qualcomm, one that Delbruck points out: It gives Prophesee access to integrate with Mobile Industry Processing Interface (MIPI), making it possible for the company to move into these mobile applications. Licensing this technology is expensive, so this would otherwise be a barrier to entering the mobile market.
Prophesee CEO Luca Verre told EE Times the company is close to launching its first mobile product with one OEM. “The target is to enter into mass production next year,” he said.
However, Delbruck cautioned that an intellectual property battle could get in the way—because there has long been contention about whether the Prophesee camera is too similar to earlier designs, particularly those invented at INI Zurich.
“It’s not an issue at all right now because nothing is in mass production,” he said, “But it could become an issue for them later, as happened with Caltech and the basic APS [Active Pixel Sensor] patent.”
Concept of the dual event/frame sensor camera. (Source: Prophesee)If we accept the above as a correct reporting of how this engagement will work then there is no reason why Prophesee cannot complete its vision by adding the AKIDA brain to the vision sensor and process the vision and send metadata to Snapdragon.
In doing so it would have the advantage of reduced latency and reduced power that would otherwise be taken up by Snapdragon converting the unprocessed spikes from Prophesee’s sensor then processing that data.
It just makes sense and given that Prophesee is after multiple markets completing their sensor by adding the missing brain discussed in the podcast with Rob Telson just makes logical sense.
Additionally if there is some issue as this article suggest with the earlier designs by third parties adding the brain may actually work to Prophesee’s advantage.
Remember the Mercedes Benz words that it is incredible what a little bit of human like intelligence can achieve.
By the way as it now seems Prophesee will be mass producing its own sensor to supply to Qualcomm the need for $50 million becomes a little clearer.
My opinion only so DYOR
FF
AKIDA BALLISTA
Last edited:
buena suerte :-)
BOB Bank of Brainchip
Fact Finder
Top 20
Another independent opinion of AKIDA technology being publicly stated by a significant industry player.
Love the wording.
Anil Mankar reposted this
BrainChip 8,600 followers
17h •
17 hours ago
BrainChip teams for AIoT - Teksun in India has joined the Essential AI Ecosystem around BrainChips Akida low power event-driven neural networking chip to develop a wide range of AI-featured devices in the Internet of Things (AIoT). eeNews Europe via Nick Flaherty
https://lnkd.in/e-TDVuKP
Does this opinion have greater weight than that expressed by anonymous posters and WANCAs you be the judge:
“Teksun is committed to innovation and dedicated to providing our customers with the most advanced IoT solutions,” said Brijesh Kamani, founder & CEO of Teksun.
“With BrainChip’s Akida processor, we will be able to deliver next-generation AIoT devices that are faster, more efficient, and more intelligent than ever before and not just meet, but exceed the expectations of our customers.”
Does this statement not make all the negative commentators no more than white noise to be tuned out.
I certainly believe so.
My opinion only DYOR
FF
AKIDA BALLISTA
BaconLover
Founding Member
The recent price drop (especially since the LDA ann) may not have played a major factor on this rebalance.
Unless we see some actual material sales, next re-balance would be worth noting.
World’s first on-device demonstration of Stable Diffusion on an Android phone
Discover how we optimized on-device stable diffusion, a leading foundation AI model, to run efficiently on an Android smartphone using Qualcomm AI Stack.
Bravo
If ARM was an arm, BRN would be its biceps💪!
Talking about the new Mercedes operating system MBOS. "The entire operating system would be a game changer, Iyer stated."
brandequity.economictimes.indiatimes.com
CX+ Summit: Mercedes-Benz goes beyond the car in its CX drive
Mercedes-Benz’s Santosh Iyer spoke about how the traditional automotive retail model has shortcomings and how CX cannot be thoroughly practiced till one changes their business model.
DingoBorat
Slim
Now try and find the time, to look into the company we actually partnered with
..Hopefully you're not underwhelmed..
Bravo
If ARM was an arm, BRN would be its biceps💪!
Another article this morning espousing the new partnership between Google and Mercedes. I think at this stage even Blind Freddie would have to agree there's no way that we won't be working with Goggle at some stage given "the Googlefied architecture" will employ the latest version Hyperscreen, a feature of the UI/UX which incoproates AKIDA technology in order increase efficiency and to help the car and driver work together as one.
thebrunswicknews.com
Casey Williams: Google, AI and augmented reality will transform our driving experience
Before automobiles, a “dashboard” was a wooden panel on carriages that kept horse dung from becoming one’s evening attire. As carriages became horseless, the dashboard separated engine from occupants and
New Vision EQXX Unveiled: The future of Mercedes-EQ? - MBWorld.org Forums
EQS - New Vision EQXX Unveiled: The future of Mercedes-EQ? - VISION EQXX ? taking electric range and efficiency to an entirely new level...
mbworld.org
Fact Finder
Top 20
Reading this I was reminded of a survey done a few years ago by a car magazine of new car buyers and a significant percentage which I cannot now remember said they would not buy their particular vehicle again because of issues related to cup holders.Talking about the new Mercedes operating system MBOS. "The entire operating system would be a game changer, Iyer stated."
View attachment 31132
View attachment 31133
View attachment 31134
CX+ Summit: Mercedes-Benz goes beyond the car in its CX drive
Mercedes-Benz’s Santosh Iyer spoke about how the traditional automotive retail model has shortcomings and how CX cannot be thoroughly practiced till one changes their business model.
Bravo
If ARM was an arm, BRN would be its biceps💪!
This is from an old post on Magnus Ostberg's LinkedIn (Chief Software Officer - Mercedes).
This tells us that Continental, BMW, Volswagen and Mercedes all use the same tool chain. What the significance of this is, I know not, but Dr Bonin does admit the Hyperscreen is the most stunning in the industry.
This tells us that Continental, BMW, Volswagen and Mercedes all use the same tool chain. What the significance of this is, I know not, but Dr Bonin does admit the Hyperscreen is the most stunning in the industry.
Sirod69
bavarian girl ;-)
Bravo
If ARM was an arm, BRN would be its biceps💪!
Reading this I was reminded of a survey done a few years ago by a car magazine of new car buyers and a significant percentage which I cannot now remember said they would not buy their particular vehicle again because of issues related to cup holders.
They mustn't have bought the magical spill-proof cup holder then. Now THAT was a game changer!
Tothemoon24
Top 20
Seeing is Collecting
Audio-video giant Sony is working to take vision systems to the next level. Similar to Nikon’s transformation, Sony aims to carve out its spot in the event-based vision system industry by creating sensors that act like retinas in the human eye.The tiny sensors are becoming ever smaller, which allows more of them to be fitted on a device to boost data collection volumes. The use of these sensors goes far beyond the manufacturing floor. As the technology improves, Sony sees deployment within collision avoidance systems, drones, and event-based 3D cameras.
Sony recently introduced what it touts as the world’s first intelligent vision sensors equipped with AI processing functionality. One highlight: The new chip will be to identify people and objects.
This would allow cameras with the chip to identify stock levels on a store shelf or use heat maps to track and analyze customer behavior. It could even count and forecast the number of customers in a given location, providing valuable data to calculate when foot traffic is highest.
Where the technology stands to shine the most in manufacturing is around data management. Advanced sensors can identify objects and send a description of what they see without having to include an accompanying image that takes up space in the database. This could reduce storage requirements by up to 10,000 times, leaving companies with more space to gather critical data that they previously haven’t been able to access, while giving AI a looser leash to capture relevant information.
Working Together
As technology evolves, partnerships between companies in the event-based vision system space and those that want to deploy across other industries will become commonplace.Datalogic is joining forces with Paris-based Prophesee, a company that invented advanced neuromorphic vision systems and is working to build the next generation of industrial products.
“We are conducting a very fruitful partnership with Prophesee,” said Michele Benedetti, chief technology officer at Datalogic. “Neuromorphic vision is a fascinating technology inspired by the behavior of the human biological system, exactly like neural networks. We believe that the combination of these technologies will provide innovative solutions to our customers.”
As investment in this space increases, the market is expected to drive growth in other industries at an exponential rate through at least 2030, according to a Grand View Research report on the U.S. machine vision market. The increasing demand for quality inspection, as well as the need for vision-guided robotic systems, is expected to fuel that growth.
While long-term forecasts for emerging technologies are far from an exact science, the future for event-based vision systems looks promising—giving manufacturers cause to be fitted with a pair of 20/20 rose-colored specs.
Well One thing is for certain, Brainchip’s astute management team must have had a very good reason for drawing down on the $50 million. With everything that’s going on it is hard not to be extremely confident that Brainchip is going to fly this year.
Similar threads
