I reckon just the day traders punting on a natural consolidation towards end of Fridays trade and trying to time the peak. I think we are having a great run. Next week will be even better!There seems to be a continuous amount of around 400k sells below $1.20. Very annoying!
..................... "NOOOOOO , that cant be, Neuromorphic Sensing: Coming Soon to Consumer Products
By Sally Ward-Foxton 07.20.2022 0
Share Post
What does âneuromorphicâ mean today?
âYou will get 10 different answers from 10 different people,â laughed Luca Verre, CEO of Prophesee. âAs companies take the step from âthis is what we believeâ to âhow can we make this a reality,â what neuromorphic means will change.â
Most companies doing neuromorphic sensing and computing have a similar vision in mind, he said, but implementations and strategies will be different based on varying product, market, and investment constraints.
ADVERTISEMENT
SCROLL DOWN TO CONTINUE READING
âThe reason why⌠all these companies are working [on neuromorphic technologies] is because there is a fundamental belief that the biological model has superior characteristics compared to the conventional,â he said. âPeople make different assumptions on product, on system integration, on business opportunities, and they make different implementations⌠But fundamentally, the belief is the same.â
Luca Verre (Source: Prophesee)
Verreâs vision is that neuromorphic technologies can bring technology closer to human beings, which ultimately makes for a more immersive experience and allows technologies such as autonomous driving and augmented reality to be adopted faster.
âWhen people understand the technology behind it is closer to the way we work, and fundamentally natural, this is an incredible source of reassurance,â he said.
WHICH MARKETS FIRST?
Prophesee is already several years into its mission to commercialize the eventâbased camera using its proprietary dynamic vision sensor technology. The company has collaborated with camera leader Sony to make a compact, highâresolution eventâbased camera module, the IMX 636. In this module, the photodiode layer is stacked directly on top of the CMOS layer using Sonyâs 3D die stacking process.
According to Verre, the sector closest to commercial adoption of this technology is industrial machine vision.
âIndustrial is a leading segment today because historically we pushed our thirdâgeneration camera into this segment, which was a bigger sensor and more tuned for this type of application,â he said. âIndustrial has historically been a very active machine vision segment, in fact, it is probably one of the segments that adopted the CCD and CMOS technologies at the very beginning⌠definitely a key market.â
Propheseeâs and Sonyâs jointly developed IMX 6363 event-based sensor (Source: Prophesee)
The second key market for the IMX 636 is consumer technologies, driven by the shrink in size enabled by Sonyâs dieâstacking process. Consumer applications include IoT cameras, surveillance cameras, action cameras, drones, consumer robots, and even smartphones. In many cases, the eventâbased camera is used alongside a fullâframe camera, detecting motion so that image processing can be applied to capture better quality images, even when the subject is moving.
âThe reason is very simple: eventâbased cameras are great to understand motion,â he said. âThis is what they are meant for. Frameâbased cameras are more suited to understanding static information. The combination of the dynamic information from an eventâbased camera and static information from a frameâbased camera is complementary if you want to capture a picture or video in a scene where thereâs something moving.â
Event data can be combined with fullâframe images to correct any blur on the frame, especially for action cameras and surveillance cameras.
âWe clearly see some traction in this in this area, which of course is very promising because the volume typically associated with this application can be quite substantial compared to industrial vision,â he said.
Prophesee is also working with a customer on automotive driver monitoring solutions, where Verre said eventâbased cameras bring advantages in terms of low light performance, sensitivity, and fast detection. Applications here include eye blinking detection, tracking or face tracking, and microâexpression detection.
APPROACH TO COMMERCIALIZATION
Propheseeâs EV4 evaluation kit (Source: Prophesee)
Prophesee has been working hard on driving commercialization of eventâbased cameras. The company recently released a new evaluation kit (EVK4) for the IMX 636. This kit is designed for industrial vision with a rugged housing but will work for all applications (Verre said several hundred of these kits have been sold). The companyâs Metavision SDK for eventâbased vision has also recently been openâsourced in order to reduce friction in the adoption of eventâbased technology. The Metavision community has around 5,000 registered members today.
âThe EDK is a great tool to further push and evangelize the technology, and it comes in a very typical form factor,â Verre said. âThe SDK hides the perception of complexity that every engineer or researcher may have when testing or exploring a new technology⌠Think about engineers that have been working for a couple of decades on processing images that now see events⌠they donât want to be stretched too much out of their comfort zone.â
New to the Metavision SDK is a simulator to convert full frames into events to help designers transition between the way they work today and the event domain. Noting a reluctance of some designers to move away from full frames, Verre said the simulator is intended to show them thereâs nothing magic about events.
â[Events are] just a way of capturing information from the scene that contains much more temporal precision compared to images, and is actually much more relevant, because typically you get only what is changing,â he said.
The simulator can also reconstruct image full frames from event data, which he says people find reassuring.
âThe majority of customers donât pose this challenge any longer because they understand that they need to see from a different perspective, similar to when they use technology like time of flight or ultrasound,â he said. âThe challenge is when their perception is that this is another image sensor⌠for this category of customer, we made this tool that can show them the way to transition stepwise to this new sensing modality⌠it is a mindset shift that may take some time, but it will come.â
Applications realized in the Prophesee developer communityinclude restoring some sight for the blind, detecting and classifying contaminants in medical samples, particle tracking in research, robotic touch sensors, and tracking space debris.
HARDWARE ROADMAP
In terms of roadmap, Prophesee plans to continue development of both hardware and software, alongside new evaluation kits, development kits, and reference designs. This may include system reference designs which combine Prohpesee sensors with specially developed processors. For example, Prohpesee partner iCatch has developed an AI vision processor SoC that interfaces natively with the IMX 636 and features an onâchip event decoder. Japanese AI core provider DMP is also working with Prophesee on an FPGAâbased system, and there are more partnerships in the works, said Verre.
Prophesee and Sony IMX 636 is a fourth-generation product. Prophesee said future generations will reduce pixel pitch and ease integration with conventional computing platforms (Source: Prophesee)
âWe see that there is growing interest from ecosystem partners at the SoC level, but also the software level, that are interested in building new solutions based on Prophesee technology,â he said. âThis type of asset is important for the community, because it is another step towards the full solution â they can get the sensor, camera, computing platform, and software to develop an entire solution.â
Where does eventâbased sensor hardware go from here? Verre cited two key directions the technology will move in. The first is further reduction of pixel size (pixel pitch) and overall reduction of the sensor to make it suitable for compact consumer applications such as wearables. The second is facilitating the integration of eventâbased sensing with conventional SoC platforms.
Working with computing companies will be critically important to ensure nextâgeneration sensors natively embed the capability to interface with the computing platform, which simplifies the task at the system level. The result will be smarter sensors, with added intelligence at the sensor level.
âWe think events make sense, so letâs do more pre-processing inside the sensor itself, because itâs where you can make the least compromise,â Verre said. âThe closer you get to the acquisition of the information, the better off you are in terms of efficiency and low latency. You also avoid the need to encode and transmit the data. So this is something that we are pursuing.â
As foundries continue to make progress in the 3D stacking process, stacking in two or even three layers using the most advanced CMOS processes can help bring more intelligence down to the pixel level.
How much intelligence in the pixel is the right amount?
Verre said itâs a compromise between increasing the cost of silicon and having sufficient intelligence to make sure the interface with conventional computing platforms is good enough.
âSensors donât typically use advanced process nodes, 28nm or 22nm at most,â he said. âMainstream SoCs use 12nm, 7nm, 5nm, and below, so theyâre on technology nodes that can compress the digital component extremely well. The size versus cost equation means at a certain point itâs more efficient, more economical [to put the intelligence] in the SoC.â
There is also a certain synergy to combining eventâbased sensors with neuromorphic computing architectures.
âThe ultimate goal of neuromorphic technology is to have both the sensing and processing neuromorphic or eventâbased, but we are not yet there in terms of maturity of this type of solution,â he said. âWe are very active in this area to prepare for the future â we are working with Intel, SynSense, and other partners in this area â but in the short term, the mainstream market is occupied by conventional SoC platforms.
Propheseeâs approach here is pragmatic. Verre said the companyâs aim is to try to minimize any compromises to deliver benefits that are superior to conventional solutions.
âUltimately we believe that events should naturally stream asynchronously to a compute architecture that is also asynchronous in order to benefit fully in terms of latency and power,â he said. âBut we need to be pragmatic and stage this evolution, and really capitalize on the existing platforms out there and work with key partners in this space that are willing to invest in softwareâhardware developments and to optimize certain solution for certain markets.â
If we hit $1.29 today I'll do a nudie run down my street and post it on here.$1.2950 CLOSE OUT
A couple of killer whales are lurking in the depths
im hoping the video will be from the front , as to see "his/her bush block"...............
He better warm up as you know what happens to you know what when it's cold.
Neuromorphic Sensing: Coming Soon to Consumer Products
By Sally Ward-Foxton 07.20.2022 0
Share Post
What does âneuromorphicâ mean today?
âYou will get 10 different answers from 10 different people,â laughed Luca Verre, CEO of Prophesee. âAs companies take the step from âthis is what we believeâ to âhow can we make this a reality,â what neuromorphic means will change.â
Most companies doing neuromorphic sensing and computing have a similar vision in mind, he said, but implementations and strategies will be different based on varying product, market, and investment constraints.
ADVERTISEMENT
SCROLL DOWN TO CONTINUE READING
âThe reason why⌠all these companies are working [on neuromorphic technologies] is because there is a fundamental belief that the biological model has superior characteristics compared to the conventional,â he said. âPeople make different assumptions on product, on system integration, on business opportunities, and they make different implementations⌠But fundamentally, the belief is the same.â
Verreâs vision is that neuromorphic technologies can bring technology closer to human beings, which ultimately makes for a more immersive experience and allows technologies such as autonomous driving and augmented reality to be adopted faster.
âWhen people understand the technology behind it is closer to the way we work, and fundamentally natural, this is an incredible source of reassurance,â he said.
WHICH MARKETS FIRST?
Prophesee is already several years into its mission to commercialize the eventâbased camera using its proprietary dynamic vision sensor technology. The company has collaborated with camera leader Sony to make a compact, highâresolution eventâbased camera module, the IMX 636. In this module, the photodiode layer is stacked directly on top of the CMOS layer using Sonyâs 3D die stacking process.
According to Verre, the sector closest to commercial adoption of this technology is industrial machine vision.
âIndustrial is a leading segment today because historically we pushed our thirdâgeneration camera into this segment, which was a bigger sensor and more tuned for this type of application,â he said. âIndustrial has historically been a very active machine vision segment, in fact, it is probably one of the segments that adopted the CCD and CMOS technologies at the very beginning⌠definitely a key market.â
The second key market for the IMX 636 is consumer technologies, driven by the shrink in size enabled by Sonyâs dieâstacking process. Consumer applications include IoT cameras, surveillance cameras, action cameras, drones, consumer robots, and even smartphones. In many cases, the eventâbased camera is used alongside a fullâframe camera, detecting motion so that image processing can be applied to capture better quality images, even when the subject is moving.
âThe reason is very simple: eventâbased cameras are great to understand motion,â he said. âThis is what they are meant for. Frameâbased cameras are more suited to understanding static information. The combination of the dynamic information from an eventâbased camera and static information from a frameâbased camera is complementary if you want to capture a picture or video in a scene where thereâs something moving.â
Event data can be combined with fullâframe images to correct any blur on the frame, especially for action cameras and surveillance cameras.
âWe clearly see some traction in this in this area, which of course is very promising because the volume typically associated with this application can be quite substantial compared to industrial vision,â he said.
Prophesee is also working with a customer on automotive driver monitoring solutions, where Verre said eventâbased cameras bring advantages in terms of low light performance, sensitivity, and fast detection. Applications here include eye blinking detection, tracking or face tracking, and microâexpression detection.
APPROACH TO COMMERCIALIZATION
Prophesee has been working hard on driving commercialization of eventâbased cameras. The company recently released a new evaluation kit (EVK4) for the IMX 636. This kit is designed for industrial vision with a rugged housing but will work for all applications (Verre said several hundred of these kits have been sold). The companyâs Metavision SDK for eventâbased vision has also recently been openâsourced in order to reduce friction in the adoption of eventâbased technology. The Metavision community has around 5,000 registered members today.
âThe EDK is a great tool to further push and evangelize the technology, and it comes in a very typical form factor,â Verre said. âThe SDK hides the perception of complexity that every engineer or researcher may have when testing or exploring a new technology⌠Think about engineers that have been working for a couple of decades on processing images that now see events⌠they donât want to be stretched too much out of their comfort zone.â
New to the Metavision SDK is a simulator to convert full frames into events to help designers transition between the way they work today and the event domain. Noting a reluctance of some designers to move away from full frames, Verre said the simulator is intended to show them thereâs nothing magic about events.
â[Events are] just a way of capturing information from the scene that contains much more temporal precision compared to images, and is actually much more relevant, because typically you get only what is changing,â he said.
The simulator can also reconstruct image full frames from event data, which he says people find reassuring.
âThe majority of customers donât pose this challenge any longer because they understand that they need to see from a different perspective, similar to when they use technology like time of flight or ultrasound,â he said. âThe challenge is when their perception is that this is another image sensor⌠for this category of customer, we made this tool that can show them the way to transition stepwise to this new sensing modality⌠it is a mindset shift that may take some time, but it will come.â
Applications realized in the Prophesee developer communityinclude restoring some sight for the blind, detecting and classifying contaminants in medical samples, particle tracking in research, robotic touch sensors, and tracking space debris.
HARDWARE ROADMAP
In terms of roadmap, Prophesee plans to continue development of both hardware and software, alongside new evaluation kits, development kits, and reference designs. This may include system reference designs which combine Prohpesee sensors with specially developed processors. For example, Prohpesee partner iCatch has developed an AI vision processor SoC that interfaces natively with the IMX 636 and features an onâchip event decoder. Japanese AI core provider DMP is also working with Prophesee on an FPGAâbased system, and there are more partnerships in the works, said Verre.
âWe see that there is growing interest from ecosystem partners at the SoC level, but also the software level, that are interested in building new solutions based on Prophesee technology,â he said. âThis type of asset is important for the community, because it is another step towards the full solution â they can get the sensor, camera, computing platform, and software to develop an entire solution.â
Where does eventâbased sensor hardware go from here? Verre cited two key directions the technology will move in. The first is further reduction of pixel size (pixel pitch) and overall reduction of the sensor to make it suitable for compact consumer applications such as wearables. The second is facilitating the integration of eventâbased sensing with conventional SoC platforms.
Working with computing companies will be critically important to ensure nextâgeneration sensors natively embed the capability to interface with the computing platform, which simplifies the task at the system level. The result will be smarter sensors, with added intelligence at the sensor level.
âWe think events make sense, so letâs do more pre-processing inside the sensor itself, because itâs where you can make the least compromise,â Verre said. âThe closer you get to the acquisition of the information, the better off you are in terms of efficiency and low latency. You also avoid the need to encode and transmit the data. So this is something that we are pursuing.â
As foundries continue to make progress in the 3D stacking process, stacking in two or even three layers using the most advanced CMOS processes can help bring more intelligence down to the pixel level.
How much intelligence in the pixel is the right amount?
Verre said itâs a compromise between increasing the cost of silicon and having sufficient intelligence to make sure the interface with conventional computing platforms is good enough.
âSensors donât typically use advanced process nodes, 28nm or 22nm at most,â he said. âMainstream SoCs use 12nm, 7nm, 5nm, and below, so theyâre on technology nodes that can compress the digital component extremely well. The size versus cost equation means at a certain point itâs more efficient, more economical [to put the intelligence] in the SoC.â
There is also a certain synergy to combining eventâbased sensors with neuromorphic computing architectures.
âThe ultimate goal of neuromorphic technology is to have both the sensing and processing neuromorphic or eventâbased, but we are not yet there in terms of maturity of this type of solution,â he said. âWe are very active in this area to prepare for the future â we are working with Intel, SynSense, and other partners in this area â but in the short term, the mainstream market is occupied by conventional SoC platforms.
Propheseeâs approach here is pragmatic. Verre said the companyâs aim is to try to minimize any compromises to deliver benefits that are superior to conventional solutions.
âUltimately we believe that events should naturally stream asynchronously to a compute architecture that is also asynchronous in order to benefit fully in terms of latency and power,â he said. âBut we need to be pragmatic and stage this evolution, and really capitalize on the existing platforms out there and work with key partners in this space that are willing to invest in softwareâhardware developments and to optimize certain solution for certain markets.â
Certainly get the felling this is going to be a tough tug of war to get to $1.20 let alone past it.
im hoping the video will be from the front , as to see "his/her bush block"...............
Gee, I wouldn't have a clue.
Luca Verre (Source: Prophesee)
Propheseeâs and Sonyâs jointly developed IMX 6363 event-based sensor (Source: Prophesee)
Propheseeâs EV4 evaluation kit (Source: Prophesee)
Prophesee and Sony IMX 636 is a fourth-generation product. Prophesee said future generations will reduce pixel pitch and ease integration with conventional computing platforms (Source: Prophesee)
Well can it? Arenât you the expert? 
