Sony Semiconductor Solutions Group develops device business which includes Micro display, LSIs, and Semiconductor Laser, in focusing on Image Sensor.
www.sony-semicon.com
April 24, 2024
Edge AI-Driven Vision Detection Solution Introduced at 500 Convenience Store Locations to Measure Advertising Effectiveness
Sony Semiconductor Solutions Corporation
Atsugi, Japan, April 24, 2024 —
Today, Sony Semiconductor Solutions Corporation (SSS) announced that it has introduced and begun operating an edge AI-driven vision detection solution at 500 convenience store locations in Japan to improve the benefits of in-store advertising.
Edge AI technology automatically detects the number of digital signage viewers and how long they viewed it.
SSS has been providing 7-Eleven and other retail outlets in Japan with vision-based technology to improve the implementation of digital signage systems and in-store advertising at their brick-and-mortar locations as part of their retail media*1 strategy. To help ensure that effective content is shown for brands and stores, this solution gives partners sophisticated tools to evaluate the effectiveness of advertising on their customers.
As part of this effort,
SSS has recently introduced a solution that uses edge devices with on-sensor AI processing to automatically detect when customers see digital signage, count how many people paused to view it, and measure the percentage of viewers. The AI capabilities of the sensor collects data points such as the number of shoppers who enter the detection area, whether they saw the signage, the number who stopped to view the signage, and how long they watched for. The system does not output image data capable of identifying individuals, making it possible to provide insightful measurements while helping to preserve privacy.
Click
here for an overview video of the solution and interview with 7-Eleven Japan.
Solution features:
-IMX500 intelligent vision sensor delivers optimal data collection, while helping to preserve privacy.
SSS’s IMX500 intelligent vision sensor with AI-processing capabilities automatically detects the number of customers who enter the detection area, the number who stopped to view the signage, and how long they viewed it. The acquired metadata (semantic information) is then sent to a back-end system where it’s combined with content streaming information and purchasing data to conduct a sophisticated analysis of advertising effectiveness. Because the system does not output image data that could be used to identify individuals, it helps to preserve customer privacy.
-Edge devices equipped with the IMX500 save space in store.
The IMX500 is made using SSS’s proprietary structure with the pixel chip and logic chip stacked, enabling the entire process, from imaging to AI inference, to be done on a single sensor. Compact, IMX500-equipped edge devices (approx. 55 x 40 x 35 mm) are unobtrusive in shops, and compared to other solutions that require an AI box or other additional devices for AI inference, can be installed more flexibly in convenience stores and shops with limited space.
-The AITRIOS™ platform contributes to operational stability and system expandability.
Only light metadata is output from IMX500 edge devices, minimizing the amount of data transmitted to the cloud. This helps lessen network load, even when adding more devices in multiple stores, compared to solutions that send full image data to the cloud. This curtails communication, cloud storage, and computing costs.
The IMX500 also handles AI computing, eliminating the need for other devices such as an AI box, resulting in a simple device configuration, streamlining device maintenance and reducing costs of installation.
AITRIOS*2, SSS’s edge AI sensing platform, which is used to build and operate the in-store solution, delivers a complete service without the need for third-party tools, enabling simple, sustainable operations.
This solution was developed with Console Enterprise Edition, one of the services offered by AITRIOS, and is installed on the partner’s Microsoft Azure cloud infrastructure. It not only connects easily and compatibly with their existing systems, but also offers system customizability and security benefits, since there is no need to output various data outside the company.
*1 A new form of advertising media that provides advertising space for retailers and e-commerce sites using their own platforms
*2 AITRIOS is an AI sensing platform for streamlined device management, AI development, and operation. It offers the development environment, tools, features, etc., which are necessary for deploying AI-driven solutions, and it contributes to shorter roll-out times when launching operations, while ensuring privacy, reducing introductory cost, and minimizing complications. For more information on AITRIOS, visit: https://www.aitrios.sony-semicon.com/en
About Sony Semiconductor Solutions Corporation
Sony Semiconductor Solutions Corporation is a wholly owned subsidiary of Sony Group Corporation and the global leader in image sensors. It operates in the semiconductor business, which includes image sensors and other products. The company strives to provide advanced imaging technologies that bring greater convenience and fun. In addition, it also works to develop and bring to market new kinds of sensing technologies with the aim of offering various solutions that will take the visual and recognition capabilities of both human and machines to greater heights. For more information, please visit
https://www.sony-semicon.com/en/index.html.
AITRIOS and AITRIOS logos are the registered trademarks or trademarks of Sony Group Corporation or its affiliated companies.
Microsoft and Azure are registered trademarks of Microsoft Corporation in the United States and other countries.
All other company and product names herein are trademarks or registered trademarks of their respective owners.
Here is some wild speculation: Could this
possibly be a candidate for the mysterious Custom Customer SoC, featured in the recent Investor Roadshow presentation (provided the licensing of Akida IP was done via MegaChips)?
Post in thread 'AITRIOS'
https://thestockexchange.com.au/threads/aitrios.18971/post-31633
View attachment 63835
Visit us at Booth 1947B, where we will be showcasing
exciting demos, including our Temporal Event-based Neural Networks (TENNs) and the Raspberry Pi 5 with Face and Edge Learning. Don’t miss the opportunity to connect and learn more about our innovative solutions.
The sold-out Raspberry Pi Akida Dev Kit was based on a Raspberry 4…
View attachment 69849
Raspberry Pi offers an AI Kit with a Hailo AI acceleration module containing an NPU for use with the Raspberry Pi 5.
View attachment 69850
Maybe there has been something similar in the works for our company?
Could the mysterious Akida Pico have anything to do with the Raspberry Pi Pico series of microcontrollers?
Could Akida by any chance be the integrated AI accelerator used in the newly launched Raspberry Pi AI Camera, jointly developed by Raspberry Pi and Sony Semiconductor Solutions (SSS)? (For the sake of completeness, I should, however, add that while Sony’s IMX500 Camera Module is being promoted as having on-chip AI image processing, there is no specific mention of this involving neuromorphic technology.)
I am afraid I can’t answer the legitimate question regarding potential revenue, though. It is a fact that Sony Semiconductor Solutions has not signed a license with us, so it would have to be a license through either Megachips or Renesas (both of which also happen to be Japanese companies).
I guess - as usual - we will have to resort to watching the financials, unless we find out sooner one way or the other…
So here goes my train of thought: Yesterday (Sept 30) was the Raspberry Pi AI Camera’s official launch - coincidentally (or not?), this happened to be the day when the BRN share price soared without any official news as a catalyst… Could there have been some kind of leak, though?
Also, BrainChip has promised “
exciting demos, including our Temporal Event-based Neural Networks (TENNs) and the Raspberry Pi 5 with Face and Edge Learning” for the Embedded World North America, taking place from
October 8-10, 2024, at the Convention Center in Austin, TX.
The now sold-out Akida Raspberry Pi Dev Kit was based on the Raspberry Pi 4, so they won’t be using one of those for the announced Raspberry Pi 5 demo. Since we are nowadays primarily an IP company, would manufacturing and releasing a new Akida Dev Kit based on a Raspberry Pi 5 make sense? Not really. How about demonstrating an affordable AI camera using Akida technology manufactured by someone else (the mysterious Custom Customer SoC?)…
The Raspberry Pi AI Kit that came out in June and uses a Hailo AI acceleration module will only work with a Raspberry Pi 5 (introduced in October 2023), whereas the new Raspberry Pi AI Camera will work with
all Raspberry Pi models. So while it may perform best on the latest Raspberry Pi 5, it will still be useful for developers with older RPI models as well.
Maybe one of the resident TSE techies will be able to tell us right away that this is a dead end or a pie in the sky, but until then I’ll keep my fingers crossed…
Sony Semiconductor Solutions Group develops device business which includes Micro display, LSIs, and Semiconductor Laser, in focusing on Image Sensor.
www.sony-semicon.com
Sony Semiconductor Solutions and Raspberry Pi Launch the Raspberry Pi AI Camera
Accelerating the development of edge AI solutions
Sony Semiconductor Solutions Corporation
Raspberry Pi Ltd.
Atsugi, Japan and Cambridge, UK —
Sony Semiconductor Solutions Corporation (SSS) and Raspberry Pi Ltd today announced that they are launching a jointly developed AI camera. The Raspberry Pi AI Camera, which is compatible with Raspberry Pi’s range of single-board computers, will accelerate the development of AI solutions which process visual data at the edge. Starting from September 30, the product will be available for purchase from Raspberry Pi’s network of Approved Resellers, for a suggested retail price of $70.00*.
* Not including any applicable local taxes.
In April 2023, it was announced that SSS would make a minority investment in Raspberry Pi Ltd. Since then, the companies have been working to develop an edge AI platform for the community of Raspberry Pi developers, based on SSS technology.
The AI Camera is powered by SSS’s IMX500 intelligent vision sensor, which is capable of on-chip AI image processing, and enables Raspberry Pi users around the world to easily and efficiently develop edge AI solutions that process visual data.
- AI camera features
- Because vision data is normally massive, using it to develop AI solutions can require a graphics processing unit (GPU), an accelerator, and a variety of other components in addition to a camera. The new Raspberry Pi AI Camera, however, is equipped with the IMX500 intelligent vision sensor which handles AI processing, making it easy to develop edge AI solutions with just a Raspberry Pi and the AI Camera.
- The new AI Camera is compatible with all Raspberry Pi single-board computers, including the latest Raspberry Pi 5. This enables users to develop solutions with familiar hardware and software, taking advantage of the widely used and powerful libcamera and Picamera2 software libraries.
“SSS and Raspberry Pi Ltd aim to provide Raspberry Pi users and the development community with a unique development experience,” said Eita Yanagisawa, General Manager, System Solutions Division, Sony Semiconductor Solutions Corporation. “I’m very excited to share SSS edge AI sensing technology with the world’s largest development community as the first fruits of our strategic partnership. We look forward to further collaboration with Raspberry Pi using our AITRIOS™ edge AI solution development and operations platform. We aim to make the most of AI cameras equipped with our image sensors in our collaborative efforts with Raspberry Pi.”
“AI-based image processing is becoming an attractive tool for developers around the world,” said Eben Upton, CEO, Raspberry Pi Ltd. “Together with our longstanding image sensor partner Sony Semiconductor Solutions, we have developed the Raspberry Pi AI Camera, incorporating Sony’s image sensor expertise. We look forward to seeing what our community members are able to achieve using the power of the Raspberry Pi AI Camera.”
Specifications
Sensor model: SSS's approx. 12.3 effective megapixel IMX500 intelligent vision sensor with a powerful neural network accelerator
Sensor modes: 4,056(H) x 3,040(V) at 10 fps / 2,028(H) x 1,520(V) at 40 fps
Unit cell size: 1.55 µm x 1.55 µm
76 degree FoV with manual/mechanical adjustable focus
Integrated RP2040 for neural network firmware management
Works with all Raspberry Pi models using only Raspberry Pi standard camera connector cable
Pre-loaded with MobileNetSSD model
Fully integrated with libcamera
About Sony Semiconductor Solutions Corporation
Sony Semiconductor Solutions Corporation is a wholly owned subsidiary of Sony Group Corporation and the global leader in image sensors. It operates in the semiconductor business, which includes image sensors and other products. The company strives to provide advanced imaging technologies that bring greater convenience and fun. In addition, it also works to develop and bring to market new kinds of sensing technologies with the aim of offering various solutions that will take the visual and recognition capabilities of both human and machines to greater heights.
For more information, please visit
https://www.sony-semicon.com/en/index.html.
About Raspberry Pi Ltd
Raspberry Pi is on a mission to put high-performance, low-cost, general-purpose computing platforms in the hands of enthusiasts and engineers all over the world. Since 2012, we’ve been designing single-board and modular computers, built on the Arm architecture, and running the Linux operating system. Whether you’re an educator looking to excite the next generation of computer scientists; an enthusiast searching for inspiration for your next project; or an OEM who needs a proven rock-solid foundation for your next generation of smart products, there’s a Raspberry Pi computer for you.
Note: AITRIOS is the registered trademark or trademark of Sony Group Corporation or its affiliates.
just my opinion
: BrainChip)
: BrainChip)
