wilzy123
Founding Member
What on earth is that LMAO
Ahh it's probably just "Bye Bye Birdie"..
Hey sorry, I really do apologise, it's just sometimes hard to tell, you know..Ouch, that hurt. I can assure you that it’s not.
Ambarella Showcases N1 SoC Series at CES, Enhancing Edge AI with Efficient LLMs
SANTA CLARA, Calif., Jan. 8, 2024 — Ambarella, Inc., an edge AI semiconductor company, today announced during CES that it is demonstrating multi-modal large language models (LLMs) running on its new N1 SoC series at a fraction of the power-per-inference of leading GPU solutions.
Ambarella aims to bring generative AI—a transformative technology that first appeared in servers due to the large processing power required—to edge endpoint devices and on-premise hardware, across a wide range of applications such as video security analysis, robotics and a multitude of industrial applications.
Ambarella will initially be offering optimized generative AI processing capabilities on its mid to high-end SoCs, from the existing CV72 for on-device performance under 5W, through to the new N1 series for server-grade performance under 50W. Compared to GPUs and other AI accelerators, Ambarella provides complete SoC solutions that are up to 3x more power-efficient per generated token, while enabling immediate and cost-effective deployment in products.
“Generative AI networks are enabling new functions across our target application markets that were just not possible before,” said Les Kohn, CTO and co-founder of Ambarella. “All edge devices are about to get a lot smarter, with our N1 series of SoCs enabling world-class multi-modal LLM processing in a very attractive power/price envelope.”
“Virtually every edge application will get enhanced by generative AI in the next 18 months,” said Alexander Harrowell, Principal Analyst, Advanced Computing at Omdia. “When moving genAI workloads to the edge, the game becomes all about performance per watt and integration with the rest of the edge ecosystem, not just raw throughput.”
All of Ambarella’s AI SoCs are supported by the company’s new Cooper Developer Platform. Additionally, in order to reduce customers’ time-to-market, Ambarella has pre-ported and optimized popular LLMs, such as Llama-2, as well as the Large Language and Video Assistant (LLava) model running on N1 for multi-modal vision analysis of up to 32 camera sources. These pre-trained and fine-tuned models will be available for partners to download from the Cooper Model Garden.
For many real-world applications, visual input is a key modality, in addition to language, and Ambarella’s SoC architecture is natively well-suited to process video and AI simultaneously at very low power. Providing a full-function SoC enables the highly efficient processing of multi-modal LLMs while still performing all system functions, unlike a standalone AI accelerator.
Generative AI will be a step function for computer vision processing that brings context and scene understanding to a variety of devices, from security installations and autonomous robots to industrial applications. Examples of the on-device LLM and multi-modal processing enabled by this new Ambarella offering include: smart contextual searches of security footage; robots that can be controlled with natural language commands; and different AI helpers that can perform anything from code generation to text and image generation.
Most of these systems rely heavily on both camera and natural language understanding, and will benefit from on-device generative AI processing for speed and privacy, as well as a lower total cost of ownership. The local processing enabled by Ambarella’s solutions also perfectly suits application-specific LLMs, which are typically fine-tuned on the edge for each individual scenario; versus the classical server approach of using bigger and more power-hungry LLMs to cater to every use case.
Based on Ambarella’s powerful CV3-HD architecture, initially developed for autonomous driving applications, the N1 series of SoCs repurposes all this performance for running multi-modal LLMs in an extremely low power footprint. For example, the N1 SoC runs Llama2-13B with up to 25 output tokens per second in single-streaming mode at under 50W of power. Combined with the ease-of-integration of pre-ported models, this new solution can quickly help OEMs deploy generative AI into any power-sensitive application, from an on-premise AI box to a delivery robot.
Both the N1 SoC and a demonstration of its multi-modal LLM capabilities will be on display this week at the Ambarella exhibition during CES.
About Ambarella
Ambarella’s products are used in a wide variety of human vision and edge AI applications, including video security, advanced driver assistance systems (ADAS), electronic mirror, drive recorder, driver/cabin monitoring, autonomous driving and robotics applications. Ambarella’s low-power systems-on-chip (SoCs) offer high-resolution video compression, advanced image and radar processing, and powerful deep neural network processing to enable intelligent perception, fusion and planning. For more information, please visit ambarella.com.
Hi Space Cadet,@Bravo, are you in the car or are you sitting on the windscreen? Hard to tell. If it's on the windscreen don't scratch the paintwork when you get off!
SC
Rob Telson likes this, but Pat Benatar likes this even more!
No way
Rob Telson likes this, but Pat Benatar likes this even more!
Hey Wilzy, please don't take this the wrong way but AI, not even neuromorphic AI, will help your self-hatred. It will only encourage it.
Take care!
Iseki
Magnificient. Your either really talented or have too much time on your hands (paws). Love it.Hi Space Cadet,
I'm actually with my mate Willy in the front seat of the car and we're pumping out some tunes together on the new sound system. Willy just asked me if I want to record a song with him about the losers on the Crapper. He reckons it's totally vibing and going to go nuts when it's realised! Here's a bit of a teaser on the hip-hop style beats we've been working on.
Yo, don't step into The Crapper, where it's full of chatter,
TomandJerry and Deadrise, the main clatter,
Critiquing BrainChip, like they're the brain master,
But we know their game is a disaster.
Always down-ramping achievements, spreading discontent,
They jump on TSEx, with aliases, a failed attempt,
Mt09 and FabricatedLunacy, trying to deceive,
But TSEx members are sharp, we won't be naive.
In The Crapper, they talk, trying to bring us down,
But we stand tall, we won't let them wear the crown,
BrainChip rising, achievements profound,
No room for dum-dums, in this TSEx forum town.
TSEx ain't fooled, by your sneaky moves,
Mt09 and FabricatedLunacy, with your fake grooves,
We see through the masquerade, the charade,
In this game of wits, we won't be played.
In The Crapper, they talk, trying to bring us down,
But we stand tall, we won't let them wear the crown,
BrainChip rising, achievements profound,
No room for ding-dongs, in this forum town.
We're building bridges, not walls,
BrainChip's success, as the market calls,
TSEx united, we stand strong,
Against the critics, proving them wrong.
TomandJerry, Deadrise, take a jump,
Your negativity won't define our bump,
BrainChip innovating, reaching the pump,
While you're stuck in The Crapper taking a dump.
BRN not mentioned but good read anyhow!![]()
BRN Discussion Ongoing
Missing Akida, missing post. What does big FORUM not want us to see?? hahathestockexchange.com.au
Another added to the list. UbiquitousThis takes us to 55 known relationships.
The unknown for ease of calculation could be described as 100s minus 4 companies.
My opinion only DYOR
Fact Finder
Hi taproot,An article from 2019
Blog | onsemi
Insights and trends in the semiconductor industry, featuring technology advancements, expert viewpoints and innovative solutions from onsemi.www.onsemi.com
In the event that an accident should happen, the same camera can detect the size, weight and position of the driver and adjust the airbag deployment accordingly, reducing the risk of injury.
![]()
BrainChip’s All Things AI Podcast Live from CES with Radhika Arora
Get ready for our exciting live third edition of BrainChip’s “All Things AI” podcast coming to you from the heart of CES!brainchip.com
Confirmed today that Onsemi and BrainChip are working together on BrainChip's Time of Flight technology on how to smartly deploy airbags.
Radhika Arora ( Senior Director of Product Management at Onsemi ) and Nandan Nayampally also confirm that there will be a demonstration of TOF that proves out this use case.