Renesas + Arduino

[uiux]

Renesas invests $10M in Arduino - Electronic Products & Technology

Aim is to leverage popular open-source firm to tap developer community

www.ept.ca

Renesas invests $10M in Arduino

The partnership with Arduino enables Renesas to make its broad range of products available for Arduino’s technology platforms used by its worldwide developer community.

The funding will also provide Arduino with access to a new level of technology with Renesas’ industry-leading technology portfolio, including MCUs/MPUs, analog, power, and connectivity products.

---

ARM battles RISC-V at Renesas

Dr. Sailesh Chittipeddi, Executive Vice President and General Manager of IoT and Infrastructure Business Unit of Renesas Electronics talks to eeNews Europe

www.eenewseurope.com

Sailesh “So that’s kind of the plan that we have, to evolve that into that landscape,” he said. “At the very low end, we have added an ARM M33 MCU and spiking neural network with BrainChip core licensed for selected applications – we have licensed what we need to license from BrainChip including the software to get the ball rolling.”

-

The Arduino deal is also key he says.

“We have formed a strategic partnership with Arduino as they have this base of 30m users and by working with them we think we have a good opportunity for MCUs, sensors, power and connectivity,” he said. “I think Arduino will move into a broader application space by working with an outfit such as us with our base of industrial customers and they have their roadmaps to expand so we have an opportunity to work with them. Even if its hobbyist it’s a pathway to get university students hooked on Arduino today and they will be the engineers tomorrow making the buying decisions.


---

Here is an example arduino compatible Renesas product:

https://au.element14.com/renesas/rtk7fpa4e1s00001be/eval-board-32bit-arm-cortex-m33/dp/3780857

Price:	$26.37

Manufacturer:	RENESAS

Core Sub-Architecture:	Cortex-M33

• Arduino Uno and Pmod™ interfaces come standard

---

Perhaps we are starting to see a narrative thread forming?

 

[thelittleshort]

Hi @uiux

I stumbled across this LinkedIn post, which relates to Arduino

I am not technical at all, but the wording seems like it would not be out of place on the BrainChip website - unless I am misinterpreting it

Happy to be proved wrong (cue ogre from @Diogenese) Even happier though if Arduino were already covertly dabbling with Akida and now Renesas are injecting funding to help (I’m not saying this is the reality)

The technology is credited to the Fraunhofer Institute for Microelectronic Circuits and Systems (IMS)

I have attached the AIfES (Artificial Intelligence for Embedded Systems) blog link from Arduino and pasted it below

Even the fruit video looks familiar

AIfES is an AI/ML framework for Arduino and Small Microcontrollers

AIfES is a standalone AI framework that allows on-device training without a PC and works on almost any hardware. Even the 8-bit Arduino Uno.

blog.arduino.cc

AIfES is an AI/ML framework written in C for even the smallest microcontrollers​

ARDUINO TEAM — July 6th, 2021

In the last few years there have been more and more solutions for running machine learning (ML) on microcontrollers. Some of the most popular are scaled down versions of frameworks designed for servers. But those are only suitable for fairly powerful MCUs.

This is now a thing of the past. With the open-source solution AIfES (Artificial Intelligence for Embedded Systems) from the Fraunhofer Institute for Microelectronic Circuits and Systems (IMS) it’s possible to run, and even train, artificial neural networks (ANN) on almost any hardware, including the 8-bit Arduino Uno.

Note: The Fraunhofer IMS is part of the Fraunhofer Society, which currently operates more than 80 research facilities, including 75 institutes, at over 40 locations all over Germany.

Arduino AI Framework Library Is Here​

AIfES is a standalone AI framework completely written in C. It allows on-device training without the need for a PC and can be used on almost any hardware. Even on the 8-bit controller of the Arduino Uno, an ANN can be trained pretty quickly. Personal, customized devices can be created that adapt to the task at hand by way of training. AIfES , with Arduino’s support, is now available for the Arduino IDE using the Arduino Library Manager.

This technology allows the development of small, self-learning, battery-powered devices that can be independent of a cloud or another device. Sensor data can be processed where it’s generated, directly on the device. Training data can be recorded by the device and used for training.

AIfES is comparable and compatible with well-known Python ML frameworks. This includes TensorFlow, Keras or PyTorch, while being significantly reduced in functionality. In the current version, feedforward neural networks (FNN) are supported, which can be configured completely freely. Also, common activation functions like ReLU, sigmoid or softmax are already integrated. A full implementation of Convolutional Neural Networks (ConvNet) will follow soon.

The model development is also based on the Python frameworks, so you can find your way around directly. The common algorithms for training, such as the gradient descent optimizer (SGD) or the adam optimizer, are also included.

Import ANNs From Other ML Frameworks​

It’s possible to import a previously trained ANN from another ML framework. Only the network structure and weights are needed to map an ANN and train it further. A Keras example is included in the library, and it’s not necessary to port the model to TensorFlow Lite. The weights of an ANN in AIfES can also be read out, saved or sent directly from the device to be used on another device. Different ANNs can be loaded at runtime by reconfiguring the model and loading new weights. The weight sets can be stored in the cloud to make them available to other devices. The applications are endless.
All algorithms are optimized for use on resource-limited embedded systems. Even the required memory area for the ANN can be specified by the developer.

AIfES has been developed in a modular way to be able to exchange different components of the algorithms. A matrix multiplication, for instance. This allows the easy use of hardware accelerators of the different processor families. For example, the CMSIS DSP properties of the ARM Cortex controllers can already be used to compute or train deep neural networks particularly efficiently.

The Fraunhofer IMS has been using AIfES in AI research and development for years. Internally it’s been used as a development tool for customer-specific AI solutions until a level of development was reached where it could be used as a stand-alone product.
Interesting demonstrators have been created in that time. It’s been part of many public projects, and has already been integrated into future products together with companies from across the industry. As demos, an extremely compact handwriting recognition system was realized on an Arduino Uno. There’s a wireless current sensor for condition monitoring, and a gesture recognition system.

Pre-Trained and Adaptable AIfES Gesture Recognition​

In gesture recognition, the model was pre-trained and the user performs the gestures as the developer trained them. This is the conventional way, but not very intuitive and the user has to adapt to the hardware. Thenew demonstrator uses the Arduino Nano 33 BLE Sense, which adapts to the user instead.

The desired gestures can be trained directly in the system without the need for a PC. A first example of product development within industry is the project “noKat.” A neural optical camera tracker for the detection of approaching persons, where a particularly compact human recognition system was realized using AIfES.

Due to their size, deep neural networks (DNN) are problematic for the implementation on a microcontroller. For this reason, Fraunhofer IMS has been researching techniques to realize particularly compact ML solutions for years. Using special feature extraction techniques the number of inputs can be reduced significantly, so only the relevant features are used.

AIfES is offered as a dual license model. For private projects or developers of free open-source software under the GNU General Public License (GPL) version 3, AIfES can be used free of charge. If AIfES is to be combined and distributed with commercially licensed software, or if the AIfES source code for commercially licensed software is not to be distributed under the GNU GPL V3, a commercial license agreement must be concluded with the Fraunhofer IMS. If you’re interested, contact the AIfES team.

AIfES for Arduino includes examples that get you started right away. Besides inference and training, it also shows how to import an ANN from Keras. The Arduino fruit identificationproject has been re-implemented in AIfES for the Nano 33 BLE Sense. Now the colors of three objects are trained directly on the device, without the need for a PC.

Download AIfES directly from the Arduino library manager or check out the AIfES for Arduino GitHub repository.
We’re super excited about this technology at Arduino, and we can’t wait to see what the community is going to build with it! Make sure you let us know your thoughts, and about any applications you create, over on the forums.

 

[Fact Finder]

Hi @uiux

I stumbled across this LinkedIn post, which relates to Arduino

I am not technical at all, but the wording seems like it would not be out of place on the BrainChip website - unless I am misinterpreting it

Happy to be proved wrong (cue ogre from @Diogenese) Even happier though if Arduino were already covertly dabbling with Akida and now Renesas are injecting funding to help (I’m not saying this is the reality)

The technology is credited to the Fraunhofer Institute for Microelectronic Circuits and Systems (IMS)

I have attached the AIfES (Artificial Intelligence for Embedded Systems) blog link from Arduino and pasted it below

Even the fruit video looks familiar


View attachment 9604

AIfES is an AI/ML framework for Arduino and Small Microcontrollers

AIfES is a standalone AI framework that allows on-device training without a PC and works on almost any hardware. Even the 8-bit Arduino Uno.

blog.arduino.cc

AIfES is an AI/ML framework written in C for even the smallest microcontrollers​

ARDUINO TEAM — July 6th, 2021

In the last few years there have been more and more solutions for running machine learning (ML) on microcontrollers. Some of the most popular are scaled down versions of frameworks designed for servers. But those are only suitable for fairly powerful MCUs.

This is now a thing of the past. With the open-source solution AIfES (Artificial Intelligence for Embedded Systems) from the Fraunhofer Institute for Microelectronic Circuits and Systems (IMS) it’s possible to run, and even train, artificial neural networks (ANN) on almost any hardware, including the 8-bit Arduino Uno.

Note: The Fraunhofer IMS is part of the Fraunhofer Society, which currently operates more than 80 research facilities, including 75 institutes, at over 40 locations all over Germany.

Arduino AI Framework Library Is Here​

AIfES is a standalone AI framework completely written in C. It allows on-device training without the need for a PC and can be used on almost any hardware. Even on the 8-bit controller of the Arduino Uno, an ANN can be trained pretty quickly. Personal, customized devices can be created that adapt to the task at hand by way of training. AIfES , with Arduino’s support, is now available for the Arduino IDE using the Arduino Library Manager.

This technology allows the development of small, self-learning, battery-powered devices that can be independent of a cloud or another device. Sensor data can be processed where it’s generated, directly on the device. Training data can be recorded by the device and used for training.

AIfES is comparable and compatible with well-known Python ML frameworks. This includes TensorFlow, Keras or PyTorch, while being significantly reduced in functionality. In the current version, feedforward neural networks (FNN) are supported, which can be configured completely freely. Also, common activation functions like ReLU, sigmoid or softmax are already integrated. A full implementation of Convolutional Neural Networks (ConvNet) will follow soon.

The model development is also based on the Python frameworks, so you can find your way around directly. The common algorithms for training, such as the gradient descent optimizer (SGD) or the adam optimizer, are also included.

Import ANNs From Other ML Frameworks​

It’s possible to import a previously trained ANN from another ML framework. Only the network structure and weights are needed to map an ANN and train it further. A Keras example is included in the library, and it’s not necessary to port the model to TensorFlow Lite. The weights of an ANN in AIfES can also be read out, saved or sent directly from the device to be used on another device. Different ANNs can be loaded at runtime by reconfiguring the model and loading new weights. The weight sets can be stored in the cloud to make them available to other devices. The applications are endless.
All algorithms are optimized for use on resource-limited embedded systems. Even the required memory area for the ANN can be specified by the developer.

AIfES has been developed in a modular way to be able to exchange different components of the algorithms. A matrix multiplication, for instance. This allows the easy use of hardware accelerators of the different processor families. For example, the CMSIS DSP properties of the ARM Cortex controllers can already be used to compute or train deep neural networks particularly efficiently.

The Fraunhofer IMS has been using AIfES in AI research and development for years. Internally it’s been used as a development tool for customer-specific AI solutions until a level of development was reached where it could be used as a stand-alone product.
Interesting demonstrators have been created in that time. It’s been part of many public projects, and has already been integrated into future products together with companies from across the industry. As demos, an extremely compact handwriting recognition system was realized on an Arduino Uno. There’s a wireless current sensor for condition monitoring, and a gesture recognition system.

Pre-Trained and Adaptable AIfES Gesture Recognition​

In gesture recognition, the model was pre-trained and the user performs the gestures as the developer trained them. This is the conventional way, but not very intuitive and the user has to adapt to the hardware. Thenew demonstrator uses the Arduino Nano 33 BLE Sense, which adapts to the user instead.

The desired gestures can be trained directly in the system without the need for a PC. A first example of product development within industry is the project “noKat.” A neural optical camera tracker for the detection of approaching persons, where a particularly compact human recognition system was realized using AIfES.

Due to their size, deep neural networks (DNN) are problematic for the implementation on a microcontroller. For this reason, Fraunhofer IMS has been researching techniques to realize particularly compact ML solutions for years. Using special feature extraction techniques the number of inputs can be reduced significantly, so only the relevant features are used.

AIfES is offered as a dual license model. For private projects or developers of free open-source software under the GNU General Public License (GPL) version 3, AIfES can be used free of charge. If AIfES is to be combined and distributed with commercially licensed software, or if the AIfES source code for commercially licensed software is not to be distributed under the GNU GPL V3, a commercial license agreement must be concluded with the Fraunhofer IMS. If you’re interested, contact the AIfES team.

AIfES for Arduino includes examples that get you started right away. Besides inference and training, it also shows how to import an ANN from Keras. The Arduino fruit identificationproject has been re-implemented in AIfES for the Nano 33 BLE Sense. Now the colors of three objects are trained directly on the device, without the need for a PC.

Download AIfES directly from the Arduino library manager or check out the AIfES for Arduino GitHub repository.
We’re super excited about this technology at Arduino, and we can’t wait to see what the community is going to build with it! Make sure you let us know your thoughts, and about any applications you create, over on the forums.

Straight off can say definitely not AKIDA. It is using 8 bit activations. It is ANN CNN and it does not have one shot and incremental learning it has training. It is going to use much more power than AKIDA as it does not do SNN or CNN2SNN conversion.

My opinion only DYOR
FF

AKIDA BALLISTA

 

[thelittleshort]

Straight off can say definitely not AKIDA. It is using 8 bit activations. It is ANN CNN and it does not have one shot and incremental learning it has training. It is going to use much more power than AKIDA as it does not do SNN or CNN2SNN conversion.

My opinion only DYOR
FF

AKIDA BALLISTA

Thanks @Fact Finder. Like I said I’m not technically literate, but would rather throw it out there just in case

 

[Stable Genius]

Hi @uiux

I stumbled across this LinkedIn post, which relates to Arduino

I am not technical at all, but the wording seems like it would not be out of place on the BrainChip website - unless I am misinterpreting it

Happy to be proved wrong (cue ogre from @Diogenese) Even happier though if Arduino were already covertly dabbling with Akida and now Renesas are injecting funding to help (I’m not saying this is the reality)

The technology is credited to the Fraunhofer Institute for Microelectronic Circuits and Systems (IMS)

I have attached the AIfES (Artificial Intelligence for Embedded Systems) blog link from Arduino and pasted it below

Even the fruit video looks familiar


View attachment 9604

AIfES is an AI/ML framework for Arduino and Small Microcontrollers

AIfES is a standalone AI framework that allows on-device training without a PC and works on almost any hardware. Even the 8-bit Arduino Uno.

blog.arduino.cc

AIfES is an AI/ML framework written in C for even the smallest microcontrollers​

ARDUINO TEAM — July 6th, 2021

In the last few years there have been more and more solutions for running machine learning (ML) on microcontrollers. Some of the most popular are scaled down versions of frameworks designed for servers. But those are only suitable for fairly powerful MCUs.

This is now a thing of the past. With the open-source solution AIfES (Artificial Intelligence for Embedded Systems) from the Fraunhofer Institute for Microelectronic Circuits and Systems (IMS) it’s possible to run, and even train, artificial neural networks (ANN) on almost any hardware, including the 8-bit Arduino Uno.

Note: The Fraunhofer IMS is part of the Fraunhofer Society, which currently operates more than 80 research facilities, including 75 institutes, at over 40 locations all over Germany.

Arduino AI Framework Library Is Here​

AIfES is a standalone AI framework completely written in C. It allows on-device training without the need for a PC and can be used on almost any hardware. Even on the 8-bit controller of the Arduino Uno, an ANN can be trained pretty quickly. Personal, customized devices can be created that adapt to the task at hand by way of training. AIfES , with Arduino’s support, is now available for the Arduino IDE using the Arduino Library Manager.

This technology allows the development of small, self-learning, battery-powered devices that can be independent of a cloud or another device. Sensor data can be processed where it’s generated, directly on the device. Training data can be recorded by the device and used for training.

AIfES is comparable and compatible with well-known Python ML frameworks. This includes TensorFlow, Keras or PyTorch, while being significantly reduced in functionality. In the current version, feedforward neural networks (FNN) are supported, which can be configured completely freely. Also, common activation functions like ReLU, sigmoid or softmax are already integrated. A full implementation of Convolutional Neural Networks (ConvNet) will follow soon.

The model development is also based on the Python frameworks, so you can find your way around directly. The common algorithms for training, such as the gradient descent optimizer (SGD) or the adam optimizer, are also included.

Import ANNs From Other ML Frameworks​

It’s possible to import a previously trained ANN from another ML framework. Only the network structure and weights are needed to map an ANN and train it further. A Keras example is included in the library, and it’s not necessary to port the model to TensorFlow Lite. The weights of an ANN in AIfES can also be read out, saved or sent directly from the device to be used on another device. Different ANNs can be loaded at runtime by reconfiguring the model and loading new weights. The weight sets can be stored in the cloud to make them available to other devices. The applications are endless.
All algorithms are optimized for use on resource-limited embedded systems. Even the required memory area for the ANN can be specified by the developer.

AIfES has been developed in a modular way to be able to exchange different components of the algorithms. A matrix multiplication, for instance. This allows the easy use of hardware accelerators of the different processor families. For example, the CMSIS DSP properties of the ARM Cortex controllers can already be used to compute or train deep neural networks particularly efficiently.

The Fraunhofer IMS has been using AIfES in AI research and development for years. Internally it’s been used as a development tool for customer-specific AI solutions until a level of development was reached where it could be used as a stand-alone product.
Interesting demonstrators have been created in that time. It’s been part of many public projects, and has already been integrated into future products together with companies from across the industry. As demos, an extremely compact handwriting recognition system was realized on an Arduino Uno. There’s a wireless current sensor for condition monitoring, and a gesture recognition system.

Pre-Trained and Adaptable AIfES Gesture Recognition​

In gesture recognition, the model was pre-trained and the user performs the gestures as the developer trained them. This is the conventional way, but not very intuitive and the user has to adapt to the hardware. Thenew demonstrator uses the Arduino Nano 33 BLE Sense, which adapts to the user instead.

The desired gestures can be trained directly in the system without the need for a PC. A first example of product development within industry is the project “noKat.” A neural optical camera tracker for the detection of approaching persons, where a particularly compact human recognition system was realized using AIfES.

Due to their size, deep neural networks (DNN) are problematic for the implementation on a microcontroller. For this reason, Fraunhofer IMS has been researching techniques to realize particularly compact ML solutions for years. Using special feature extraction techniques the number of inputs can be reduced significantly, so only the relevant features are used.

AIfES is offered as a dual license model. For private projects or developers of free open-source software under the GNU General Public License (GPL) version 3, AIfES can be used free of charge. If AIfES is to be combined and distributed with commercially licensed software, or if the AIfES source code for commercially licensed software is not to be distributed under the GNU GPL V3, a commercial license agreement must be concluded with the Fraunhofer IMS. If you’re interested, contact the AIfES team.

AIfES for Arduino includes examples that get you started right away. Besides inference and training, it also shows how to import an ANN from Keras. The Arduino fruit identificationproject has been re-implemented in AIfES for the Nano 33 BLE Sense. Now the colors of three objects are trained directly on the device, without the need for a PC.

Download AIfES directly from the Arduino library manager or check out the AIfES for Arduino GitHub repository.
We’re super excited about this technology at Arduino, and we can’t wait to see what the community is going to build with it! Make sure you let us know your thoughts, and about any applications you create, over on the forums.

Hi,

Re-reading the above information about Arduino and my question is going to show how little I know, but it reads to me that the company does their AI through software? Is that right? Is Arduino an AI training system?

It describes it can train Neural Networks so just wondering if Renesas have bought it to use in conjuction with Akida?

Trying to work out why, if they have access to Brainchip Renesas are going down this path to buy Arduino?

Anyone who understands this technology or can answer feel free. Even though he is best qualified I feel bad asking Dio all the questions all the time so if anyone else knows the answer please contribute.

Cheers,

 

[uiux]

Why Arduino has set a course towards uncharted waters

The CEO of Arduino talks us through the company's drive to bring its microcontrollers to production environments

www.techradar.com

Why Arduino has set a course towards uncharted waters

The company is perhaps most famous for its hardware, but tell us about the software side of things​

Arduino has evolved into a complete platform providing hardware, firmware, software, cloud services and content. To achieve the aim of making technology accessible and easy to use for everyone, in the enterprise our approach to software and cloud services is an essential component.

Arduino provides the most complex libraries to solve enterprise problems (e.g. connecting field bus like mod bus). We are also developing partnerships related to AI applications to make it possible to do image recognition or signal processing on a microcontroller without the developer having to know all the details about how the algorithm works.