Embedded Artificial Intelligence Inference with Renesas RZ/G2
Embedded Artificial Intelligence (AI) is when AI inferencing is done at the endpoint, rather than on a server in the cloud.
The Renesas RZ/G FOSS (Free and Open Source Software) AI BSP is a collection of Yocto meta-layers that enable a number of popular Open Source AI frameworks to run natively on the RZ/G2 series of reference platforms. This allows users to test AI models directly on an embedded platform using Arm Cortex CPU and NEON cores.
Currently supported frameworks are ArmNN, ONNX Runtime and TensorFlow Lite.
The AI BSP also includes sample benchmarking applications for each framework that will test the performance of running several popular pre-trained image classification models. The inference timings below are a sub-selection of those provided by the meta-benchmark Yocto layer. The RZ/G2H SoC has the fastest inference timing, following closely by RZ/G2L.
Figure 1: Inference Timings from the RZ/G AI BSP v3.4.0
The source code for the meta-layers is published on GitHub: https://github.com/renesas-rz/meta-renesas-ai
As with any open-source project, code contributions and pull requests are welcome.
Shopping Basket Demo Application
Using the RZ/G AI BSP as a base, Renesas have developed a mock-up shopping basket demo application that uses Machine Learning to identify items in a shopping basket.
Figure 2: RZ/G Shopping Basket Demo Running on the RZ/G2L Evaluation Board Kit Platform
This demo uses the TensorFlow Lite AI framework to process a custom MobileNet v2 SSD model trained to identify 10 common shopping items. The application then adds up the cost of each item and provides a total, mimicking a “smart checkout” that is efficient and reduces waiting time in the retail market.
Download all source code from GitHub: https://github.com/renesas-rz/meta-renesas-ai-demos
- +1 Like
- Add to Favorites
Recommend
- Renesas Launches New General-Purpose 64-Bit RZ/G2L Group of MPUs with Latest Arm Cortex-A55 for Improved AI Processing
- Renesas RZ/G2M Awarded Arm SystemReady IR 1.1 Certification
- RZ/G2L Series from RENESAS is the World’s First MPU Certified PSA Certified Level 2
- New Highly Integrated Renesas Power Management IC Optimized For RZ/G2L And V2L MPUs
- Renesas Introduces Scalable AI SMARC SoM for Accelerating Time to Market of HMI and Embedded Vision Systems
- Renesas Announces 10 New Winning Combinations Integrating Celeno and Renesas Products
- Renesas DSP Solution on Renesas Lab on the Cloud, Input Analog Signals Directly From A Signal Generator To The Rx231 Microcontroller Evaluation Board
- Introducing the Renesas Scalable HMI SMARC SOM with AI
This document is provided by Sekorm Platform for VIP exclusive service. The copyright is owned by Sekorm. Without authorization, any medias, websites or individual are not allowed to reprint. When authorizing the reprint, the link of www.sekorm.com must be indicated.
Integrated Circuits
Discrete Components
Connectors & Structural Components
Assembly UnitModules & Accessories
Power Supplies & Power Modules
Electronic Materials
Instrumentation & Test Kit
Electrical Tools & Materials
Mechatronics
Processing & Customization
