Application Note
R01AN6010EJ0100 Rev.1.00 Page
1
of 31
Aug.31.21
RX671 Group
Voice Recognition, Touch and Cloud Solution Using Renesas Starter Kit+ for
RX671
Introduction
The Renesas Starter Kit+ for RX671 is the best kit for developing IoT applications equipped with Voice
recognition, Capacitive Touch Interface.
This application note shows an HMI solution that realizes voice recognition, touch function, and LCD by
PMOD-LCD module using the Renesas Starter Kit+ for RX671. And also introduces an Amazon Web
Services (hereinafter referred to as AWS) cloud solution using the PMOD-Wi-Fi module (sold separately).
An executable file (trial version) that can be downloaded and experienced on the Renesas Starter Kit+ for
RX671 is attached to this application note. There are two trial versions, AmiVoice® version and Voice
Trigger version. The trial versions of AmiVoice® and Voice Trigger can run for only 5 minutes after a
reset. Please reset every 5 minutes.
If you would like to obtain the sample source code, please contact Renesas dealer or Renesas sales
representative.
The demo software described in this application note is configured using the following libraries.
• Voice recognition 1: Voice recognition middleware AmiVoice®, hereinafter referred to as “AmiVoice®”.
• Voice recognition 2: Voice recognition middleware Voice Trigger, hereinafter referred to as “Voice
Trigger”.
• Noise reduction: “Zoom Voice Software”, hereinafter referred to as “Zoom Voice”.
• OS: Amazon FreeRTOS (202012.00), hereinafter referred to as “FreeRTOS”.
Target Device
RX671 Group
Operation Check Tool
Renesas Starter Kit+ for RX671
RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
2
of 31
Aug.31.21
Contents
1. Overview of the System ........................................................................................................... 4
1.1 System Overview Diagram ...................................................................................................................... 4
1.2 Demo Overview ....................................................................................................................................... 4
1.2.1 Voice and Touch Interface (Standalone version) .................................................................................. 4
1.2.2 Voice and Touch Interface (Cloud version) ........................................................................................... 4
2. Hardware Preparation .............................................................................................................. 5
2.1 Constitution of the Hardware ................................................................................................................... 5
2.1.1 Constitution of the Standalone Version ................................................................................................. 5
2.1.2 Constitution of the Cloud Version .......................................................................................................... 5
2.2 About Renesas Starter Kit Board Modification (cloud version only) ....................................................... 6
2.2.1 PMOD2 Connection Destination ........................................................................................................... 6
2.2.2 Board Modification Points ...................................................................................................................... 7
2.2.3 Mounting Locations ............................................................................................................................... 8
2.3 Board Connection .................................................................................................................................... 9
3. Software Preparation ............................................................................................................. 10
3.1 Selection from 2 Types of Programs ..................................................................................................... 10
3.2 Programming the Selected Programs to RX671 ................................................................................... 10
3.3 Preparation of AWS (Cloud version only) ............................................................................................. 12
3.4 Setting for Certification (Cloud version only) ......................................................................................... 12
4. Starting the Demo for Standalone Version ............................................................................. 16
4.1 Renesas Starter Kit+ for RX671 Power On to Voice Command Standby Screen ................................ 16
4.2 Selecting the Language Mode of Renesas Starter Kit+ for RX671 ....................................................... 17
4.2.1 Acceptable Voice Commands ............................................................................................................. 17
4.3 Possible Functions on the Standby Screen After the Board is Turned On ........................................... 18
4.4 Possible Functions on Air Conditioner Mode ........................................................................................ 18
4.4.1 Change the Set Temperature .............................................................................................................. 18
4.4.2 Switching Between Heating and Cooling ............................................................................................ 19
4.4.3 Power Off of Air Conditioner ................................................................................................................ 19
4.5 Parameter Setting Function of Voice Recognition Engine .................................................................... 20
4.5.1 Types of Parameters that can be Set .................................................................................................. 20
4.5.2 How to Start Parameter Setting Screen .............................................................................................. 21
5. Starting the Demo for Cloud Version ................................................................ ..................... 22
5.1 Operation for Touch Interface and Voice Interface ............................................................................... 22
5.2 shadow .................................................................................................................................................. 22
5.3 Device Properties .................................................................................................................................. 23