Handwritten digit recognition on Raspberry Pi and Arduino

Jumper wires (generic)

Computer Aided Simulation Program (CASP)

Raspberry Pi 3 Model B

Arduino UNO

7 Segment LED Display, InfoVue

Webcam, Logitech® HD Pro

<p >This project uses Raspberry Pi-3/4 or Aaeon Up x86 single board computers (SBCs) to detect hand written digits from live video captured by the USB camera and send the recognized digit to Arduino Uno to display on a 7 segment display.For this purpose, we use CASP software to program the SBC and Arduino Uno with respective logics.</p><p >This project demonstrate how to integrate Arduino boards with SBCs to do some really useful tasks. It also demonstrate the capabilities of CASP to model and program individual targets to achieve a common objective.</p><h3 >Basic Logic</h3><p >Step 1: On the host PC (native target), we develop a simply 2 layer 128 neurons per layer feed forward neural network model and train the model with MNIST number data set. We save the model during the training process.</p><figure><img src=https://projects.arduinocontent.cc/d2148eb6-6b94-4394-a953-ad7bbbfc0fe6.png /><figcaption>Neural Network Training Model</figcaption></figure><p >We then test the trained model with live images from USB camera connected to the native PC</p><figure><img src=https://projects.arduinocontent.cc/0b8b9eaa-ba27-4a5e-8613-ae3401eef50b.png /><figcaption>Neural Network Inference Model</figcaption></figure><p >Step 2: On the Arduino Uno target we develop a logic to receive a number from the PC via serial communication and display it on a 7-segment display</p><figure><img src=https://projects.arduinocontent.cc/6f740540-7ff1-4863-88fa-ea0dd03bd38f.png /><figcaption>Interfacing 7-segment display with Arduino Uno</figcaption></figure><p >Step 3: We then test the complete logic on the native PC. That is, when a digit is recognized in the live video from USB camera the corresponding digit shall be displayed on the 7 segment display.</p><figure><img src=https://projects.arduinocontent.cc/25a310fd-5c15-4cc9-9fe9-07206e4e1e42.png /><figcaption>Output on Native Target</figcaption></figure><p >Step 4: We now transfer the model from Step-1 to the target SBC and connect USB camera and Arduino Uno to the SBC. We run the model on the target SBC to recognize hand written digits and display on the 7-segment display.</p><h3 >Procedure</h3><p >Step 1. Install CASP and ensure board support packages (BSP) of following are installed (based on your target) before proceeding.</p><p >a. Raspberry Pi 3B (Remote Build), Raspberry Pi 4B (64bit Remote Build)</p><p >b. Ubuntu 64bit OS (Remote Build), Windows 64bit OS (Remote Build)</p><p >c. Arduino Uno</p><p ><span >These are available at this link: </span><a href="https://aadhuniklabs.com/?page_id=550.">https://aadhuniklabs.com/?page_id=550. </a><span >Please go through this </span><a href="https://youtu.be/O46LkUOHTh0">l</a><span >ink: </span><a href="https://aadhuniklabs.com/?page_id=554">https://aadhuniklabs.com/?page_id=554</a><span > for video tutorials on CASP. Please note that this project is supported on CASP version 0.9.4.0 and above only.</span></p><p ><span >Step 2: Download </span><a href="https://aadhuniklabs.com/casp_res_tutorials/">tutorial on machine learning</a><span > and follow the below video tutorial on how to perform the above logic</span></p><div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/IlJL3tXhdeA" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe><figcaption contenteditable="true"><div>Video tutorial on this project</div></figcaption></figure></div><p ><br ></br></p>

Handwritten digit recognition on Raspberry Pi and Arduino

This project shows how to use Arduino with single board computers to recognize hand written digits and display on a 7-segment display.