Arduino Lidar Scanning & Java Rendering

Arduino IDE

Servo Motor MG996R

TFMini Lidar Sensor (UART)

Arduino Mega 2560 Rev3

Netbeans Java IDE

Video Demo<div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/6YTCKRSWroE" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe></figure></div>How It WorksThis project consists of two parts. The Arduino side handles all the servo movements and gets measurement readings from the Lidar sensor. The Java side does the spherical to cartesian points conversion and renders them in 3D. They communicate with each other over the serial port. The user can move around the scene with game-like fps controls for a better experience.The MathThere are two servos in the project. One will be used as the Pan (Phi) angle and the other as the Tilt (Theta) angle. The reading we get from the Lidar sensor will become the Radius. Which means that device itself would be at point (0,0,0). Each data set sent from the Arduino to the Java program consists of these three numbers (radius, phi, theta) with leading zeroes for consistency.<figure><img src=https://projects.arduinocontent.cc/cb560c94-fcc6-4c2b-b17a-6f8508b6e503.png /><figcaption> </figcaption></figure>From here we have to convert these Spherical points to Cartesian(x, y, z) so we can properly plot them in our Java program.<figure><img src=https://projects.arduinocontent.cc/41cbe44a-20f1-469b-8abc-803d2bee16fb.png /><figcaption> </figcaption></figure>We can achieve these conversions using these formulas.<figure><img src=https://projects.arduinocontent.cc/c318f9d6-1adb-4e50-8734-366db0fbd4c8.png /><figcaption> </figcaption></figure>Note: If you look inside the Java code and notice that some of the values of x, y, and z are swapped, some times even set to negative, that's because the computer coordinate system is different as well. For example, in computer coordinates, the x goes horizontal not y. Y positive goes down, not up. Things like that. These modifications made to the formula were only to get Java to render the points in the correct place.Serial CommunicationI started this project with an Arduino Uno but ran into problems with the serial port conflicting with the servos. They cannot work at the same time. When data was being sent back and forth, the servos would jitter constantly. From research I learned that this was a common problem using SoftwareSerial. I found some workarounds for this problem but they were such a hassle and didn't even completely work for me. I decided to switch to an Arduino Mega and it solved the jittering problem. This is because the Mega has multiple serial ports.The steps of communicating<ul ><li >Java opens port and listens for data</li></ul><ul ><li >Arduino takes first measurement, moves the servos to the next position and wait for an &#34;Okay&#34; signal from Java</li></ul><ul ><li >Arduino sends the data to Java in this format 000,000,000</li></ul><ul ><li >Java waits for all the fragments of data to reach a certain amount that is enough to convert</li></ul><ul ><li >Java converts those numbers, plots the point, and send the Arduino a single char as the &#34;Okay&#34; signal</li></ul><ul ><li >Once the Arduino receives the signal, it repeats what it did before at the new angle positions</li></ul>The reason Java has to wait is because even though you tell the Arduino to send 9 digits and 2 commas, sending data over serial does not work that way. It will send fragments of whatever data it wants whenever it can. So we want Java to until all the data received looks like something it can recognize.I used a USB cable as the serial connection but I am sure one could use a bluetooth module as well if wireless was needed.Powering The ProjectI used a 5v wall brick to run the servos because I just hate dealing with batteries and avoid them when possible. The Lidar sensor was powered through the Arduino 5V. And of course the Arduino was powered with the same USB cable that was used as a serial port.Feel free to leave a comment or question about the project. Thanks!

Arduino Lidar Scanning & Java Rendering

Replicate a 3D environment in real-time!