Sensor Data Streaming with Arduino

Arduino MKR IMU Shield

Arduino MKR IoT Bundle 1010

I got myself an <a href="https://store.arduino.cc/usa/mkr-wifi-1010">Arduino MKR 1010</a> (with built-in WiFi+Bluetooth) and a 9-axis <a href="https://store.arduino.cc/arduino-mkr-imu-shield">Arduino MKR IMU</a> shield - let's capture some sensor data! Local data logging In this project we'll try two different methods, first USB and second Web Bluetooth, to stream data from the board to a local machine. This might be a useful starting point to collect sensor data to create ML datasets, for example.IoT options not covered in this projectUsing the MKR 1010's WiFi you can also securely send the sensor data to <a href="https://github.com/arduino/ArduinoCloudProviderExamples">IoT platforms from AWS, Google or Microsoft</a> using the ready-made examples or via <a href="https://www.arduino.cc/en/IoT/HomePage">Arduino IoT Cloud</a>. In fact there are some nice Arduino libraries for <a href="https://github.com/arduino-libraries/Arduino_JSON">JSON</a>, <a href="https://github.com/arduino-libraries/WiFiNINA/blob/master/examples/WiFiSSLClient/WiFiSSLClient.ino">HTTPS</a>, <a href="https://github.com/arduino-libraries/Arduino_OAuth">OAuth</a> so interfacing directly to pretty much any web service is possible.If you swapped out the MKR 1010 board you could use other connectivity options such as <a href="https://store.arduino.cc/usa/mkr-wan-1300">LoRaWAN</a>, <a href="https://store.arduino.cc/usa/arduino-mkrfox1200">SigFox</a>, <a href="https://store.arduino.cc/usa/mkr-gsm-1400">2G/3G</a> and even <a href="https://store.arduino.cc/usa/arduino-mkr-nb-1500">NB-IoT and LTE Cat-M</a>! <h3 >Quick start</h3>Here's how to see a 3D model of your Arduino MKR 1010 moving in real-time:<ul ><li >Connect your IMU Shield to your MKR 1010, and connect to your laptop/PC by USB</li></ul><ul ><li >Compile<a href="https://create.arduino.cc/editor/dpajak/e7af8e95-0aff-4ce1-b2f7-4e7b446c2577/preview"> the BLE_IMU sketch</a> and upload to your Arduino MKR 1010 </li></ul><ul ><li >Load this <a href="https://8bitkick.github.io/ArduinoBLE_IMU/">web page</a> in the Chrome browser on a nearby machine</li></ul><ul ><li >Press the green button on the webpage to pair to your Arduino</li></ul><ul ><li >Watch it go!</li></ul><figure><img src=https://projects.arduinocontent.cc/0ca346eb-5e5f-4e2c-8e96-7a2334416b94.png /><figcaption>BLE_IMU web page in action</figcaption></figure>If you want to know more about data collection from Arduino MKR 1010 and the upcoming Arduino Nano 33 IoT, read on...<h3 >Reading IMU sensor data</h3>The sensor data for our project is provided by the Arduino MKR IMU shield with a 9-axis Bosch BNO55 IMU on board. The <a href="https://github.com/arduino-libraries/MKRIMU/blob/master/examples/SimpleEulerAngles/SimpleEulerAngles.ino">MKRIMU </a>library gives us a simple interface to read the IMU sensor registers. It allows you to read three axes (x, y and z) of each of the three sensor types (accelerometer, gyro and magnetometer) giving us a total of 9 axes. For example:<pre ><code >IMU.readAcceleration(ax, ay, az); // acceleration in straight lines IMU.readGyroscope(gx, gy, gz); // how fast it is spinning IMU.readMagneticField(mx, my, mz); // used as a digital compass </code></pre>A nice feature of this IMU is a dedicated Arm Cortex-M0+ CPU inside the sensor package that uses the sensor values to calculate the orientation of the board for us. All we need to do track orientation is read <a href="https://en.wikipedia.org/wiki/Euler_angles#Geometrical_definition">Euler angles</a> from the IMU shield using one simple function call:<pre ><code >IMU.readEulerAngles(ex, ey, ez); // orientation &lt;&lt;-- we'll use this </code></pre><figure><img src=https://projects.arduinocontent.cc/1db8e13a-feff-4f71-b2c2-09c5bcb895f2.png /><figcaption>Arduino MKR IMU Shield </figcaption></figure><h3 >Outputting JSON log via USB</h3>If you want to log movements of the board the most direct way is to use the same USB cable you plug into your Arduino to program it. Arduino MKR1010 setup We'll use the <a href="https://github.com/arduino-libraries/Arduino_JSON">Arduino_JSON</a> library to write our sensor readings to serial; formatted as a list of JSON objects separated by a newline. A copy of the <a href="https://create.arduino.cc/editor/dpajak/8bed1fec-2514-4646-88d6-0e895edf443b/preview">JSON log Arduino sketch</a> can be found here for you to try.PC or laptop setupIn a linux terminal you will be able to see your Arduino serial connection using:<pre ><code >ls /dev/cu.* </code></pre>Your Arduino will be in the form of <code >/dev/cu.usbmodem[nnnn]</code><pre ><code >/dev/cu.Bluetooth-Incoming-Port /dev/cu.MALS /dev/cu.SOC /dev/cu.iPhone-WirelessiAPv2 /dev/cu.usbmodem1451 &lt;-- in my case it's this one! </code></pre>You can use this the view Arduino's serial output in Linux. (Remember to disconnect your Arduino IDE Serial Monitor otherwise you will see a <code >Resource busy</code> error message.)<pre ><code >cat /dev/cu.usbmodem14511 {&#34;ms&#34;:1561,&#34;ex&#34;:356.25,&#34;ey&#34;:4.875,&#34;ez&#34;:3.5} {&#34;ms&#34;:1591,&#34;ex&#34;:358.9375,&#34;ey&#34;:-0.4375,&#34;ez&#34;:0.0625} {&#34;ms&#34;:1624,&#34;ex&#34;:0.5,&#34;ey&#34;:-3.6875,&#34;ez&#34;:-0.125} {&#34;ms&#34;:1654,&#34;ex&#34;:1.625,&#34;ey&#34;:-5.125,&#34;ez&#34;:0.0625} {&#34;ms&#34;:1684,&#34;ex&#34;:359.75,&#34;ey&#34;:-3.5625,&#34;ez&#34;:0.0625} {&#34;ms&#34;:1715,&#34;ex&#34;:348.25,&#34;ey&#34;:9.8125,&#34;ez&#34;:0.625} {&#34;ms&#34;:1746,&#34;ex&#34;:342.8125,&#34;ey&#34;:22.25,&#34;ez&#34;:2.75} {&#34;ms&#34;:1777,&#34;ex&#34;:338.875,&#34;ey&#34;:31.625,&#34;ez&#34;:5.75} {&#34;ms&#34;:1809,&#34;ex&#34;:336.5,&#34;ey&#34;:37.75,&#34;ez&#34;:9.8125} </code></pre>You can now save your data as a log file, do some parsing and processing.<h3 >Sending data from Arduino over Bluetooth</h3>Arduino MKR1010 setup Bluetooth is a quick and easy way to connect the Arduino to a local machine. The <a href="https://create.arduino.cc/editor/dpajak/e7af8e95-0aff-4ce1-b2f7-4e7b446c2577/preview">BLE_IMU sketch</a> is what we'll run on the Arduino in order to connect to our web browser.Our sketch uses the <a href="https://github.com/arduino-libraries/ArduinoBLE">ArduinoBLE library</a> which has nice examples for creating a Bluetooth connected projects. This is how we will send the data from the device.Don't forget to <a href="https://forum.arduino.cc/index.php?topic=579306.0">update your Arduino MKR 1010 firmware</a> if needed. Our Euler angles are three single precision floating point variables, which each take up 4 bytes. We're packing them into 12 byte array to send in one BLE packet. Here's where in the sketch the sending happens:<pre ><code >void sendSensorData() { float eulers[3]; // read IMU.readEulerAngles(eulers[0], eulers[1], eulers[2]); // Send over bluetooth - casting 3x euler floats as 1x byte array imuCharacteristic.setValue((byte *) &amp;eulers, 12); } </code></pre><h3 >Receiving sensor data in a web browser</h3>Using Web Bluetooth we can build a webpage so that our Arduino board can connect and stream data to the browser.You can see the full webpage <a href="https://8bitkick.github.io/ArduinoBLE_IMU/">here</a> - if your Arduino is powered and running the BLE_IMU sketch you'll be able to connect to it. N.B. You'll need to <a href="https://developer.mozilla.org/en-US/docs/Web/API/Web_Bluetooth_API#Browser_compatibility">check your browser supports Web Bluetooth</a>. We tested this project with <a href="https://www.google.com/chrome/">Chrome</a>.JavaScript and WebBLETom Igoe made a <a href="https://github.com/tigoe/web-bluetooth-example/blob/master/ble.js">cool little JavaScript Web Bluetooth example</a> we used as the basis to create our webpage. The BLE UUID and Characteristic IDs used here need to be the same as those used in the sketch running on your Arduino in order to connect.The magic line that listens for incoming Bluetooth data from the Arduino is here:<pre ><code >characteristics[c].addEventListener('characteristicvaluechanged', handleData); </code></pre>Unpacking the euler values with JavaScript DataViewsYou'll remember our Arduino sketch packs the 3x floats (for euler x, y and z) into a single array, so we'll unpack them using JavaScript DataViews. One gotcha to note is that Arduino is sending variables as little endian and <a href="https://hacks.mozilla.org/2017/01/typedarray-or-dataview-understanding-byte-order/">JavaScript DataViews default to </a><a href="https://hacks.mozilla.org/2017/01/typedarray-or-dataview-understanding-byte-order/">Big Endian</a>. We have to add a parameter to make sure our floats come out correctly<pre ><code >function handleData(event) { // get the data from the peripheral // true = byte order from Arduino is littleEndian var x = event.target.value.getFloat32(0,true); var y = event.target.value.getFloat32(4,true); var z = event.target.value.getFloat32(8,true); </code></pre>We now have the same x, y, z values we sent from the Arduino available in our web browser!Visualization and digital twinNow we have the 3D orientation of our Arduino board streaming to a webpage we can do some fun stuff with it.We'll render a real-time graph using<a href="https://plot.ly/javascript/"> Plotly JavaScript Open Source Graphing Library</a> representing the x, y and z axis.Using a Blender model of the MKR board we exported as a GLTF model, we can animate a simple scene using the <a href="https://threejs.org/">Three 3D Library</a>.

Sensor Data Streaming with Arduino

Connect Arduino to a web browser over Bluetooth and see a 3D model and graph moving around - magic!