Safe or Not: Prediction with Machine Learning model (AI)

Beacon, EZ-Light

Edge Impulse Studio

SparkFun Simultaneous RFID Reader - M6E Nano

Arduino Nano 33 BLE Sense

UHF RFID Antenna

<p >Elephants are the largest land mammals and are highly sensitive and caring animals, much like humans. They are highly intelligent animals with complex emotions, feelings, compassion and self-awareness (elephants are one of very few species to recognize themselves in a mirror!). They pick up sounds of rumbles with their feet and they can hear low-frequency communications over long distances though the vibrations that come up through their feet and into their ears. Like humans, elephants mourn the death of their love ones. An elephant never forgets.</p><p >But these wonderful creatures are in grave danger. Once common throughout Africa and Asia, elephant numbers fell dramatically in the 19th and 20th centuries, largely due to the ivory trade and habitat loss. While some populations are now stable, poaching, human-wildlife conflict and habitat destruction continue to threaten the species.</p><p >African elephant populations have fallen from an estimated 12 million a century ago to some 400, 000. In recent years, at least 20, 000 elephants have been killed in Africa each year for their tusks. African forest elephants have been the worst hit. Their populations declined by 62% between 2002-2011 and they have lost 30% of their geographical range, with African savanna elephants declining by 30% between 2007-2014. This dramatic decline has continued and even accelerated with cumulative losses of up to 90% in some landscapes between 2011 and 2015. Today, the greatest threat to African elephants is wildlife crime, primarily poaching for the illegal ivory trade, while the greatest threat to Asian elephants is habitat loss, which results in human-elephant conflict.</p><h3 ><span >Edge Impulse</span></h3><p >Edge Impulse enables developers to create the next generation of intelligent device solutions with embedded machine learning. In this project, we will be creating a machine learning model with the help of Edge impulse. Using some datasets, we will train the model to differentiate between different types of audio, which are sounds made by an elephant when it's safe and when it's not.</p><figure><img src=https://projects.arduinocontent.cc/fd87b86f-7dbe-4ff4-80ab-829834dd16e9.png /><figcaption> </figcaption></figure><h3 ><span >Step 01: Acquire Data</span></h3><p ><span >I have not used any devices to capture data. Instead, I created training and test datasets using the sounds from </span><a href="https://www.elephantvoices.org/multimedia-resources/elephant-calls-database-contexts">Elephant Voices database</a><span > and youtube. I have split the sample to avoid the noise and increase the accuracy of the model.</span></p><p >I have created a dataset under two labels: Safe and Danger.</p><div id="gallery"><img id="gallery" src=https://projects.arduinocontent.cc/f1a78017-7132-45eb-a21a-4fc389e7ee2e.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/152fb091-b595-4c31-a5d5-c209bc771ff0.png /><figcaption> </figcaption></div><h3 ><span >Step 02: Create Impulse</span></h3><p >After creating my training dataset, I designed an impulse. An impulse takes the raw data, slices it up in smaller windows, uses signal processing blocks to extract features, and then uses a learning block to classify new data. Signal processing blocks always return the same values for the same input and are used to make raw data easier to process, while learning blocks learn from past experiences.</p><p >For this project, we will be using "MFCC" signal processing block which extracts features from audio signals using Mel Frequency Cepstral Coefficents.</p><p >Then pass this simplified audio data into a Neural Network block, which will learn patterns from data, and can apply these to new data and classify them. This is great for categorizing movement or recognizing audio.</p><figure><img src=https://projects.arduinocontent.cc/7a554643-a1a6-4da3-a710-70c3ce418b79.png /><figcaption> </figcaption></figure><h3 ><span >Step 03: MFCC configuration</span></h3><p >Do not change the default parameters during the configuration.</p><div id="gallery"><img id="gallery" src=https://projects.arduinocontent.cc/0c91d788-39dc-43d5-b71a-b5cf2da71ce6.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/fc926aa7-3ca2-4548-b7af-844d196c0215.png /><figcaption> </figcaption></div><p >Scroll down and click 'Save parameters'. This will redirect you to the 'Generate Features' page.</p><figure><img src=https://projects.arduinocontent.cc/bde20899-4bc9-4570-b4c7-b43ec23d5c91.jpg /><figcaption> </figcaption></figure><p >The feature explorer presents you with a visualisation of the generated MFCC.</p><figure><img src=https://projects.arduinocontent.cc/a0ba7f3a-e3db-48dc-b3cd-aa67a9b6d230.jpg /><figcaption> </figcaption></figure><h3 ><span >Step 04: Neural Network configuration</span></h3><p >Now, it's time to start training a neural network. Neural networks are algorithms, modeled loosely after the human brain, that can learn to recognize patterns that appear in their training data. The network that we're training here will take the MFCC as an input, and try to map this to one of two classes—safe and danger.</p><figure><img src=https://projects.arduinocontent.cc/30da0fbb-81e2-433e-ae1d-5e40a89064da.png /><figcaption> </figcaption></figure><p >I had to train my model a few times with different combinations - number of training cycles and neural network architecture presets.</p><p >The accuracy of this Machine Learning model can be improved by acquiring more data and we need to have minimum 10 minutes of data for each label.</p><div id="gallery"><img id="gallery" src=https://projects.arduinocontent.cc/b5134e13-848c-4731-a7f7-00182196fc2b.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/6f2e0e4a-bd94-4aca-ba84-1f434d28784a.png /><figcaption> </figcaption></div><h3 ><span >Step 04: Model testing</span></h3><p >You can test the validity of your model by this model testing. I tested twenty-seven samples and my model recognised eight of them. If I had more data under each label, this ML model would have been more accurate.</p><figure><img src=https://projects.arduinocontent.cc/169892d4-b28b-4461-be68-72d50171ef47.png /><figcaption> </figcaption></figure><h3 ><span >Step 05: Deployment</span></h3><p >The ML model is now ready for deployment. This makes the model run without an internet connection, minimizes latency, and runs with minimal power consumption. You can either create a library or build firmware for your development board.</p><p ><span >I have turned my audio classification model into optimized source code that can run on any device, for example: </span><a href="https://docs.edgeimpulse.com/docs/arduino-nano-33-ble-sense">Arduino Nano 33 BLE sense</a><span >.</span></p><p >The device can be connected to the elephant collar and be implemented to prevent danger and threats to the diminishing elephant population.</p><div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/pu3MqtpEFuc" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe></figure></div><h3 ><span >Final and complete idea</span></h3><p ><span >To make things more interesting and effective, an RFID microchip could be fitted to the elephant collar or a passive RFID tag can be attached to the elephant's ear. Each elephant will have a unique ID and with the help of Ultra High frequency antennas and </span><a href="https://www.sparkfun.com/products/14066">Sparkfun's simultaneous RFID readers, </a><span >we would be able to detect when the elephant is within a safe distance away from poaching risk areas or places where people reside. Simultaneous RFID readers are capable of reading multiple tags simultaneously. If the elephant is approaching, the RFID reader will be able to detect as it can calculate the distance between the certain RFID tag and the reader. If the elephant is at risk, the park or forest rangers can take the appropriate actions.</span></p><p >The RFID reader can be connected to the microcontroller at around 1 or 2 km away from areas where people live or where poaching activity is high. If the system detects an approaching elephant, the microcontroller is programmed to automatically turn on a beacon light and alert the people residing in that area.</p><p >This would also be helpful if the Machine Learning model fails to recognize sounds from the audio recorded by the microphone in the collar or elephant collar's battery has run out of power or if it malfunctions.</p><h3 ><span >Reference</span></h3><ul ><li ><span >Arapahoe Libraries: </span><a href="https://arapahoelibraries.org/blogs/post/15-reasons-why-elephants-are-the-best/">https://arapahoelibraries.org/blogs/post/15-reasons-why-elephants-are-the-best/</a></li><li ><span >World Wildlife Fund (WWF): </span><a href="https://wwf.panda.org/knowledge_hub/endangered_species/elephants/">https://wwf.panda.org/knowledge_hub/endangered_species/elephants/</a></li><li ><span >World Wildlife Fund (WWF) - Elephant: </span><a href="https://www.worldwildlife.org/species/elephant">https://www.worldwildlife.org/species/elephant</a></li><li ><span >Edge Impulse - Getting started: </span><a href="https://docs.edgeimpulse.com/docs">https://docs.edgeimpulse.com/docs</a></li><li ><span >Edge Impulse - Recognise sounds from audio: </span><a href="https://docs.edgeimpulse.com/docs/audio-classification">https://docs.edgeimpulse.com/docs/audio-classification</a></li></ul>

Safe or Not: Prediction with Machine Learning model (AI)

An effective Machine Learning model, created with Edge Impulse, which can be used to detect whether the elephant is safe or not.