Garden Habitat Data Pipeline (Sensors, Java, Docker, Python)

SparkFun Soil Moisture Sensor (with Screw Terminals)

Arduino UNO Wifi Rev.2

Temperature and Humidity Sensor, IP67

<p >My project is about building a prototype for a garden habitat monitoring system with sensors and creating a data pipeline with the ability to use visualization tools and programs to generate statistics to learn more about my seedling environment.</p><p >This is my first time gardening and planting vegetables, particularly from seedlings.  Since the Arduino can interface with various sensors I thought it would be great to capture information on the moisture of the soil, the temperature, and also humidity.  I also thought it would be great to use some of the other  applications I tend to work with on a daily basis as a software engineer such as Docker, Java micro services, Python, etc... to create a data pipeline from my sensors back to a relational database.</p><p >I've seen  many tutorial videos that explain the sensor basics with Arduino but there never seemed to be a deep enough discussion on what to do with this data once you collect it.  Most tutorials acted on the data immediately to trigger a water pump to water soil.  I would like to potentially not only use these sensors to automate watering my soil but I'd also like to take a deeper dive into the data to really understand what my vegetables are experiencing from as many environmental factors as possible.</p><p >The garden habitat monitoring prototype works in the following manner:</p><p >1) The moisture, humidity, and temperature sensors provide readings to the Arduino WiFi board.</p><p >2) The Arduino WiFi board then creates HTTP POST requests with a JSON payload and sends this off to a Java microservice API running in a Docker container.</p><p >3) The API then publishes this data to a MySQL database, running in a Docker container, to be stored for later use.</p><p >4) I then use Jupyter Notebooks, Pandas, and Matplotlib to generate statistics and graphs from this data in the MySQL database.</p><p >This process completes a data pipeline from my seedling environment to a relational database.</p><p >I created a YouTube channel named Embedded Garden. I plan to post more videos as I build my garden and add automation for watering and sensor data collection.  I am hoping to engineer a solar powered solution when my final garden monitoring system is completely implemented.</p><p >Here is a link to the YouTube channel. I created three videos as a 3 part series titled Seedlings and Sensors.</p><div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/m_53hKY5Eg0" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe></figure></div><div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/eUM9UQQJ4J4" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe></figure></div><div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/RJKAE2LdYPs" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe></figure></div><p ><span >This is only my second Arduino project. My first project your blog featured on the site. I made my old AT-AT walker from Star Wars remote controlled and walk. Here is a link to that blog article also: </span><a href="https://blog.arduino.cc/2015/12/10/making-a-vintage-star-wars-at-at-toy-walk-with-an-arduino/">https://blog.arduino.cc/2015/12/10/making-a-vintage-star-wars-at-at-toy-walk-with-an-arduino/</a></p>

Garden Habitat Data Pipeline (Sensors, Java, Docker, Python)

Imagine a sensor data pipeline direct from your garden.