Full-auto nerf gun that shoots you in face, using OpenCV

Arduino IDE

Arduino UNO

OpenCV

MG996

I've been building this project as a way to learn computer vision.I've been documenting the build progress on my YouTube channel: <a href="https://www.youtube.com/channel/UCcT3iGeJJfpGU1QehvG48tg/videos">https://www.youtube.com/channel/UCcT3iGeJJfpGU1QehvG48tg/videosw</a>Currently the project sort of works as an initial version, but I may come back to it at some point and try to improve it. If you want to see the final testing watch this video, and then below I'll put more details about the build process<div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/N5vzpi4yF7A" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe></figure></div>I started with creating a prototype to test the face-tracking without the nerf gun, which would both mean it would be lighter and easier to quickly to together, and also that I wouldn't be constantly shot by nerf bullets whilst trying to get the software working.The testing setup comprises of two servos, one for pan and one for tilt, with a webcam mounted on top, as shown below:<figure><img src=https://projects.arduinocontent.cc/8ba81afa-8b26-42be-ae07-02b85cbe43a1.png /><figcaption> </figcaption></figure>The webcam is plugged into a computer running a python script with OpenCV. That detects a face, and sends the coordinates of where it is within the image to an Arduino, which moves the pan and tilt servos so that the centre of the face (green dot) is within the centre of the image (white square). I used a guide by Shubham Santosh (<a href="https://create.arduino.cc/projecthub/shubhamsantosh99/face-tracker-using-opencv-and-arduino-55412e">https://create.arduino.cc/projecthub/shubhamsantosh99/face-tracker-using-opencv-and-arduino-55412e</a>) for this part, so thanks to him for pretty much half the project!<figure><img src=https://projects.arduinocontent.cc/0c98dbf9-01e0-4127-8e90-7f76624403ce.png /><figcaption> </figcaption></figure>I could then design and print a larger and more sturdy two axis mount for the nerf gun, and a firing mechanism which is triggered when the face is within the centre of the screen (shooting me in the face, apologies for my lack of eye protection!)<figure><img src=https://projects.arduinocontent.cc/38f47b3a-568c-4a1c-a628-8b8ba2c706d4.png /><figcaption> </figcaption></figure>And after that, all that was left to do was test it!<figure><img src=https://projects.arduinocontent.cc/eb5357bc-411b-428d-9b6e-703f889f9d0c.png /><figcaption> </figcaption></figure>It works, although currently motion is a bit jerky, and it might be worth adding in a feature to scan the room if no face is detected.To see the test (and me get shot in the face) check out the testing video: https://www.youtube.com/watch?v=N5vzpi4yF7A&ab_channel=AdamBeedle

Full-auto nerf gun that shoots you in face, using OpenCV

I built a face tracking full-auto nerf gun that shoots me in the face using computer vision.