Botgammon Battle

Arduino IDE 2.0

GRBL

Arduino Micro Pro

Arduino Mega 2560

Arduino R3

Arduino R4 UNO

<html><body>The aim of the project was to develop the first robot capable of playing Backgammon against human being. It possesses the ability to comprehend the board and execute intelligent, precise moves based on an well known Bsckgammon that calculates the optimal next move. Full video:<figure><iframe src="https://www.youtube.com/watch?v=F0rRMJZtO1g"></iframe></figure> <h3>Main Fetures and Challenges:</h3>- Closed-Loop Monitoring A camera positioned above the board and dice captures their status and relays it to the controlling PC. An old mobile phone serves as the camera, transmitting its output to the PC. Main features: -	Closed-Loop Monitoring: A camera positioned above the board and dice captures their status and relays it to the controlling PC. An old mobile phone with an app serves as the camera, transmitting its output to the PC. Board Calibration: Calibration involves identifying four well-known 'machine location' checkers on the board, establishing an initial mapping between screen coordinates and machine coordinates. Due to camera distortion, the mapping isn't linear. I used the following steps to calibrate the board: <ol><li>Board-Camera initial Mapping (scale and position) </li></ol><ol><li>Board Rotation: To align the image with the board, it's rotated since the board borders aren't perfectly aligned with the camera's X and Y directions. </li><li>Camera Distortion Compensation: Camera distortion causes errors of a few millimeters, necessitating compensation to prevent expected errors like missed checkers. </li></ol> <figure><img src="https://projects.arduinocontent.cc/a8304ba1-ec7b-4787-8777-385fc59b367d.jpg"/><figcaption>The corner checkers (yellow) are being used to calculate screen-to-machine coordinate translation. the other ones (black) are used to identify the bars</figcaption></figure>Checkers identification Checkers recognition: An algorithm identifies checkers and their colors, filtering out noise like the markers and the paintings on the board (see Red arrow below). It then interprets the image and translates it to checkers on the board (on the right). <figure><img src="https://projects.arduinocontent.cc/6d112c87-2132-47d0-bfac-b01623568af9.jpg"/><figcaption>the original board (left) and the interperted board (right)</figcaption></figure>Special handling is required for unusual cases, such as when checker columns are high enough to 'invade' the opposite column, see example below: <figure><img src="https://projects.arduinocontent.cc/c58eef31-8ad9-4043-baf0-5addbb21a3c9.jpg"/><figcaption>special cases of checkers</figcaption></figure> Controlling the Robot The robot is managed using GRBL, a platform for motion control for CNC, adapted to control the robot's head for playing backgammon. An Arduino serves as the main controller, communicating with another Arduino running GRBL to execute move commands. Moving Checkers <ol><li>Offline simulation: Offline simulation was crucial due to the numerous maneuver types involved. It was essential to develop a simulation that clearly illustrates the head's movement from the origin to various pickup and target positions. Additionally, the simulation provides warnings if it detects potential collisions with the board's bars (the simulation runs before every movement, to prevent damage to the robot’s head. </li><figure><img src="https://projects.arduinocontent.cc/c576964c-e371-40a5-929c-1ffec4f10447.jpg"/><figcaption>Offline Simulation</figcaption></figure>In this example, the head moves to 1 (Black line - head is up), pick up the checker, then it descents when running to 2 (red line), getting closer to the bar and slides the checker in it’s target position</ol><ol><li>Approaching for Pickup : To avoid collisions with the bars around the board, a 'no-descending zone' is defined (see Grey borders below). The robot's head avoids descending in this area and adopts a specific approach when picking up checkers near the bars. </li><figure><img src="https://projects.arduinocontent.cc/7495e907-9f82-4be6-afc3-4a6ce66775c8.jpg"/><figcaption>'No descent' zone (Grey)</figcaption></figure></ol><ol><li>Picking up Checkers: Once the robot's head is positioned above (or nearly above) the checker, it descends, activates a magnet, and picks up the checker. </li></ol><ol>The checkers are outfitted with metal that becomes magnetized when in close proximity to an active magnet. To achieve this, I opted to utilize a small round battery with this magnetic property.</ol><ol><li>‘Lift &amp; Shift’ - In order to prevent difficulties during the descent onto the checker, I incorporated a mechanism that provides a degree of flexibility in the descent height. </li><figure><img src="https://projects.arduinocontent.cc/512580a2-3b56-4377-b53e-00d54f1e7a9b.jpg"/><figcaption>'Lift &amp; Shift' - straigthen up the checker once it is picked up</figcaption></figure></ol><ol>As can be seen, once a checker is collected and being lifted – it is being straighten up. This becomes crucial when descending and placing the checkers, as it prevents placing it on top of other checkers, due to the misalignments. This is a game changer in this whole implementation.<figure><iframe src="https://www.youtube.com/watch?v=7xacsFTQi2Q"></iframe></figure>Placing a checker on board</ol><ol><li>Avoiding bars – another challenge is to put the checker back on the board. When the checker’s target position is close to the corner, it behaves in a similar way to when it was picked up – first, go as fast as possible near the target position, then, descent and then – drop the checker in its final position. This avoids collisions and some mess on the board afterwards. </li></ol><figure><iframe src="https://www.youtube.com/watch?v=sQ3fbP2t4E0"></iframe></figure><ol><li>Avoiding clashes with other checkers . Sometimes, there’s a need to put the checkers in a very narrow position since there are checkers on both sides of the target column and not enough space for the checker. For that, I decided to approach the target position from the top of the column and then make some way for the checker to be placed. Fortunately, the magnet was strong enough to hold the checker when moving some other checkers away and giving some space. The key success factor here is to maneuver the checker high enough so it doesn't touch the board, but low enough to make it move other checkers. The height of the checkers was adjusted to make this happen. </li></ol><figure><iframe src="https://www.youtube.com/watch?v=m7HKXtxNxHM"></iframe></figure>It was also necessary to ensure the checkers on the bar, when flying over them. This was handled by adjusting the height of the robot's head:<figure><iframe src="https://www.youtube.com/watch?v=z-zRh-HJbSI"></iframe></figure><ol><li>Dice Recognition : Implemented using a simple CNN (Convolutional Neural Network) trained on roughly 1K images. The NN is practically working perfectly, apart from the times when the dice is partially laying on the corner of the dice roller. </li></ol>Communication: I employ three communication protocols: <ol><li>TCP: Facilitating communication between the PC and the main Arduino. </li><li>I2C: Establishing communication between the main Arduino and a communication transfer controller. This controller reads I2C and transmits data via Serial, compensating for the absence of additional Serial capability on the main Arduino. </li><li>Serial: Enabling communication between the main Arduino and the GRBL controller, as well as between the main Arduino and the communication transfer controller. </li></ol>Visual Feedback : Utilizing a 64x32 LED Matrix to display messages and enhance the gaming experience. A simple PCB that I designed connects the LED Matrix to the controlling Arduino. <figure><img src="https://projects.arduinocontent.cc/e0b71a66-c5de-468c-a98b-1815f0578b3b.jpg"/><figcaption>PCB to transmit data from Arduino to RGB Led Matrix</figcaption></figure> there are many messages and multiple animations that the game provides:<figure><img src="https://projects.arduinocontent.cc/6fe41b3d-d2e6-4c4d-9dad-8edee3272ee1.jpg"/><figcaption></figcaption></figure><ol></ol> </body></html>

Botgammon Battle

A fully operational robot that plays checkers against a human player