Arduino MIDI Mouse Controller

Computer roller ball mouse ps/2

ps/2 mouse socket adapter module

Adafruit Bicolor LED Square Pixel Matrix with I2C Backpack

OLED 128 * 64 0.96" 

Arduino Micro

<h3 >Reimagining MIDI devices based on old electronics</h3><p ><span >I hate throwing away old electronics that still work but are no longer supported by modern appliances. My idea for this project came after finding an old PS/2 port roller ball computer mouse that I no longer had a use for. I'm a musician in my spare time and currently recording an EP with my metal band </span><a href="https://hellsheep.bandcamp.com">HELL SHEEP</a><span >. I'm using MIDI controllers to create synth parts for our tracks on pro tools. Many people use a MIDI keyboard to write MIDI parts on the computer. I'm no pianist so I have been experimenting with different methods of writing MIDI, including using </span><a href="https://youtu.be/TBQJtroDKkk">chess games</a><span > and </span><a href="https://www.youtube.com/watch?v=GayJycHz04s&t=1s">cellular automata</a><span >. Trying to think of a way to re-use the old computer mouse, it occurred to me that it could be repurposed with Arduino as a nifty MIDI controller.</span></p><p ><span >(For those of you who don't know what MIDI is, </span><a href="https://www.youtube.com/watch?v=NgIzSxTmQYA">check out this great video by Collin's Lab</a><span >.)</span></p><div class="se-component se-video-container __se__float-none" contenteditable="false" style="width: 100%;"><figure style="width: 100%; height: 56.25%; padding-bottom: 56.25%; margin: 0px;"><iframe frameborder="0" allowfullscreen="" src="https://www.youtube.com/embed/vHMShHjJebs" data-proportion="true" data-percentage="100%,56.25%" data-size="100%,56.25%" data-align="none" style="width: 100%; height: 100%;" data-index="0" data-file-size="0" data-origin="100%,56.25%"></iframe></figure></div><h3 >The Arduino MIDI computer mouse controller</h3><p >I decided that the controller would make use of every feature on the old computer mouse I had. That meant mapping separate MIDI commands to left click, right click, mouse wheel click, mouse wheel scroll, and mouse movements on the X and Y axis. </p><p ><span >I decided to map the midi pitch to the X axis position, and the midi volume (known as 'velocity') to the Y axis position. The position of the mouse wheel, would determine the value of a </span><a href="https://www.sweetwater.com/insync/continuous-controller/">continuous controller. </a><span >In the default settings this is CC1 - the mod wheel value. </span></p><p ><span >The operation of the device is based around two modes which can be switched between by clicking the mouse wheel. In </span><em >Glissando </em><span >mode, the device can only play one MIDI note at a time. Left or right mouse clicks map to the same note. Moving the mouse while clicking down leads to a seamless movement between notes. In </span><em >Interval </em><span >mode, left and right mouse clicks map to different notes so it is possible to play intervals by first clicking one mouse button, then moving the X axis position of the mouse, and clicking the other mouse button. </span></p><h3 >The user interface</h3><p ><span >I wanted to give the controller an intuitive and fully established user interface so users wouldn't have to rely on a computer display to be able to use the device. </span><strong >This means the controller</strong><span > </span><strong >can be used with any device capable of reading MIDI through USB. </strong><span >In order to do this I used an LED bicolour 8 * 8 matrix and a 128 * 64 monochrome I2C display. </span></p><p >The LED matrix provides a representation of the X and Y axis position of the mouse. The pattern of lights across the X axis is based on 1 octave of a C major scale. The pattern is shown in the images below. It will repeat from -5 to +4 octaves above middle C.</p><div id="gallery"><img id="gallery" src=https://projects.arduinocontent.cc/aa53b15a-b7ae-4887-b220-1804ca548f2f.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/2bafba90-0cd8-4dc8-9619-5c21cdab7c4c.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/00b700b2-cc07-4230-868b-1f7f208b495d.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/08b9e063-4ffd-4ebe-b925-b540f5b0e8a6.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/a7323d91-2498-4d81-8b8a-f0c81dc6c046.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/f7b5709b-f0dc-40f6-b5d3-dcf98baaeed0.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/7e2e380d-b064-4984-a56e-3a11146cd1ad.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/e1127f67-4016-43cd-be83-adbd00293688.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/74f2af46-5880-4e5b-8187-7ddcb448ff62.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/3dbce189-1c5c-46b6-97b8-b1e798803e46.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/81097b31-5533-4532-9608-8495f8e9ccf5.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/5940a289-57fa-484a-bc87-d59e300c28d5.png /><figcaption> </figcaption></div><p >Unlike the X axis, the Y axis does not 'loop' and so the 127 possible volume values map to 8 positions on the matrix. This is demonstrated in the images below: </p><div id="gallery"><img id="gallery" src=https://projects.arduinocontent.cc/4e18939d-3599-48a1-8111-fa05d652d552.png /><figcaption> </figcaption><img id="gallery" src=https://projects.arduinocontent.cc/010cf448-b139-420f-9296-9a79af2b056b.png /><figcaption> </figcaption></div><p >In Glissando mode the matrix lights up green to show the position of the mouse before a note is pressed, and red while a note is being pressed. In interval mode, the matrix lights up red at the point at which the left mouse button was pressed, orange at the point at which the right mouse button was pressed, and green at the current position of the mouse. </p><figure><img src=https://projects.arduinocontent.cc/e5b3ae39-a6f2-462a-804d-e9f0ee6e07d8.png /><figcaption> </figcaption></figure><p >Alongside the LED matrix, there is a 128 * 64 OLED monochrome display that displays the current note and volume, as well as the position of the mouse wheel and the mode of operation. An annotated image of this display is shown below.</p><figure><img src=https://projects.arduinocontent.cc/42896849-e78d-4ca5-b8c4-902bfa03a75e.png /><figcaption> </figcaption></figure><h3 >How to assemble the device</h3><p >Wire up your components on a breadboard as shown in the breadboard layout image below. Install the following libraries using the library manager on the Arduino IDE: </p><ul ><li >MIDIUSB (used to send MIDI through USB) </li></ul><ul ><li >Adafruit_LEDBackpack (used to communicate with LED matrix)</li></ul><ul ><li >Adafruit_GFX (used by the OLED display)</li></ul><ul ><li >Adafruit_SSD1306  (to communicate with the OLED display)</li></ul><p ><span >Install the following library from GitHub to communicate with the PS/2 mouse adapter. </span><a href="https://github.com/rucek/arduino-ps2-mouse">ps2 mouse</a><span >. </span></p><p >Download the code from the GitHub repository and upload it onto your Arduino micro. </p><h3 >Making music with your mouse</h3><p ><span >Once you've wired the circuit and uploaded the code, attach a ps/2 roller ball mouse and check that the UI is working. If it is, the device is now ready to be used as a MIDI controller. If you've never used a MIDI controller to make music on your PC before I recommend following the </span><a href="https://www.arduino.cc/en/Tutorial/MidiDevice">Midi Sound Generation on Windows </a><span >instructions in the MIDI device documentation. </span></p><p >If you've used MIDI before, the device is ready to be used just like any other MIDI controller. In the images below I show how I use the device with Pro Tools 12. </p><div id="gallery"><img id="gallery" src=https://projects.arduinocontent.cc/930703d1-13fb-4a27-a8c0-dc64c3d3da05.png /><figcaption>In Pro Tools go to Setup -> MIDI -> MIDI Input Devices</figcaption><img id="gallery" src=https://projects.arduinocontent.cc/dda7bc33-492b-49b9-ba3b-6c0920385a00.png /><figcaption>Select 'Arduino Micro', this will be automatically detected if you have connected your Arduino via USB.</figcaption></div><p ><span >Some things to note: the MIDI channel is fixed at channel 1. If you want to change this you will have to change the </span><strong >midiChannel</strong><span > constant in the code. Likewise the mouse wheel is mapped to CC 1, this can be changed in the code too. </span></p><p >Finally, if you do some light tinkering with the code, you can experiment with changing the sensitivity of the mouse, or what MIDI parameters the X an Y positions or mouse wheel correspond to. If you do some tinkering and come up with something cool, please share it in the comments! </p><h3 >Acknowledgements</h3><p ><span >This project was greatly aided by the </span><a href="https://github.com/rucek/arduino-ps2-mouse">PS/2 mouse library</a><span > and the </span><a href="https://github.com/arduino-libraries/MIDIUSB">USBMIDI </a><span >library. In the YouTube video I am using the </span><a href="https://www.plogue.com/products/chipsounds.html">chipsounds software synth</a><span > to create music with the controller. </span></p>

Arduino MIDI Mouse Controller

Turn an old "roller ball" mouse into a MIDI controller that can unlock new ways of making digital music.