This years Geek Fest in the form of 3D Camp is taking place on Saturday the 11th June at the Computer Science and Information Systems (CSIS) building at the University of Limerick. I am very honoured to have been asked by its creators (Gabriela Avram & James Corbett)
to give a talk on my FYP in Masters of Science in Interactive Media, a project I have talked about before on this blog while building it during the course. It will be held at 12:30pm in room CSG001 where I will run thorugh a brief history of my background coming from art and design, not having ever touched electronics prior to the course and how I built and created an interactive project where you can pedal through anywhere in the world on Google Streetview using an exercise bike with readymade “off the shelf” programmes, software, and hardware, cheaply and easily. During the lunch break people interested in trying out the bike may do so as it will be fully set up for use in one of the demo rooms in CSIS.
My husband Keith and I will also be hosting a 45minute Arduino workshop at 1:30pm upstairs in one of the computer labs in the CSIS building. Arduino is an open-source electronics prototyping platform based on flexible, easy-to-use hardware and software. It’s intended for artists, designers, hobbyists, and anyone interested in creating interactive objects or environments. For 3D-Camp, this is a beginners Arduino workshop and will suit people who are completely new to Arduino. For this tutorial we will be looking at how to set up an Arduino development environment, write and upload a small programme to the device to help you gain a basic understanding at getting started with the fun of Arduino.
You can read the press release on 3D Camp “Here” to find out more information on other workshops, keynote speakers and talkers, times and places. Its free to attend and take part in so theres no excuse for you not to pop along for some geeky fun for the day! Hope to see you there!
The project is now finally finished, built, actually works and has been very well received by not only the people it was originally built for but also test users at exhibitions including The Science Gallery in Trinity College Dublin where it is on display from the 26th to the 30th of October.
Escapism is just part of my final year project for the Master of Science in the University of Limerick Ireland. It is a stationary bike that hooks up to a computer, which is hooked up to a screen and allows you to pedal through anywhere in the world that Google Streetview is available. You can also look 360º using a programmed Nintendo Wii Remote. Considering I come from an art background and never really so much as touched an LED prior to this year, It was a difficult enough project for me even though it is a very basic idea.
Abstract:
The aim of this project was to explore the development of an interactive guided imagery display to be used initially by both the staff and residents of Milford Care Centre Limerick. Now completed, it can potentially be used by anyone for exercise and recreation.On the 3rd of December 2009, the Interaction Design Centre at the University of Limerick received an email from the head of the art department in Milford hospice asking about the possibility of a student or a number of students to collaborate on an idea for a project to enable residents and visiting patients of Milford Hospice with a sense of escapism in the physiotherapy room, as the room itself has no ground level windows leaving the current palliative and elderly users feeling trapped in their environment as well as their illness. For the purposes of demonstration, the completed project itself features an interactive display, linked to a stationary bike allowing users to cycle through Google Streetview, with 360º navigation using a Nintendo Wii Remote. The set up may also be used to display pre recorded video landscapes and virtual environments.This project has shown how accessible and inexpensive virtual reality rehabilitative environments can be as it was built and programmed using all off the shelf, freely available, open source software and the device itself can be attached to any stationary or assistive bike.
The Build:
It’s simple enough, making a long build story very short: The stationary bike was opened, 8 Rare Earth magnets were attached to the pedal rotator of the bike where they pass 2 hall sensors. The sensors are connected to an Arduino which is active on a computer, attached to a large screen or projector.
Initial set up diagram, the device has now been built into the stationary bike
Magnets hot glued in place and the 2 Hall sensors ready to be attached to an aluminium bracket.
Sensors fitted
Arduino device built into the stationary bike.
When you pedal the bike, the magnets activate the sensors. If sensor 2 then 1 activates in that order the arduino is programmed to read ‘forward’, when they are activated in the opposite order, 1 then 2, the arduino reads backwards, then converts the code into simple keystrokes that Google Streetview understands to move forward [Page Up] and back [Page Down] on screen. The arduino wiring was then fixed to a protoboard for sturdiness and built into a project box. As a novel debugging method, two LEDʼs were added to the prototype, Green which would light when pedalling forward and Red which would light when pedalling backward. These LEDʼs allow for understanding that the prototype sensors are active and working when the Processing windows Serial Monitor is not onscreen. The Processing environment where the Arduino code is compiled has a simple display of a serial monitor, when the sensors are activated it indicates a FWD (Page Up) when pedaling forward and a BWD (Page Down) for backward pedaling. It is indicated to print these commands in the code for debugging purposes and is just another way of seeing that the code is working and the sensors are activating.
Serial Monitor reading forward and back.
Before building and tidying into a project box. Test wiring with LED’s.
After tidying, its rough but safer!
Virtual Reality Environments, even as basic enough as this, are notoriously expensive to build and market and usually this is the grounds for companies, that need it most, to refuse to implement it in there working, rehabilitative or recreational environment.
As this project was designed specifically but not limited to a rehabilitative/medical environment, I was determined to make this project as cheaply as possible so that it could be built and readily available at very little cost.
As a result of much research since February 2010, All software used in this project is free to download online and easy to install. Anyone with a stationary bike, a computer and wifi can use this in their own home for exercise and recreation.
AAC keys to convert the code from the Arduino into keystrokes so that it is recognised on Google Streetview.
Darwiin Remoteto connect the Nintendo Wii remote to the computer so that it is recognised as a wireless mouse. This remote can be then be used to view the maps in 360º while you pedal and can also be keymapped so that the buttons can be used to move forward and back for any individuals with limited dexterity or other difficulties pedaling.
All of the above software is free and available for both Mac and PC, I have added the links to them in the names if you would like to download and try for yourself.
Set Up And Use:
Setting up the working prototype for use is simple but requires opening up all the different applications involved. Firstly attach the sensors to the bike making sure they are correctly spaced apart so that the magnet on the pedal can easily activate them, then open the Arduino processing environment. Plug in the Arduino USB and upload the completed code onto the board. Next open AAC Keys, open preferences making sure the correct USB serial port and Baud rate is activated, for this project it is 9600 Baud, open Google Stretview in a browser, pick your destination by dragging the Streetview man onto the street you would like to explore. Finally, turn on Bluetooth, activate Darwiin Remote and connect the Wii Remote to your computer, personalisation of preferred key controls will have been saved from previous use and does not need to be done every time you connect a remote. It is all now ready for use.
Difficulties Involved in Set Up:
There are a few glitches that need to be highlighted prior to use but are easily solved once they are understood. It was found that all the applications running together may cause problems between programmes, Most notably between AAC keys and Darwiin Remote. When AAC Keys is in use it seems to run the computers processor at a very high rate and on occasion can interfere with the Darwiin Remote programme. Setting up the particular programmes in the order set out above covers the problem the majority of times but there can still be trouble connecting the remote to the computer. The best way around this is as follows:
When connecting the Wii Remote through Darwiin, the first time the remote is seen by the computer it is logged and stored as a device in the Bluetooth Devices menu, should there be difficulty connecting the remote thereafter, delete the Wii remote from the Devices menu and try again, this has proven successful in solving the remoteʼs connection problem.
Response:
Everyone who has tested and played with this prototype has responded very positively saying it is an excellent source of exercise and fun and would be great for use before going to a place on holidays to get a look around and familiarise themselves.
Bike being used at the Science Gallery Dublin while on display for the TWISTing Science Exhibition
Conclusions:
Originally, video and audio was to play a larger role in the thesis research, to be activated and respond in realtime to the pedaling of the user. An actual functional interactive virtual display was only to be one part of the overall finished piece. However, further detailed research into real time video and audio interaction was dropped to facilitate the speed at which the prototype was developing.
The project and prototype can not only be defined as an interactive display for virtual reality landscapes like that of Google Earth, but the build leaves itself wide open to display any number of items on screen. From video games, photos, movies and websites, this prototype can simply be manipulated to be used with any onscreen software environment.
Initially this project was to entice users back into the physiotherapy gym and provide a distraction to the monotony of their rehabilitation exercises without a particular motivational factor, however through the development cycle and the contribution and feedback from both the physiotherapy staff and the users themselves, this project now provides as both a distraction and a motivational tool enough to entice the users back into the gym in a fun and playful new environment that users have not been privy to in the gym before.
A lot of scope has presented itself for further development with this project. Mainly in the field of further research in video and audio and the possibility of incorporating graphical elements in an interface to make the set up simpler. Also researching possibilities for more options in intuitive methods of haptic control. A lot more attention will need to be given to these extra research areas in order to create a more intuitive and completed immersive interactive experience.
Our Masters in Interactive Media and Music Technology Thesis projects go on public show starting 6pm Weds 1st of september in the Computer Science and Information Systems building in the University of Limerick in an anual exhibition called DAWN (Digital Arts Week Now) and followed by a concert at 8pm in the Irish Chamber Orchestra Studio by the Music Technology students, all are welcome so please come along to see our projects, we have all worked endlessly to bring this to you so please, PLEASE spread the word and drag friends allong to experience our artistic, musical and technological projects first hand, play and ask questions, it will be fun Hope to see you all there, thanks
The poster above was designed by Keith Moloney and Oisin Lavery, thanks to Triona Butler for all the help in organising the printing and organisation of DAWN too. Below is my own project poster as designed again by my wonderful husband, Keith Moloney. To find out more about the masters, what we got up to for the year and more about my own project please see HERE.
Much thanks has to go to Keith for his constant patience at my endless stupid and silly questions and requests, you are a saint love! Also a massive thank you to Mikael Fernström, my supervisor for all his endless help and ALL in the IDC, saints the lot of ye for putting up with the lot of us this year
This week kicks off my physical electronic and video prototyping for my FYP, I made this little photo last night to show how I feel, im anxious because its all so new to me, but Im excited to get properly stuck into the project and move away from just the conceptual aspect Bring on the build!
This thesis has turned me into a gadget freak altogether, I know I was bad before but now its just crazy!
I had never heard of an Arduinoprior to starting this course, and as part of the installation in the IWAMD in UL, I had to devise a switch mechanism for starting and stopping a Max MSP Audio and video loop. I did it using an Arduino and following the Debounce tutorial to hook up the switch. Arduino is a really simple electronic programming board that you can use to do pretty much anything as simple or as complicated at you like. The site and the tutorials really help and as its the new ‘in thing’ in the world of gadgetry at the moment, there is almost nothing that hasn’t been done yet so theres a tutorial for nearly everything, I stress nearly though, however the programming is simple enough once you get your head around the basics of which I am currently in the middle of!
So I left working with Arduinos for a while only touching on them for workshops and things in college untill now. My Thesis proposal calls for me to hook up an exercise bike to an interactive visual display and currently one of the best options for interaction between the devices is with the Arduino. I started reading up and ordered a few cool gizmoes like an LCD and Ethernet shield and a shiney new 328 Arduino, and Arduino skinny to play with to initially just get my head around the electronics before working on any project specific thing.
Followed a tutoraial to use the LCD and did this
Followed a few more tutorials with some more new gear and a beautiful little LCD Dot Matrix display and got these!
“Menacing Messages from Matrices!”
Then added a potentiometer to controle the speed of the text
So thats all I have for now, eventually I want to devise a way to get all the technology talking to eachother in my FYP, until then ill keep playing and experimenting
As part of this years‘Spirit Store Event‘, we got together to do a live public performance as part of the Contemporary Art in the Public Realm module.
“Púca ar Scáth is a performance art work, designed and performed by the Masters students from UL’s Interactive media and Music Technology programmes.
The name of the work alludes both to the Ghostiness of Catherine Street (and any eventual Spirits in the Store), as well as an assembly of artefacts normally associated with the prevention of aquatic influences due to meteorological conditions often associated with the Midwest of Ireland.”
Performing this was terrifying, there I said it!! It was fun yes, the peoples reactions on the street were hillarious and overall we got a fantastic reaction. especially at one point today (Sunday) where a group of fellas drive past and start ‘beeping’ along to the beat
I was part of the drumming crew and was actually silly nervous, Im just learning hand drumming and have never ‘performed’ before so that was new, either way we went out and did it and had great fun. The umbrella people were amazing, worked really well today and the vibe really grew towards the end of todays performance and everyone started shouting, it was great!
I wont say I put my ‘back’ into the performance, I think my hands would gladly take my backs place after the last couple of days, im really out of practice! :p
Thanks to Mikael for this group shot and of the shot of my ‘FaceDown Ireland’ Pose balancing on the head of my drum! :p
And thanks to Aladdin for these beautiful pictures
Just completed a 3’080 word Literature review for my Masters dissertation, You may Download it here. Im a little angry at myself as I got pretty tired towards the end of the writing and forgot to talk about a previous students FYP Paper from 2001 that I had been given from my supervisor, but its been handed in now, ill know to add it in to the proper write up!! :p
I am so excited about this! As part of my Thesis resarch I have been looking into Google’s Liquid Galaxy, a 20% time project created by Jason Holt. A 20% time project is where Google employees are encouraged to use 20% (One day) of their working week to work on their own personal projects.
Holts idea was an immersive display consisting of 8 screens displaying one landscape, navigated by a flight simulator control where you can freely fly around the planet and travel anywhere in the world or even space.
Holt calls the end result “stunning.”From his blog post: and you can read more on the project there too:
“…all of a sudden, flying around in Google Earth really felt like flying, and exploring the ocean trenches was like piloting a submarine. When you splashed through the sea surface you cringed slightly, expecting to get wet. You could even command your own lander down to the Moon or Mars.”
Anyhow, I was hoping to get in contact with him somehow to find out more about the project as well as hopefully getting my hands on the code to work into my own project if I was allowed. I spoke with my supervisor Mikael and mentioned he had contacts there that mey be able to help but I didnt hold out too much hope as Mikael also mentioned they are busy people and may not check their mails for weeks on end.
However, I woke this morning to a mail in my inbox from Mikael showing a responce to a mail he had sent Google, the reply came from Jason Holt himself saying he thought the project was a great idea as he said:
“I always said I wanted to see galaxies in old folks’ homes, so that people could virtually travel to places they can no longer visit in person.”
He also said in the mail that the code was ok to use and gave an indication to its setup and that if we needed help to let him know and he could see what he will do. I am very excited now to hear back from Holt as this was the one project I was clinging to as its closest to what it is im trying to do in my project. Also this type of thing hasnt been done before as such and trying to find reading material or resourses of anykind has been tough so this is a great bit of news.
Thanks here goes to Mikael and of course Jason for getting back to us, Much appreciated
For Thursday’s presentation we took the topic of ‘Social Exclusion and Accessability’ with relation to Interactive media. You can see the comic intro video below, theres a lot of narration and reading so I left that out and will add a link to the written report in this post a little later.
We took it from the point of view of an ECDL (European Computer Driving Licence) class, where the teacher encounters a new set of students for the year, all of whom suffer some sort of social exclusion or accessibility issue, Poor teacher! (Thanks to Aladdin for the pics!)
There were 5 on the team again, Aladdin who played the Visually Impaired, Colette who played the socially disadvantaged, Gill was the Teacher, Marion the Narrator who had to dredge through a serious amount of reading of laws, statistics and all the reasearch we had done for our individual parts and myself the Old Granny!
Hope you enjoy the video!
also…its getting lonely in here, leave some comments and feedback (Are you still out there!?!)
Here is a look at myThesis Presentation Slides for the talk I had to give in The Principles of Interactive media module of the course, View the video of my talk Here and You will also find a full outline of my Thesis proposalHere, on my course websiteHere, Enjoy
