The computer goes through a complicated process of analysis and produces words to describe its perception of the object, which are then spoken aloud in a slightly mystifying and often poetic sentence.
“By the timely day, the holy castle of the vermillion floc is unceasingly split by the breathtaking pistol under which the enlightenment does harm,” runs one resulting from a shuttlecock-shaped object and pistol.
Very Nervous System, meanwhile, uses cameras, computers and synthesisers to create an interactive space where body movement is transformed into music. The technology Rokeby developed for this work has subsequently been taken up by composers, choreographers, musicians and artists. It’s even being used in music therapy, and is being tested as an activity enabler in the treatment of Parkinson’s Disease.
Rokeby’s experimentation and use of modern technology has led to acclaim in both the arts and technical fields. He has been awarded a BAFTA and twice been honoured with the Prix Ars Electronica Award of Distinction.