In 2004 I created this completely magical interactive experience called The Butterfly Garden for the Submerge exhibition. Its a memorable interactive illusion that puts digital butterflies all around you. Born in the palm of your hand, the interactive creatures flutter from flower to flower, until they eventually fly off into the ether.

People of all ages can interact with the artificially intelligent 3D butterflies by placing their hands above one of sixteen flowers, growing new and different butterflies in their palms. Entire groups of people can interact with the garden at any time. Just make sure you are gentle and calm though. Just like real butterflies, if you make sudden movements you may scare them away.

I have worked on several different versions of the beautiful butterfly garden.The very first was for the Submerge exhibition in Bristol, surrounding the main entrance with two sets of flowers planted on real grass turf. More recently the piece has been recreated for a Bridal show in Plymouth and a Literary festival in Cornwall.

How does it work?

Hidden into every sunflower is a tiny sensor that can detect the movement of your hand, and the distance and position of your hand. As you hold your hand out gently, the intelligent butterflies sense your position, and fly towards you. If you spend enough time playing, you can be surrounded by beautiful creatures.

How was this made?

I had been working with sensors and a computer control system that I wired and designed myself during my time on my degree. The sensors were really delicate and super-sensitive, so I had to find the perfect use for them. I wanted to create an interaction that was light and delicate and delightful. Luckily, Submerge approached me and asked me to create something along the theme of ‘organic/synthetic’ and the ideas just went together beautifully.

Thanks to Submerge

I had such a great time working with Cadbury World on projects like Chocolate Rain that I was thrilled when they, along with Newangle, asked me to work on a new interactive project for the historic Cadbury Collection.

The Story

Cadbury doesn’t just make great chocolate, Mr Cadbury also designed and built most of area surrounding his factory. He provided houses for the workers, schools, playing fields, sports clubs, and all sorts of other things to make life in Bournville a happy and healthy place to be. Cadbury world wanted to share the idea of building your own, virtual town, and see what it would be like in the future.

The Idea

I was tasked with programming a new interactive game that would take place on a giant interactive table. The game would be a lot like Sim City, where players would create housing, roads, schools, pubs, power plants, and pretty much everything else that you need to build a thriving city. But this game had a twist. Not only did you have to work against time and budget constraints, but you had to work with 3 other friends to help build the city. That means its a 4 player sim city! A very challenging thing to program indeed! But it was a lot of fun.

Each player takes a different side of the table, and must place different buildings down before the time, and the budget run out! Players must work together to make sure that everything is in the right place, as different players will be given different options, keeping the game fast paced and exciting.

Hidden Sensors

Underneath the table were hidden tiny electrostatic sensors that could detect players hands as they waved them over the table. This allowed for fast, large-scale gameplay. Simply by placing your hand on the giant map, a building would be placed under your fingertips.

The average game time lasts around 3 to 4 minutes, and once the buildings are placed in literately thousands of different configurations the camera “zooms out” and shows a realistic view of what that city would look like in 25 years time.

Will it be a thriving metropolis, or a dead end, crime ridden town? Only by working together will you get to find out.

I programmed all the software and the game mechanics, and Electrosonic provided the hardware. The concept was brought to life by Newangle, and Mark Dowsett created the various graphics and hundreds of icons that were used in the game.

Hyperfabric is one of my all time favourite inventions. I created it as a beautiful art installation that would allow people to go beyond the screen, with a new tactile interface. I came up with the name “Hyperfabric” because I wanted to suggest that new things could be combined in interesting ways. Hyperfabric  is a touchable, pushable, movable, malleable interface that uses a very thin film to simulate an immersive user interface.

You can press, grab, twist, punch and play with the screen. It can even support your full bodyweight. The Hyperfabric screen is specially designed to communicate with a computer to generate interactive computer graphics, in realtime.

Pushing through the image

I created digital images that are projected onto the film that react to touch and pushing, so it feels like you’re actually pushing through the image.

I created a 7 foot high Hyperfabric installation for the Artytechs parlour this summer at the Port Eliot literature festival. Taking place in a hidden dungeon underneath the stately home, where visitors had the chance to come face to face with the magical and mysterious interactions.

How does Hyperfabric work?

The design of hyperfabric is actually very clever. The strong rubbery surface is stretched over a doorway that leads to a hidden room, in fact an underground dungeon of sorts. Hidden in the room is a projector, for the images, and a specially modified camera. Infra-red light is shone across the surface of the hyperfabric, so that the camera can see exactly what parts of the hyperfabric are being touched, and how hard they are being pressed. By measuring how the light is reflected, special computer software that I wrote can instantly detect peoples presence.

This hyperfabric of course has “multi touch” capability, but it also has a magic power to it as well.

Hyperfabric works with aura?

During the installation, guests would be invited down to the underground dungeon, and would place their hands on the hyperfabric surface. One girl touched it, and yellow sparks shot out from her fingers. She then told me that she “charged up her aura” and the next time she touched it, red and blue sparkles dripped from her fingers instead.

I love it that Hyperfabric is able to create a totally new way of interacting. There is no keyboard and no mouse, no instructions, just emotions. Currently we change graphics by clicking a mouse, but here, guests were able to change graphics by charging their aura!