I’ve continued playing with projectors on the surfaces of architectural designs. (In Blender). As I’m trying to texturise 3d Models with online media (most likely screen captured videos of news channels), I’ve been testing its potential. These are the second round.
I’ve managed to create and test a few Oculus Rift environments. They are crude, but they worked well. It hasn’t proved too difficult to implement the head tracking which is positive for future projects.
It was a great opportunity to experiment with the kit. Thank you Alejandro!!
They are impressive. The only downside in my mind is the screen resolution, but given certain company’s recent successes with 4K (and higher) screen resolution, hopefully it’ll be better on the commercial release.
Below are two videos of the experiences. No.2 was significantly more successful than No.1
This ‘smart space’ helps look at a world without devices. The concept of the work was to create an interactive, augmented experience without a device-based equipment. The environment senses a plastic sheet and projects personalised messages onto it whilst you move around the space. The image on the wall has a variety of games that allow you to interact with the technology. I can only imagine that its very freeing to have this interaction with technology, without holding a device. Probably as freeing as the Nintendo Wii’s first release.
Considering my interest in VR, AR and now MR (Mixed Reality), its good to see concepts around digital-physical augmented space without the use of devices. Perhaps this is a better progression from anti-social personal computing to open source sensor based environments. Or maybe a mix between the two? Who knows!
Photos, Articles and Video link below……
NO_THING – An infrared light framework that turns (almost) anything into a device
“We get to do a lot of thinking about the future of interaction,” says Milla & Partner’s Ingo Wörner, who together with Fabian Fuchs spearheaded NO_THING’s in-house development. Having realized award-winning exhibitions, show rooms, and trade shows, their team knows the limitations of the current generation of smart spaces all too well. “We were frustrated with solutions available to us at the time. While the arrival of audio guides, VR, AR or tablets has dramatically improved how contextual information can be accessed within a space, they create largely solitary, device-driven experiences; devices that have to be lugged around and that distract as much as they reveal,” says Ingo. Another problem is technology itself: devices age quickly (particularly when they go through many hands), require maintenance, and updates. With NO_THING, Ingo and Fabian tried to get rid of the technology altogether (they describe the experience as “close to NO_TECH”) by taking full control of the environment. “We wanted to create a smart space that is aware of my presence and that provides relevant information when and where I need it, without me having to carry around any equipment, punch in numbers or navigate a screen. To achieve that we use nothing but light — visible and invisible.”
To project onto a moving target, which is what NO_THING does at its core, the team first built prototypes with Kinect systems, openFrameworks, ARToolKit and OpenCV. To increase tracking precision, stability and overall performance across different light settings, NO_THING now uses IR (infrared) light, OptiTrack motion capture cameras (with in-camera blob tracking) and IR-reflecting foil for the markers. The tracking data can be accessed via a Node.js-based andSocket.IO-connected tracking server and allows a wide range of interactions – from tilting, rotation, and gestures, to movements and accessing pre-defined hotspots. The 3d projection mapping onto the tracked cardboard ‘devices’ is done in Pandoras Box (a commercial media and show control system) using a webkit layer as texture. The advantage of the latter: all content and interaction can be built and delivered with standard web technology.
A ‘holodeck’ degree of freedom demands a lot of the tracking and projection. NO_THING currently performs at an impressive 60 frames per second (a latency of 3 to 4 frames is largely intentional to ensure a stable image) and with a ‘device’ angle of up to 80 degrees. Additional sensors on the device would increase the tracking precision even further.
“Given the trend towards miniaturization and mobility of projection technology and seamless connectivity there’s an infinite potential for meaningful mixed-reality applications,” says Fabian about NO_THING’s future. From deploying the next generation display and lighting technology (miniature LEDs, lasers) to interfacing with ‘always on’ devices to the prospects of taking NO_THING outside of “controlled environments” and to the street — “It is as if the future has met us halfway.”
For now, the project’s biggest feat remains the manifestation of the interface. “The surprise transformation of a simple piece of cardboard without any electronics into an interactive device is magical. It gets me every time and personally, it’s what I appreciate the most,” says Fabian. “And while the commercial applications, as evidenced by our Expo 2015 use case, are myriad, I’d really like to see an artistic take on it, maybe as part of an installation or performance.” So do we.
NO_THING’s Expo Milano 2015 setup was developed together with Jan Hüwel of coolux (producers of Pandoras Box).