Kinect to HoloLens scanning with RoomAlive
On the Coding4Fun blog, we’ve been doing a theme week focusing on projects related to last week’s Hardware announcement. After seeing this project, I thought it cool to continue the theme here too.. 🙂
Roland Smeenk shared this great project, that just looks awesome…
Rebuilding the HoloLens scanning effect with RoomAlive Toolkit
The initial video that explains the HoloLens to the world contains a small clip that visualizes how it can see the environment. It shows a pattern of large and smaller triangles that gradually overlay the real world objects seen in the video. I decided to try to rebuild this effect in real life by using a projection mapping setup that used a projector and a Kinect V2 sensor.
Prototyping in Shadertoy
First I experimented with the idea by prototyping a pixel shader in Shadertoy. Shadertoy is an online tool that allows developers to prototype, experiment, test and share pixel shaders by using WebGL. I started with a raymarching example by Iñigo Quilez and setup a small scene with a floor, wall and a bench. The calculated 3D world coordinates could then be used for overlaying with a triangle effect. The raymarched geometry would later be replaced by geometry scanned with the Kinect V2. The screenshot below shows what the effect looks like. The source code of this shader can be found on the Shadertoy website.
…
Projection mapping with RoomAlive Toolkit
During Build 2015 Microsoft open sourced a library called the RoomAlive Toolkit that contains the mathematical building blocks for building RoomAlive-like experiences. The library contains tools to automatically calibrate multiple Kinects and projectors so they can all use the same coordinate system. This means …
Bring Your Own Beamer
The installation was shown at the Bring Your Own Beamer event held on September 25th 2015 in Utrecht, The Netherlands. For this event I made some small artistic adjustments…..
[youtube http://www.youtube.com/watch?v=A4DQiV49_s8&w=425&h=355]
…
Project Information URL: http://smeenk.com/hololens-scanning-effect/
Contact Information:
Follow @CH9
Follow @Coding4Fun
Follow @KinectWindows
Follow @gduncan411
