KinectHacks.net

DUO Project from the NUI Group needs your help !

Ben Kuper — Thu, 18 Apr 2013 18:50:38 +0000

Hello,

it’s been a while since anything has been posted here.
And yet, the NUI Community has never been so productive and involved than today !

If you didn’t hear about the DUO Project, i like to think of that as the golden child of the Kinect and the Leap Motion.

Code Laboratories one again created the true Open Source product that is the result of the past few years research and development in the 3D sensing field.

Click here to view the embedded video.

http://www.kickstarter.com/

Unfortunately, there is only 6 days left on the Kickstarter, and they only have done half of the goal… If you feel like you would enjoy such a device, feel free to back the project, and share it to all your friends !

Next Generation Kinect for Mobile Devices (Current Smartphones, Tablets & NBs)

Sky Chen — Fri, 05 Apr 2013 10:33:02 +0000

According to ABI Research’s report, it is projected that over 600 million mobile devices will be produced with vision-based behavior recognition features in 2017. However, there are still several technical problems need to be solved with these features first:

1. Under Different Lighting Conditions

2. Interferences From Moving Backgrounds

3. High Power Consumption

4. Large Size of the Mobile Device Itself

5. Double BOM Cost for the 2nd Camera (For color video calling and color vision sensing)

This technology solves these problems above for tablet PCs and mobile phones.

Two Implemented Applications:

The team solves the mentioned problems for tablet PCs and smart phones and has implemented 2 applications as below:

1. It successfully replaces Slide-to-Unlock patent from Apple.

2-1. No interruptions from the power-saving setting (It will turn off the backlight frequently) for long-time using circumstances. Such as watching a movie, reading a book, checking the stock market or reading a map on the mobile device.

2-2. A great deal of power can be saved from our module, as the screen from the device will be turned off immediately once the user is away. It also saves the power from using the video applications that are with Auto-play settings.

(2-1. & 2-2. also like Samsung S4′s Smart Pause and Smart Stay combined)

Introduction video:

Click here to view the embedded video.

█ Power Consumption: 0.1444mW (Mass product edition, not prototype in video; By the way, Kinect is 13200mW):
According to the 2 major applications: To read and to unlock, the module only will be turned on immediately once it detects the user (the operation rate is really low) and it will be always off for the rest of the time when the device is not being used.

Take reading for example. The backlight timeout preset time of the most popular 10-inch iPad is 5 minutes and the backlight timeout preset time of a 7-inch Samsung tablet is 30 seconds. Our module only takes 0.1 seconds to operate, the operation rate is only 0.0222%, and the power consumption is only 0.1444 mWh. Imagine how much power our module can save from those settings.

█ Power Consumption of the Display Backlight:
Take 7 to 10 inch tablets that are released in the market recently for example, there are about 20 to 36 backlight LEDs in those tablets. When the tablet is not being used but the backlight is still on, the power consumption from all those backlight LEDs can be assumed as how much power we can save by using our module. Furthermore, our module only uses 1 to 2 LEDs, it only detects in every 15 seconds or 2.5 minutes and it takes only 0.1 seconds to operate.

█ Power Consumption from the Power Button:
According to Sony’s research, people press the power button 76 times a day on their phones. If people use their phones 15 hours a day, the button would be pressed 5 times an hour. According to the regular using habits, if people forget to press the power button to turn it off after using their phone twice an hour, our module can save more than 923 times power that is consumed from a 10 inch LCD screen.

Our previous work: http://www.kinecthacks.net/using-1-camera-to-integrate-live-foreground-fake-background-in-real-time/

Sky Chen’s LinkedIn: tw.linkedin.com/pub/sky-chen/67/489/80/

Use Kinect for live interaction events

Dmitry Burov — Tue, 15 Jan 2013 12:05:08 +0000

This project comes from the idea of testing Kinect in two different kind of application:

Use the motion capture to create a common base for ten various style by tools like Thinking Particle and Real Flow.
Use Kinect for live interaction events as creating an indigame with C4D.

KINECT PROJECT – I DIECI

Click here to view the embedded video.

KINECT PROJECT – MAKING OF

Click here to view the embedded video.

KINECT PROJECT – BACKSTAGE

Click here to view the embedded video.

More here.

Point 2 Paint

Dmitry Burov — Tue, 08 Jan 2013 13:30:36 +0000

Mess free finger-painting using Kinect.

Click here to view the embedded video.

Installation created by Hatchd and Adapptor for Brookfield Place Perth uses the power of Microsoft Kinect to make fingerpainting 100% mess free. Kids (and adults alike) can forget the smock, step into the paint booth and move their hands in space to select and apply colours. Their daubs, strokes and splodges are projected onto the canvas in front of them, and when they’re finished become part of a collaborative mess-free masterpiece.

Live Interactive Virtual Environment

Dmitry Burov — Tue, 08 Jan 2013 13:12:38 +0000

Training demo to see how Organic Motion LIVE uses advanced motion capture technology to transform a single role-player’s performance into multiple live projected digital animated characters within a highly interactive training scenario.

Cost-effective, real-time, powerful, immersive and easy to use.

Click here to view the embedded video.

More here.

Finally a real live kinect AV peformance

Dmitry Burov — Fri, 21 Dec 2012 09:00:48 +0000

Ethno Tekh is a collaboration between Brad Hammond and Chris Vik, in a motion-controlled, A/V act. Performances are totally live, using the Kinect, Ableton Live and a number of custom tools built in Unity3D and Max/MSP/M4L.

Click here to view the embedded video.

Ethno Tekh is a dubsteppy AV performance with a flow of beats and images. Now, we’ve heard all the criticisms of Kinect as musical controller – its fairly high latency and broad gestures mean it can’t quite compete with acoustic instruments or more sensitive physical controllers. But in this case, it seems the performance techniques evolved before the Kinect in a way that suits it perfectly. If you are going to make big, sweeping changes to filters, modulation, and overall musical gestures, why not do it like this? Somehow, the physical expression seems to match the music, better than exaggerating twisting a knob would.

Just be prepared to get physical and bare your arms.

More here.

Kinect Face Tracking demo – Skulls App

Dmitry Burov — Thu, 22 Nov 2012 10:57:38 +0000

Click here to view the embedded video.

Paradox D&D wanted to take the opportunity to try the new features that Kinect provides. This time, Face-Tracking.
With this excuse, we developed “Skulls”, an aplication with Face Tracking which positions a 3D skull and replaces the user’s head. In addition to Face Tracking, has also been used the video capture image to provide a “natural augmented reality”, using the user’s own body for referencing 3D models.

The Skulls application provides 3 types of heads options: skull bone, skull radiography and skull in flames (based on Ghost Rider’s comic). Furthermore, a controller is added to the user’s mouth so that it can open and close the skull’s jaw. This application is an example of a new technology that offers many possibilities and is in the line of “virtual dressers” (in which the user “wears” 3D elements: dresses, costumes, accessories, etc..).

For more information and demos: www.pdxstudio.com

Drawing a Happy face

Dmitry Burov — Tue, 20 Nov 2012 08:53:42 +0000

Click here to view the embedded video.

For this application we use Kinect-based sensor system to draw a happy face and some others shapes. They can be draw on the air without a pencil; only using your hands, and depending on your pulse as well.
We are using Labview to process the image and to drive the sensor system. This work is being developed at the Instituto de Investigacion en Comunicacion Optica (Universidad Autónoma de San Luis Potosí), Mexico. These are the first tests and we’ll upload more results soon, mainly those based on tactile skills and many more applications!
Thanks are due to Ryan Gordon @ ryangordon.net.

metoso – the interactive dance performance

Michel Winterberg — Sun, 21 Oct 2012 21:18:26 +0000

Click here to view the embedded video.

“metoso” is an interactive audio-visual media installation developed by the media artist Michel Winterberg.
The dancer and choreographer Heidi Köpfer creates a dialogue with this installation in “tension” between sound and movement. After the performance, the audience has the opportunity to explore the installation themselves and to discuss with the two artists.

First performed on 29th July 2012 in Werkraum Warteck pp, Proberaum Cirqu’enflex, Basel Switzerland.
Programmed with Max/MSP/Jitter and the Kinect controller.

Michel Winterberg: www.michelwinterberg.ch
Heidi Köpfer: www.tanzbuero-basel.ch (Tanzschaffende)
© 2012

Camera: Julian Gresenz
Editing: Julian Gresenz, Michel Winterberg, Heidi Köpfer
Title image (video still): Rolf Bürgin

Thanks to: Florian Giraudel, Diana Pfammatter, Rolf Bürgin, Franz Bannwart, Daniel Gaudey, Claude Winterberg, Kaserne Basel, Cirqu’enflex

For booking, please contact www.michelwinterberg.ch

Unity3D Virtual world and Kinect

Dmitry Burov — Fri, 05 Oct 2012 12:04:53 +0000

AFTER-MOUSE.COM offers you a totally new experience thanks to the motion sensing technology of Kinect™ for Windows® powered by Windowsreg; 7/8!

Click here to view the embedded video.

AFTER-MOUSE.COM will develop your custom made Kinect™ for Windowsreg; application to suit whatever requirements you may have. Whether you’re looking for a retail solution to showcase your products, or an entertaining interactive experience to engage your customer, AFTER-MOUSE.COM can design what you need. The Kinect™ for Windows® sensor enables you to “simulate touch” through simple movements and gestures. There’s no need to touch a device, you simply need to move: you are the controller!

This new technology does away with the need for a touch screen: you can interact at a distance with any television (connected to a Windows® 7/8 PC) simply by moving. This natural and intuitive technology opens up unlimited possibilities, helping you cut costs dramatically, as the only hardware needed is a conventional display device (screen, projector, etc.), a Windows® 7/8 PC and a Kinect™ for Windows® sensor. Users have complete freedom to interact with the display device, whether it’s right beside them or behind glass. As no contact is required, it’s a completely hygenic product and particularly well suited to fields such as healthcare, or as a unique communication and display tool at events, trade shows, or anywhere!

Source

Note for the hack “Surgeon Assistant”

Dmitry Burov — Fri, 14 Sep 2012 12:44:46 +0000

Click here to view the embedded video.

Surgeon Assistant : one of the fields that kinect can be useful is in medical uses . when the doctor or surgeon needs to access documents and scans of patients in the middle of a surgery . In normal situations surgeon has to access the documents and scans by his hands or review them with a mouse and keyboard on the computer , and doing so will force the surgeon to go through sterile process again . This hack enables surgeons to review patients documents and scans without having to use their hands and save time and energy on surgeries .

Mojtaba Tabatabaie

www.smtabatabaie.com

Explore a cave in a CAVE using a kinect driven flashlight

Dmitry Burov — Wed, 05 Sep 2012 11:59:50 +0000

Hi,

I’ve put a very short video on youtube of our latest project with the kinect.

Click here to view the embedded video.

In this setup the kinect is used to track a uses hand that directs a virtual flashlight. It was a challenge because the kinect is looking at a steep angle down on the user.

The room itself is a CAVE, a four-sided projection system where users experience a holographic like environment. (if we were to show a virtual table and you would bend your knees, you would automatically see underneath the table). In this particular project the imagery is of a cave that temporally has been excavated by archeologist.
Now, with the virtual flashlight they can explore it again at any time.

Frans

Chalearn Gesture Challenge Winner (1st Place) at CVPR

Dmitry Burov — Tue, 21 Aug 2012 13:01:19 +0000

The technology developed at Sigma R&D can detect your fingers using a depth sensor. The individual directions of your fingers can be tracked, which allows you to use your hand as an advanced controller. For instance, a bare hand can turn into a virtual light saber.

Click here to view the embedded video.

The technology can also be used to interpret the shape of your hands using a depth sensor. For instance, sign language gestures can be translated in real time. the users can type without a keyboard, or give commands to applications such as games.

Click here to view the embedded video.

The system can determine the direction of the light saber by analyzing your hands. If the thumb is extended, the light saber is on. Otherwise, the system turns the light saber off.

The system analyzes the interactions between hands. This enables the user to switch the virtual light saber between hands.

The same technology is used by Sigma R&D to create other virtual devices, such as a virtual joystick, mouse and driving wheel. For instance, you can use your left hand as a joystick, and your right hand as a mouse, and play many different games with your bare hands.

NumHop – A multi-sensor interactive playful learning game

Dmitry Burov — Tue, 07 Aug 2012 13:19:14 +0000

NumHop is a prototype game of physical interaction,developed around the concept of embodied learning.

Aim of the prototype is to study the potentials of modern motion capture and body sensors technologies in educational games, involving human body in the learning process, and assisting the development of basic social skills like self and others awareness.

The prototype was developed as part of my master thesis at the Vrije Universiteit Amsterdam, and my internship at Waag Society.

Click here to view the embedded video.

NumHop features the Microsoft Kinect, Neurosky Mindwave EEG sensor, and Zephyr HxM ECG sensor.
It was developed using Unity, cinder, OpenNI and OSC

DISTOPIC Dancing is forbidden

Dmitry Burov — Tue, 07 Aug 2012 13:07:03 +0000

Click here to view the embedded video.

Yet another use of the Kinect for an interactive dance show! In our work, we use two Kinects to analyze the skeleton of the dancer and trigger media events (video, sound, lighting, etc.). Both of the Kinects are running in different computers and are connected over an ethernet wire using OSC. Additionally, we have hacked CD trays in conjunction with Arduino+Processing to build our sound space. You could visit www.distopic.es for a tutorial on how to set up the two Kinects and, as well, you can find lot of info about the whole creative process.
The show will have its premiere on Seville at the end of the year.

DISTOPIC. DANCING IS FORBIDDEN
info@colectivomalab.org
www.distopic.es

DirActNI – Imagine a virtual world, directly controlled by your body!

Dmitry Burov — Tue, 07 Aug 2012 12:53:07 +0000

Hey over there!

I developed as technical part of my Master Thesis in Computer Sciences the DirActNI framework (Direct Acting Natural Interface) for the implementation and evaluation of contactless (whole-body) 3D interaction techniques based on depth sensors like the Kinect.
The DirActNI framework provides the possibility of a natural and immersive whole body interaction in virtual environments. The user controls the environment directly and totally contactless to any physical controllers or sensors.

You can watch the video on Youtube:

Click here to view the embedded video.

Or see more information on features and use cases at:
http://www.DirActNI.de

I hope you like it.

Alexander Dridger

Kin-Hackt Body Instruments Collection – Arms (Ableton Live and Kinect)

Dmitry Burov — Mon, 30 Jul 2012 10:00:43 +0000

This is one of the Body Instruments designed by Adriano Clemente for his project Kin-Hackt.
This performance is one extract from the “Composition for Five Bodies and Kinect”.

Click here to view the embedded video.

This is achieved with a 3D sensor (Kinect) able to map the joints of a human body, then tracking their movements which are translated to musical impulses.
My art project is based on the idea of the body itself as the ultimate instrument of expression and communication, without the use of any other objects to hold, wear or touch. Interacting directly with a virtual sound-space, the essence of the expression is contained in the movement.

The person performing is the composer, the music player, the instrument and even the orchestra.

The possibilities of this new “instrument” are limited only by ones imagination.

Adriano Clemente, NY

www.adrianoclemente.com

V Motion Project and BiKinect Roadmap

Ben Kuper — Sun, 22 Jul 2012 08:45:13 +0000

Paul Sanderson contacted me in February for a big project, because he wanted to use BiKinect in it. We shared a few mails and after some explanations, he was ready to create something really cool.

Actually, my soft wasn’t enough so he modified it a bit and added a complete new kinect/software systems for the visuals.
Check out the video and here’s a link to an interesting article on how this was done : http://fugitive.co.nz/v-motion-project-tech-how-we-built-it

Click here to view the embedded video.

Paul contacted me just after the video was released, and after seeing what he did, coming from my software, i got really motivated to get bikinect on tracks again (i had to stop the development for professional matter).
With new access to the kinect from other languages, i will port the software and make it more usable for everyone. The builder is also being reshaped and released openSource.

In the meantime, enjoy the V Motion Project !

Eurocup 2012 Game

Dmitry Burov — Thu, 19 Jul 2012 08:32:07 +0000

Click here to view the embedded video.

Because of the Euro Cup, Paradox D&D, in conjunction with BHB Group, has developed an application that exploits Kinect technology. This is a game that allows the user to become a goalkeeper whose objective is to stop as many balls as possible. Then, the player receives his deserved award. Euro Cup appears in his hands.

The system recognizes the user height and uses this information to adapt the dificulty of the game to the age of the player. Among other surprises, the application takes two photographies of the user. The first one while playing as the goalkeeper and the other when showing the Euro Cup. Such photographs may be downloaded from facebook at the end of the day.

This application takes advantage of the possibilities of kinect as a Natural Interface, as well as an Augmented Reality tool. Users play with their own body, thus no markers are needed.

You are invited to try the game if you have the chance to go to the Nueva Condomina Mall (Murcia).

http://pdxstudio.com

Hand-skeleton recognition in depth images

Dmitry Burov — Thu, 19 Jul 2012 08:16:40 +0000

After the creation of TipTep Mouse, our team decided to create software which would allow us to recognize the skeleton of the hand (with the hand not being further than 3m away from sensor) using new generation of depth sensors.

Click here to view the embedded video.

We are now able to recognize the skeleton of the human hand in a real time.The skeleton of the hand can also be recognized even when it’s in close proximity to the body. On this basis we are planning on creating a system which will allow us recognize static and dynamic hand gestures, similar to those used in sign languages.

More here.

Vahagn