Kinectron is an open source tool that brings realtime, motion capture data into the browser. I developed both the application and API with Shawn Van Every under the xStory Experiments in Storytelling Google Research Grant at New York University, which supports experiments with emerging technology in service of new forms of storytelling.
In this Coding Train Guest Tutorial I explain how Kinectron works with Dan Shiffman.
Here I discuss Kinectron at the Volumetric Filmmakers NYC (VFNYC) event at New Inc, November 6th, 2018.
|Coding Train Guest Tutorial|
How It Works: Kinect + Electron
Kinectron has two components—an electron application to broadcast Kinect2 data over a peer connection, and a client-side API to request and receive that data over a peer connection. Kinectron is open source and connects to creative coding frameworks like P5.js and three.js. It is node based, and it builds on the Node Kinect2 and PeerJS libraries.
The application runs on a computer connected to a Kinect 2, a low cost motion sensing camera created by Microsoft. Once started it wirelessly broadcasts Kinect data over a network. It can send volumetric data, skeletal data, and color and infrared images. It can send one or more feed at a time.
Kinectron can be used to broadcast data from one Kinect to many different users.
It can also be used to receive data from more than one Kinect in one place