3D-aware devices enables new forms of interaction and computer system understanding of the world. In short, 3D perception will give rise to exciting new applications such as self-driving cars, immersive training, multi-player games the integrate the physical and virtual world, and so on.  A critical challenge with 3D sensing is noisy  sensor data and the oversampling and computing required to build robust systems.  These demands exceed the capabilities of even the most powerful of today's mobile devices, for all but crude or low-quality interaction.

We are exploring both computing requirements and modern sensor capabilities, and the use of distributed computing ensembles (multiple devices such as a glasses, smartphone, laptop, desktop, cloud) to meet these requirements.  The Polyceph system is a distributed software layer than enables flexible decomposition and experimentation.   Research questions include:

• What are the requirements of 3D perceptual applications for computing, networking, and data?
• How do these requirements vary with sensor, noise, and scene activity?
• What distributed architectures make sense for 3D perceptual applications?
• What applications are enabled by Polyceph distributed approaches?

---

Publications: