Why

1- Inspired by new ways to visualize and bring physicality to realtime/ user driven 3D.

2- Alive 3D, users control the world's details.

3- Users understands they have control/ however the control is subtle/ takes exploring to understand.

Essentially we love 3D and are inspired by possibilities of real-time rendering and physical interaction.


https://s3-us-west-2.amazonaws.com/secure.notion-static.com/e6b98ca9-c04e-47b9-9612-139f8597c063/IMG_20191107_131548.jpg

A physical 3D viewing experience that responds to 3 control objects (sphere, cube, & pyramid) and outputs real-time 3D visuals. Visual rendering can be done by a real time game engine (Unity), while data communication and video mapping is controlled with Touchdesigner.

Shown below is an interactive environment using floor projection. We'll track the x,y,z positions of the control objects using the IMU integrated in the Arduino Nano 33 Iot. Visuals will be made of 3D particles with the control objects conducting the flow of these as attractors for the particles. As the user moves/ interacts with these control objects the realtime graphics change color and behavior of the system.

Interactive floor projection

Interactive floor projection

An immersive virtual environment, visible live on set and shot directly in camera. #xRStage #ExtendYourEnvironment #augmentedreality #mixedreality #disguise #TheUltimateResource

Diagrams

Projection + Color

Projection + Color

Top view

Top view

Software communication

Software communication

Potential Rules:

Virtual World Axis.

Virtual World Axis.

Y Interaction:

-Pull up on the cube and it effects the level of abstraction of the projected visuals

-Pull up on the pyramid and it effects the projected shadows

-Pull up on the sphere and the brightness shifts

X,Z Interaction:

Arranging the objects in the space on the x,z changes the directional flow of the particles as well as the color of the scene (playing with the RGB combinations)

Visual inspirations:

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/cb03da9d-2942-4df8-b726-f2deb6f96418/michiel-schuurman-risograph-book-work-publication-itsnicethat-12.jpg

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/5e94c845-f3f0-4ad3-a40e-8fbf45b8d643/marpi2.jpg