CUBE V3

Cube v3 is a multi-user AR and VR simulation that allows fans to enjoy virtual Deadmau5 concerts on their phones or AR and VR headsets.

In December 2019, I pitched Joel Zimmerman (Deadmau5) on the idea of a virtual concert platform that would allow him to perform for international audiences while he simultaneously performed live at concert venues and stadiums.

In light of the threat caused by COVID-19, we got to work prototyping various features that linked his physical stage and home studio to a virtual, multi-user simulation. During this process we had a couple of goals:

1. Link the output of his touring Touchdesigner and Ableton Live projects in real-time to Unreal Engine.

2. Be able to replay his sets with sample accurate timing and scrubbing through a timeline after a performance for a “replay.”

Ultimately, we accomplished both goals. We were able to integrate Microsoft’s Mixer streaming solution, as well as ingest HAPS-encoded video files inside of a virtual arena environment (provided by the folks at Bluehole/PUBG Corp.). Coal Car Studio provided some expertise and built an initial prototype system in Unity to ingest cvar files from TouchDesigner and audio encoded by Ableton Live to allow full replay and scrubbing after the performance that we ported into Unreal Engine 4.

I have since added additional functionality such as BPM-synced dancing for simulated crowds, VR and FPS Controls, as well as AR features to view the stage and performance in the user’s living room through both a mobile phone and Magic Leap headset.