I worked on an interactive mixed-reality trailer for Fantastic Beasts: The Crimes of Grindelwald using the Magic Leap One headset. The experience unfolds in front of a simple wall-and-table setup: when you don the Magic Leap and wave your wand, a collection of magical artifacts and dusty tomes materializes on the tabletop, and a crisp cinema screen projects the film’s trailer onto the opposite wall.
Under the hood, I built the application on the Magic Leap platform—leveraging its spatial-mapping and gesture-recognition capabilities—to anchor virtual objects seamlessly to the physical environment. Rather than relying on mobile real-time rendering alone, I integrated pre-rendered, film-quality character animations (using Framestore’s VFX pipeline) into a Unity-based spatial experience. This hybrid approach let us deliver smooth, cinematic sequences on the Magic Leap hardware.
Altogether, the project showcases how you can combine the Magic Leap One’s hand-tracking, spatial anchors, and projection capabilities with Framestore’s pre-rendered assets to create an immersive, movie-driven mixed-reality experience.
Key Contributions
- Learning how to write an application for the Magic Leap AR Headset
- Setting up the calibration phase to make it easier for first-time users
- Creating an intuitive virtual marker placement system to easily change required image tracking target position
Chicago is discovering the magic of #FantasticBeasts in the real world with an exclusive experience powered by #MagicLeapOne at @ATTMichiganAve. pic.twitter.com/S4ss1G8Agb
— Magic Leap (@magicleap) December 23, 2018