Envisioning Holograms (1)

Design Breakthrough Experiences for Mixed Reality — M.Pell

Today we are going to talk about this book — Envisioning Holograms. Holograms are digital representations of literally anything we can imagine blended into our physical spaces.


Fragments is an adventure game published by Microsoft — Experience compelling new possibilities for storytelling and gameplay when life-sized characters are aware of your presence, share your real space and interact with you in mixed reality.


  • Adapts to the room size
  • Room Solver AI
  • World-aware characters
  • Emotional storytelling

The interesting part of Holograms is we know that holograms are not real — just as most audience members realize the magician on stage has just tricked them through misdirection. Yet momentarily, we are all fooled into believing an amazing feat has been accomplished right in front of our eyes.

One thing you will probably notice about holograms is they are fundamentally a contradiction. Clearly digital, but uncannily real at the same time; life-sized, yet re-sizable. Responsive, but not live. Within reach, but not touchable. They are right there, but elusive. Holograms are like unicorns in that way.

Emotional Response

Another fascinating aspect of holograms is they cannot help but elicit an emotional response in people. They appear to co-exist in our space and our minds simultaneously, which triggers an unexpectedly personal connection.

Manageable Immersion

Unlike a virtual reality experience that completely immerses you in an encompassing digital world, mixed reality keeps you anchored to the real world by blending holograms in with the physical objects you naturally see around you. While VR acts as a transport mechanism to take us into self-contained worlds, mixed reality is an augmentation of the real spaces we reside in. Being anchored to the real world makes mixed reality much easier to stomach for many people.

Microsoft Hololens

Microsoft Hololens — the ability to see lifelike 3D holograms — the first holographic computing device ran on a custom Holographic Processing Unit (HPU) chipset, included Wi-Fi connectivity, built-in spatial sound, and rechargeable battery.

Microsoft Hololens, the world’s first self-contained holographic computer.

Magic Leap

The Magic Leap One is an augmented-reality headset, using light field display.

Apple ARkit

Build unparalleled augmented reality experiences for hundreds of millions of users on iOS — the biggest AR platform in the world. With ARKit 2 on iOS 12, your AR apps can now be experienced by multiple users simultaneously and resumed at a later time in the same state. You can also incorporate real-world objects into your AR experiences, giving your users even greater immersive opportunities. Viewed through the screen of an iPad or iPhone initially, the ARKIt uses the device’s camera, sensors, and custom software to match and integrate these AR objects quite realistically.

Key Innovations:

  1. Optics: Through the remarkable process of projecting light into your line of sight in real-time, advanced hardware and software render holograms in such a way that our eyes treat them the same as any object we see normally.
  2. Sensors and Cameras: A hologram’s natural environment is the real-world space that we inhabit, not the confines of a flat-screen. That means the devices and operating systems needed to create and power holograms require collections of sensors and sophisticated software to scan physical spaces in real-time to orient the holograms properly.
  3. Sound: Holographic devices can sample the world around the participant with a sensitive microphone and in turn render 3D surround sound that simulates your current space accurately.
  4. Input: The means for controlling interaction is made possible by sensor arrays detecting movements, gestures, and voice commands that serve as the primary means of controlling the experience.
Ready to dive into the metaverse? Start Free For 7 Days.