1.

Introduction
Microsoft HoloLens, known under development as Project Baraboo, is a pair of
mixed reality head-mounted smartglasses developed and manufactured by Microsoft.

HoloLens is essentially a holographic computer built into a headset that lets you see,
hear and interact with holograms within an environment such as a living room or an
office space. It is based on Augmented reality, Augmented reality (AR) is a live
direct or indirect view of a physical, real-world environment whose elements are
augmented (or supplemented) by computer-generated sensory input such as sound,
video, graphics or GPS data.

The history of augmented reality can be traced back to 1990 and work undertaken by
Professor Tom Caudell as part of a neural systems project at Boeing. This project was
focused upon finding new ways to help the company's engineering process and
involved the use of virtual reality.

Augmented reality is the blending of virtual reality and real life, as developers can
create images within applications that blend in with contents in the real world. With
AR, users are able to interact with virtual contents in the real world, and are able to
distinguish between the two.

Virtual Reality or Virtual Environments is a computer simulated environment that

gives the user the experience of being present in that environment. It is a 3-
Dimensional computer generated environment. VR provides the effects of a concrete
existence without actually having a concrete existence. VR not only provides
immersions of vision but also of sound and tactile feedback. Basically, VR is a theory
based on the human desire to escape the real world boundaries and this is done by
embracing the cyber world. It is a new form of human machine interaction that is
beyond keyboard, mouse or even touch screen for that matter. It is a means by which
one can interact with full visual immersion.
 2. 3D Holographic Technology

Holography is a diffraction-based coherent imaging technique in which a complex

three-dimensional object can be reproduced from a flat, two-dimensional screen with
a complex transparency representing amplitude and phase values. It is commonly
agreed that real-time holography is the ne plus ultra art and science of visualizing fast
temporally changing 3-D scenes. The integration of the real-time or electro-
holographic principle into display technology is one of the most promising but also
challenging developments for the future consumer display and TV market. Only
holography allows the reconstruction of natural-looking 3-D scenes, and therefore
provides observers with a completely comfortable viewing experience.
A HoloLens will use holographic technology to project large-scale, high-resolution
images onto a variety of different surfaces, at different focal distances, from a
relatively small-scale projection device. To understand the technology used in
HoloLens, we must understand the term Hologram, and the process of making and
projecting holograms. Holography is a technique that allows the light scattered from
an object to be recorded and later reconstructed. The technique to optically store,
retrieve, and process information. The holograms preserve the 3-D information of a
holographed subject, which helps to project 3D images.

2.1. Holograms
A hologram is a physical component or device that stores information about the
holographic image. For example a hologram can be a grating recorded on a piece of
film. It is especially useful to be able to record a full image of an object in a short
exposure if the object or space changes in time. Holos means whole and graphein
means writing. Holography is a technique that is used to display objects or scenes
in
three dimensions. These 3D images are called Holograms. A Photographic record
produced by illuminating the object with coherent light (as from a laser) and, without
using lenses, exposing a film to light reflected from this object and to a direct beam
of coherent light. When interference patterns on the film are illuminated by the
coherent light a three-dimensional image is produced.

3. Advantages of Holographic Projection

The interest in 3D viewing is not new. The public has embraced this experience since
at least the days of stereoscopes, at the turn of the last century. New excitement,
interest, and enthusiasm then came with the 3D movie craze in the middle of the last
century, followed by the fascinations of holography, and most recently the advent of
virtual reality. Recent developments in computers and computer graphics have made
spatial 3D images more practical and accessible. Modern three-dimensional (3D)
display technologies are increasingly popular and practical not only in computer
graphics, but in other diverse environments and technologies as well. A concurrent
continuing need is for such practical autostereoscopic 3D displays that can also
accommodate multiple viewers independently and simultaneously. A particular
advantage would be afforded if the need could be fulfilled to provide such
simultaneous viewing in which each viewer could be presented with a uniquely
customized autostereoscopic 3D image that could be entirely different from that
being viewed simultaneously by any of the other viewers present, all within the same
viewing environment, and all with complete freedom of movement therein. A high
resolution three dimensional recording of an object. Another feature is that these are
glasses free 3D display. This 3D technology can accommodate multiple viewers
independently and simultaneously, which is an advantage no other 3D technology
can show. The 3D holographic technology does not need a projection screen. The
projections are projected into midair, so the limitations of screen are not applicable
for 3D holographic display.

3.1. Microsoft HoloLens

HoloLens is essentially a holographic computer built into a headset that lets you see,
hear, and interact with holograms within an environment such as a living room or an
office space. Microsoft has built the headset without the need to be wirelessly
connected to a PC, and has used high-definition lenses and spatial sound technology
to create that immersive, interactive holographic experience.

The HoloLens comes with semitransparent holographic lenses which 'generate multi-
dimensional full-colour holograms'. That means it's not going to be projecting images
into a room that everyone can see. It's cutting edge stuff, but it's not quite that
advanced yet.
Basically HoloLens is a high-tech computer system that can be wearable and works
according to your gestures with hands, eyes, etc.

Fig. 3.1 (HoloLens)

As seen in above fig. 3.1, That is actual picture of wearable augmented reality from
Microsoft named by HoloLens. This is the first holographic computer which is
running on Windows 10. It is completely unattached as no wires, phones or
computers needed, it is a computer itself.

The premier device for Windows Holographic, Microsoft HoloLens is a smart-glasses

headset that is a cordless, self-contained Windows 10 computer. It uses various
sensors, a high-definition stereoscopic 3D optical head-mounted display, and spatial
sound to allow for augmented reality applications, with a natural user interface that
the user interacts with through gaze, voice, and hand gestures. Codenamed "Project
Baraboo," HoloLens had been in development for five years before its announcement
in 2015, but was conceived earlier as the original pitch made in late 2007 for what
would become the Kinect technology platform. It was introduced with operating
systems, such as Android, iOS and OS X on April 5, 2016.
Microsoft has targeted HoloLens for release "in the Windows 10 timeframe," with
the Microsoft HoloLens Development Edition to begin shipping March 30, 2016,
Microsoft has not set a time frame for consumer availability of HoloLens, with
HoloLens chief inventor Alex Kipman stating that HoloLens will have a consumer
release only when the market is ready for it. Companies such as Samsung Electronics
and Asus had expressed interest in working with Microsoft to produce their own
mixed-reality products based on HoloLens.
 4. Working of HoloLens
Microsoft hololens has user interface so it takes voice, gaze and gestures as input
command. Than internal computer works on input command. Now projection of
hologram, for projection hololens use the HUE (head up display) method two
nanoprojector located at each side of head and semi transparent visor which reflect
the image as light on users eye.

Microsoft explains the holographic element in this way: The key to a great
holographic experience holograms that are light point rich, i.e. have a high
holographic density, and are pinned or anchored to the world around you. To achieve
this, HoloLens has been designed for optimal holographic density of 2.5K radiants.
The more radiant and light points there are, the brighter and richer the holograms
become.

We here divide it in three parts to make easy to understand, in one of them we study
the major hardware parts of it, and specification than we will move to the real world
example of augmented reality based HoloLens.

4.1. Parts of HoloLens

It have a major six parts those are bone of this product Camera, Computer, Lenses,
Vent, Sensor, Buttons. Let us study them one by one:

Camera : The project HoloLens depth camera has a field of vision that spans 120 by
120 degree, so it can sense what your hands are doing even when they are nearly
outstreached.
Computer : HoloLens is not just a visor connected to a computer, it is a computer on
its own. HoloLens contain CPU, battery, GPU and first of its kind HPU (holographic
processing unit). 18 sensors flood the brain of the device with terabyte of data every
seconds.
Lenses : Microsoft HoloLens has two display. They are transparent so that wearer
can see the real world behind virtual object. To create project HoloLens image, light
 particles bounce around millions of times in the so called light engine of the device.
Then the photons enter the two lenses(one for each eye), where they ricochet
between layers of glasses before finally hitting of wearer eye.
Vent : The device is more powerful than a laptop but wont overheat- warm air flows
to the sides, where it vents up and out.
Sensor : Sensor track where the wearer is looking and adjust the display. Motion
sensor detect wearers movement. The sensor can also see wearers hands, the hands
are an input system: user can interact with whatever he sees by just touching it.
Wearer also give gesture as input sensor enables the tracking of user movement.
Buttons : On the right side buttons allow user to adjust the volume and to control the
contrast of the hologram.

4.2. Specification of HoloLens

Optics

Fig. 4.2.1. Optical view of HoloLens

See through holographic lenses (Waveguides)

2 HD 16:9 light engines.
Automatic pupillary distance calibration.
Holographic Resolution : 2.3 total light points.
Holographic Density: > 2.5 radiants (lights point per radian).
 Sensors

Fig. 4.2.2. Sensors of HoloLens

1 IMU
4 environment understanding cameras
1 depth camera
1 2MP photo / HD video camera
Mixed reality capture
4 microphones
1 ambient light sensor
 Human Understanding
Spatial sound
Gaze tracking
Gesture input
Voice support

Input / Output / Connectivity

Built-in speakers
Audio 3.5mm jack
Volume up/down
Brightness up/down
Power button
Battery status LEDs
Wi-Fi 802.11ac
Micro USB 2.0
Bluetooth 4.1 LE

Power

Battery Life
2-3 hours of active use
Up to 2 weeks of standby time
Fully functional when charging
Passively cooled (no fans)
 Processors

Fig. 4.2.3. Motherboard of HoloLens

Intel 32 bit architecture with TPM 2.0 support

Custom-built Microsoft Holographic Processing Unit (HPU 1.0)

Weight
579g

Memory
64GB Flash
2GB RAM
4.3. Real-life working of HoloLens
The HoloLens comes with semitransparent holographic lenses which 'generate multi-
dimensional full-colour holograms'. That means it's not going to be projecting images
into a room that everyone can see. It's cutting edge stuff, but it's not quite that
advanced yet.

In much the same way as Google's ill-fated Glass experiment, the HoloLens will
interject virtual elements onto your vision. That means it's different to virtual reality
headsets such as the HTC Vive, Oculus Rift, and Playstation VR. These VR headsets
immerse you in a fully simulated world, whereas the HoloLens uses the real world as
a canvas on which to overlay virtual elements.

Microsoft explains the holographic element in this way: "The key to a great
holographic experience is holograms that are light point rich, i.e. have a high
holographic density, and are pinned or anchored to the world around you. To achieve
this, HoloLens has been designed for optimal holographic density of 2.5K radiants.
The more radiants and light points there are, the brighter and richer the holograms
become."

Unlike Google Glass then, Microsoft's AR headset will create virtual 3D models that,
thanks to the HoloLens' various cameras and sensors, interact with the environment
you're in. The in-built speakers that sit above your ears create sound based upon
where each hologram is in relation to your position, making for an even more
immersive experience.

What will you be able to do with HoloLens?

From the sounds of it, quite a lot. Microsoft presented some of the most interesting
potential uses in a video, which you can see above. Among the most interesting,
HoloLens will be able to let you view and interact with work projects such as
assembling 3D models, play games like Minecraft, video chat with hologram
versions of Skype contacts, and even watch live content.
An on-stage demonstration further emphasised the ability to create 3D objects, from
assembling to choosing the colours, all using simple gestures that looks very Intel
RealSense.

Fig. 4.3.1. Playing minecraft game.

One of the most fascinating uses, at least for the folks at NASA, which collaborated
with Microsoft in the making of HoloLens, is the potential to control the Mars rover
Curiosity via the HoloLens. The headset will give NASA staff the ability to plant
virtual flags in the terrain and work as if they're actually on the planet themselves.

Microsoft is also partnering with other companies to use HoloLens in practical ways.
Volvo is expected to bring the technology to its car showrooms where customers will
be able to view different colour options for their chosen car and see safety features in
action. The car maker is also expected to integrate HoloLens tech into its
autonomous vehicle projects, although it remains unclear how.

At Microsoft's 2015 Build developer conference, we got to see other ways HoloLens
could be used. The company treating us to demos of physiology students exploring
the human anatomy, a Raspberry Pi powered robot with HoloLens support, and how
architects can use the augmented reality elements to help construct buildings with
Windows 10 at the core.

But what about gaming with HoloLens? Well Microsoft is doing that as well and the
first example of what it's calling mixed reality gaming was demonstrated at
Microsoft's E3 2015 press conference.

Having snapped up Minecraft-maker Mojang for a cool $2.5 billion, the first
Minecraft game designed for Hololens lets you project maps onto a physical table
simply by saying the words, 'create world'. Then with your hands, you can play with
items and characters. This can be done all while another player is immersed in the
Minecraft world from a Microsoft Surface tablet.

At a Windows 10 event late last year, Microsoft showed off a brand new demo
known as Project X-Ray, which showcases mixed reality technology.

An unknown wearer took to the stage wearing the HoloLens and quickly donned a
wearable hologram, in the form of some kind of space blaster. He shot through one of
the walls on the stage a few times, but then suddenly a crack started to appear and a
mechanic alien burst through it.

The robots themselves know where the walls and furniture are in your space,
meaning the gameplay is tailored to you. There's options to change your weapons
using voice commands and there's a tonne of different enemies that you'll come up
against.
 Fig. 4.3.2. HoloLens Project X-Ray.

There's clearly some exciting possibilities here and we can't wait to see what else
Microsoft has planned on the gaming front.

In late March 2016, an impressive video showcasing 'holoportation' appeared online.

The Microsoft research video (below) demonstrated how it's possible to use the
HoloLens to teleport a 3D version of yourself into another HoloLens wearer's field of
view. Of course, the whole thing requires multiple cameras in order to work, so
you're still a long way from chatting to virtual versions of your mates in your living
room. But the video was another example of how innovative Microsoft's headset has
the potential to be.

Along with the launch of the HoloLens developer edition came news of the first
confirmed games and apps for the headset. Microsoft confirmed that the dev kit
would come with seven pre-installed AR experiences. On the app side, there's
HoloStudio, Skype, and HoloTour, while games include Fragments, Young Conker,
and RoboRaid.
In March 2016, Microsoft showed off a seriously cool new app called Actiongram,
which it plans to launch in the summer. The storytelling app will allow developers to
create videos featuring holographic effects for use with the headset.

Fig. 4.3.3 Holographic platform

 5. Advantages of HoloLens

Easy to wear and use.

Sensitive and responsive to the presence of people.

Hololens can be used in army battlefield, where detailed instruction can be given to
the untrained person in the midest of combat.

A spectacle based computer to reside directly

On your eyes rather than your pocket.

6. Dis-advantages of HoloLens

Can be easily damaged or broken user will have a tough time taking care of it.

It may lead to accident while driving.

Privacy of people may break due to new glasses.

 7. Augmented Reality

Augmented reality (AR) is a live direct or indirect view of a physical, real-world

environment whose elements are augmented (or supplemented) by computer-
generated sensory input such as sound, video, graphics or GPS data. It is related to a
more general concept called mediated reality, in which a view of reality is modified
(possibly even diminished rather than augmented) by a computer. As a result, the
technology functions by enhancing ones current perception of reality. By contrast,
virtual reality replaces the real world with a simulated one. Augmentation is
conventionally in real-time and in semantic context with environmental elements,
such as sports scores on TV during a match. With the help of advanced AR
technology (e.g. adding computer vision and object recognition) the information
about the surrounding real world of the user becomes interactive and digitally
manipulable. Information about the environment and its objects is overlaid on the
real world. This information can be virtual or real, e.g. seeing other real sensed or
measured information such as electromagnetic radio waves overlaid in exact
alignment with where they actually are in space. Augmented reality brings out the
components of the digital world into a person's perceived real world. One example is
an AR Helmet for construction workers which displays information about the
construction sites.

7.1. Different from Virtual Reality.

One of the biggest confusions in the world of augmented reality is the difference
between augmented reality and virtual reality. Both are earning a lot of media
attention and are promising tremendous growth. So what is the difference between
virtual reality vs. augmented reality?

What is Virtual Reality?

Virtual reality (VR) is an artificial, computer-generated simulation or recreation of a
real life environment or situation. It immerses the user by making them feel like they
 are experiencing the simulated reality firsthand, primarily by stimulating their vision
and hearing.

Fig 7.1. A lady with Virtual Reality gadget (Facebooks Oculus)

VR is typically achieved by wearing a headset like Facebooks Oculus equipped with

the technology, and is used prominently in two different ways:

To create and enhance an imaginary reality for gaming, entertainment, and play
(Such as video and computer games, or 3D movies, head mounted display).

To enhance training for real life environments by creating a simulation of reality

where people can practice beforehand (Such as flight simulators for pilots).

Virtual reality is possible through a coding language known as VRML (Virtual

Reality Modeling Language) which can be used to create a series of images, and
specify what types of interactions are possible for them.

What is Augmented Reality?

Augmented reality (AR) is a technology that layers computer-generated
enhancements atop an existing reality in order to make it more meaningful through
the ability to interact with it. AR is developed into apps and used on mobile devices
to blend digital components into the real world in such a way that they enhance one
another, but can also be told apart easily.

AR technology is quickly coming into the mainstream. It is used to display score

overlays on telecasted sports games and pop out 3D emails, photos or text messages
on mobile devices. Leaders of the tech industry are also using AR to do amazing and
revolutionary things with holograms and motion activated commands.

Augmented Reality vs. Virtual Reality

Augmented reality and virtual reality are inverse reflections of one in another with
what each technology seeks to accomplish and deliver for the user. Virtual reality
offers a digital recreation of a real life setting, while augmented reality delivers
virtual elements as an overlay to the real world.
 8. Future Scope of HoloLens
HoloLens is the product to enhance the virtual reality or augmented reality in real
world, it is the new way to visualize our work, new way to collaborate and explore,
the vary new way to create what we imagine. HoloLens is a new world to connect,
create and explore like never before. There are various uses and scopes for HoloLens,
some of them can be categories in major three lines below:

Visual diagrams would actually show up in space around the user indicating exactly
what you need to do next.

This application could even extend to the battlefield, where detailed medical
instructions could be given to untrained personnel in the midst of combat.
Pin holograms to physical objects so user can size and scale them in each angle and
with gestures do all new creation.
 9. Conclusion

The premier device for Windows Holographic, Microsoft HoloLens is a smart-glasses

headset that is cordless, self-contained Windows 10 computer. It uses advance
sensors, a high-definition stereoscopic 3D optical head-mounted display, and spatial
sound to allow to augmented reality applications, with a nature user interface that the
user interact with trough gaze, voice and hand gestures that gives you ways to go
beyond the screen, so see your world as a canvas, and gives you more natural way to
interact. HoloLens is a thing where you can connect, create and explore like never
before, Create what you imagine, visualize your work, collaborate and explore.

HoloLens with Holographic processing unit, sensor fusion, power and grace,
advanced optics, build in speakers, spatial sound gives you the new augmented or
virtual world over real world. Without bumping to walls you can watch NetFlix, play
Minecraft, use AutoCAD, talk to Dad on Skype, design a brand new car, and so on
 10. References

1. Pandher, Gurmeet Singh (2 March 2016). "Microsoft HoloLens Preorders: Price,

Specs Of The Augmented Reality Headset." The Bitbag. (thebitbag.com)

2. "Microsoft Hololens hardware". Microsoft. Retrieved 1 May 2015. (microsoft.com)

3. Microsoft HoloLens - Here are the full processor, storage and RAM specs, Windows
Central, May 2, 2016 (windowscentral.com)

4. Terry Myerson, Alex Kipman, Jeff Norris, Satya Nadella (21 January 2015).
Windows 10: The Next Chapter. Microsoft. Event occurs at 01:36:53. Retrieved
(vimeo.com)

5. Microsoft HoloLens: Partner Spotlight with Case Western Reserve University.

Microsoft. 8 July 2015. Retrieved 9 July 2015.

6. "Halo 5 headlines greatest holiday games lineup in Xbox history" . Microsoft News
Center. Microsoft. 15 June 2015. Retrieved 15 June 2015. (news.microsoft.com)

7. Satya Nadella, Lorraine Bardeen, Dan McCulloch (13 July 2015). Our journey
together. Event occurs at 42:42. Retrieved 15 July 2015. (vimeo.com)

8. "Announcing the Microsoft HoloLens 'Share Your Idea' campaign" . Building Apps
for Windows. Microsoft. 1 December 2015. Retrieved 17 February 2016.
(blog.microsoft.com)

9. "Development overview". Windows Dev Center. Microsoft. Retrieved 1 March 2016.

(dev.microsoft.com)

10. "Gestures". Windows Dev Center. Retrieved 7 March 2016. (dev.microsoft.com)

11. Microsoft HoloLens: What is a hologram?. Microsoft. 29 February 2016. Retrieved
7 March 2016. (youtube.com)

12. Microsoft HoloLens hardware. Microsoft retrieved 1 May 2015.

(dev.microsoft.com)

13. Microsoft HoloLens. Official Wikipedia articles. (wikipedia.org)

14. Documents on HoloLens. Individual documentations on Scribd. (scribd.com)

15. Images source : Microsoft.com