Avionics Displays Technology

AVIONICS
Displays Technology
Angel E. Gonzalez-Lizardo,
Ph.D.
Polytechnic University of Puerto Rico
August 28, 2016
AVIONICS
Ph.D. 1
Displays and Man-Machine Interaction

Displays Technology
Two recent developments in HUD and HMD displays
technology
Will have major influence on future HUD and HMD
performance
size
weight
reliability
initial cost and cost of ownership
AVIONICS
Ph.D. 2

Displays TechnologyReplacing the HUD CRT
HUDs are split into four generations according to the image
generation technology.
First GenerationUse a CRT to generate an image on a phosphor
screen, with the disadvantage of the phosphor screen coating
degrading over time. Most HUDs in operation today are of this type.
Second GenerationUse a solid state light source, for example LED,
which is modulated by an LCD screen to display an image. Do not fade
or require the high voltages of first generation systems. These systems
are on commercial aircraft.
Third GenerationUse optical waveguides to produce images
directly in the combiner rather than use a projection system.
Fourth GenerationUse a scanning laser to display images and even
video imagery on a clear transparent medium.
AVIONICS
Ph.D. 3

Characteristics of the HUD CRT
Very simple and technically elegant.
Around 2000 hours MTBF
Hard to match major advantages are:
Sharp, crisp cursive display symbology and the very wide viewing
angle
Extremely high display integrity;
The current solution to replacing the CRT:

A projected display with very high luminance light source to
illuminate a light modulator, such as a flat panel high resolution
display device.
AVIONICS
Ph.D. 4

Figure 1: Block diagram of a HUD projected display unit.
The high luminance light source illuminates a flat panel display device
comprising a matrix addressable x-y array of electrically switchable, light
reflecting mirror elements.
The display image is then projected onto the display screen and relayed
by optics to the HUD combiner.
AVIONICS
Ph.D. 5

The Texas Instruments Digital
Micro Mirror Device (DMDTM ) is
an array of over a million hinged
micro-mirrors individually
deflected mechanically through
(12 ).
The micro-mirrors are deflected
by the electrostatic forces by
applying a voltage to the
appropriate mirror electrodes;
Each micro-mirror produces a
display pixel.
AVIONICS
Figure 2: Digital Light Engine projector display unit (courtesy of BAE Systems).
Ph.D. 6

The probability of displaying misleading information must be less
than 1 part in a billion per hour if the HUD is designated PFD.
Pixel based displays have problems in meeting this extremely
high integrity requirement.
A typical concern, for example, is a figure 8 degraded to read as
a 3 by the loss of a vertical row of pixels.
To address this problem, monitoring of the drive circuits and a
camera to monitor the display.
The camera monitors the actually displayed image in terms of
both symbol form and positional placement.
A signal from the camera is compared to the original data
generated.
AVIONICS
Ph.D. 7

A novel technique, create
Computer Generated Hologram
(CGH) of the display image which
is then illuminated by a solid state
laser to re-create that image on
the diffuser screen.
It requires a two dimensional
Fourier Transform of the image
at high iteration rates
Because the phase hologram is
used, a great deal of pixel failures
can be tolerated before the image
becomes significantly degraded.
AVIONICS
Figure 3: Block diagram of active CGH method

of generating a fault tolerant display.
Ph.D. 8

Displays TechnologyHMD/HUD Optical System Technology
Holographic waveguide
technology HMD and HUD
design.
The fundamental requirement
for HMD/HUD optical system is
to convey a collimated image of
the display symbology into the
pilots field of view so it overlays
the distant outside world scene
AVIONICS
Figure 4: Basic HMD/HUD requirement.
Ph.D. 9

Optical requirements for any HMD/HUD
High accuracy.
Sufficient contrast
Minimal internal
reflections
Wide field of view
Very wide dynamic range

of luminance.
Low Weight.
Compactness.
AVIONICS
Large Exit Pupil
High Reliability.
Ph.D. 10

In a typical HMD optical configuration.
Complex optical system
Mass is well forward of the pilots head
CG.
Space and weight constraints limit
diameter of relay lens aperture;
This determines the size of the exit
pupil.
Large aberrations free lenses are very
expensive.
Size is also limited by severe thermal
and vibration stresses in military
aircraft.
AVIONICS
Figure 5: Optical configuration of a typical HMD (courtesy of BAE Systems).
Ph.D. 11

A holographic waveguide can be used
to convey a collimated display image
directly into the pilots FOV.
The optical waveguide comprises a
sandwich of two thin rectangular glass
plates with a holographically generated
diffraction grating in the middle of the
sandwich.
The display image is first optically
collimated with a simple lens system and
then launched into the waveguide by an
optical prism arrangement.
AVIONICS
Figure 6: Holographic
waveguide concept(courtesy
of BAE Systems).
Ph.D. 12

Displays TechnologyThe Q Sight HMD
Figure 7: Schematic illustration of the Q Sight HMD (courtesy of BAE Systems).

AVIONICS
Ph.D. 13

The light rays from the collimated
display image are then internally
reflected along the waveguide
When a reflected light wave
encounters the diffraction
grating, a very small fraction of
the light is diffracted out
The diffracted light from the
grating forms a continuous row
of images of the display exit pupil
Figure 8: Optical waveguide
which is duplicated along the
diffraction grating.
horizontal waveguide.
AVIONICS
with
central
Ph.D. 14

A second waveguide, which
forms the combiner, is optically
coupled at right angles to the
first waveguide.
The row of exit pupils from the
first waveguide is coupled into the
second waveguide to form an
array of rows and columns of
exit pupils along the wave guide
combiner
The second waveguide is to
couples the exit pupil to the eye.
Figure 9: Optical waveguide

diffraction grating.
with
central
The image is ejected normal to

the glass and overlaid on the
outside world.
AVIONICS
Ph.D. 15

It does not matter if the pilot can

see a particular symbol in two
overlapping exit pupils.
Since the display image within an
exit pupil is focused at infinity,
symbol will still overlay the same
point on the distant outside world
scene
Figure 10: Basic principle of array of multiple

exit pupils.
AVIONICS
Ph.D. 16

The Q Sight HMD is
Intrinsically inexpensive to
manufacture.
Modular, to be incorporated onto
existing pilot helmets.
Low mass and large eye position
box.
Symbology and/or video can be
displayed for full head up
operation.
Fully compatible with NGVs
AVIONICS
Figure 11: The Q Sight HMD. Inset shows

display symbology overlaying
outside world (courtesy of BAE
Systems).
Ph.D. 17

Displays TechnologyThe Q HUD
The advantages exploited in
the Q Sight, apply equally to
the HUD.
A holographic waveguide
used to inject the display
directly into the pilots FOV
Eliminates of the bulky and
complex optical projection
system in a conventional HUD
Advantages: lower weight,
smaller size, large head
Figure 12: The Q HUD optical configuration (courposition box and lower cost
tesy of BAE Systems).
AVIONICS
Ph.D. 18

Displays TechnologyThe Q HUD
The prototype Q HUD

50% smaller and lighter than
conventional civil HUDs
Eye position box many times
greater than current HUDs
FOV is 34 horizontally by 25
vertically
Combiner transmission over
80%.
AVIONICS
Figure 13: Prototype Q HUD installed in a business jet (courtesy of BAE Systems).
Note: Compactness and absence of
obstructions above pilots head.
Ph.D. 19

Control and Data EntryIntroduction
The pilots must be able to control the information being
displayed
For example, to switch modes and information sources at
the various phases of the mission
Also, they must be able to enter data into the various
avionic systems (e.g. navigation way points).
Effecting control and data entry must be as easy and as
natural as possible.
Particularly under high work load conditions
This section briefly overviews Tactile Control Panels, Direct
Voice Input and Eye Trackers
AVIONICS
Ph.D. 20

Control and Data EntryTactile Control Panels
A typical tactile control panel
uses a matrix array of
infrared beams across the
surface of the display which
displays the various function
keys.
Touching a specific function
key on the display surface
interrupts the x and y
infrared beams
Hence signals the operation
of that particular key function.
AVIONICS
Figure 14: Touch panel concept.
Ph.D. 21

Control and Data EntryDirect Voice Input
Direct voice input (DVI) control enables to enter data and
control the operation of the aircrafts avionic systems by
means of speech.
Spoken commands and data are recognized by a speech
recognition system
Commands are then compared with the stored speech
templates of the system vocabulary.
Recognized commands, or data, are then transmitted to the
aircraft sub-systems through the interconnecting data bus.
AVIONICS
Ph.D. 22

Examples:
To change a communication channel frequency, the pilot says: radio
followed by select frequency three four five decimal six
To enter navigation data, the pilot says: navigation followed by
enter waypoint latitude fifty one degrees thirty one minutes
eleven seconds North. longitude zero degrees forty five minutes
seventeen seconds West.
The DVI provides feedback that has recognized the command
correctly
Visually via the HUD and HMD (if installed).
Aurally via speech synthesizer system.
The pilot confirms the recognized command by saying enter and the
action is initiated.
AVIONICS
Ph.D. 23

The pilot can thus stay head up not having to divert attention
from the outside world to operate touch panels, switches,
push buttons, keyboards etc.
DVI can thus reduce the pilots work load in high work load
situations
The required vocabulary is not extensive and pilots (and
crew) make good DVI subjects.
They are trained to speak clearly and concisely, strongly
structured.
AVIONICS
Ph.D. 24

Main characteristics and requirements for an airborne DVI
Fully connected speech. No pauses required between words
Able to operate in the cockpit noise environment
Vocabulary size. 200 to 300 words.
Speech template duration. Around 5 seconds.
Vocabulary duration. Around 160 seconds.
Syntax nodes. About 300.

Duration of utterance1 . No restrictions.
Recognition response time. Must be in real time.
1 smallest unit of speech
AVIONICS
Ph.D. 25

Sophisticated algorithms are
used to select the best match
and to output the recognized
words.
The speech features of an
individual word which can be
extracted by spectral analysis
The distinctive features can be
seen in the 3D spectrogram.
AVIONICS
Figure 15: Speech features spectral analysis

a spectroscape of the word spar
(courtesy of BAE Systems).
Ph.D. 26

The airborne environment, however, poses particular
requirements
high confidence level in
high background noise situation
Recognition accuracies of at least 96% to minimize having to
repeat a command.
Recognize commands spoken during the physical stress of
maneuvering.
For these reasons, the stored vocabulary templates are

currently derived directly from the pilot to characterise the
system to his particular speech patterns.
AVIONICS
Ph.D. 27

IKBS2 can also be used to improve the recognition
accuracy
Deducing the context in which the words are spoken and
ruling out out of context or unlikely words.
For numerical data, numbers outside the likely range for a
quantity.
For example, radio frequencies or latitude/longitude
coordinates can be rejected.
2 intelligent knowledge based systems

AVIONICS
Ph.D. 28

Control and Data EntrySpeech Output Systems
Audio warning systems to provide voiced warning
messages to the pilot/crew are now well established.
They complement DVI systems in the essential feedback on
correctly recognized spoken command/data.
Speech synthesisers are now available and in wide scale
use in many everyday applications.
A recent development for combat aircraft application is the
use of stereo sound warning signals to indicate the
direction of the threat to the pilot like behind and to the
left or right, above or below, etc.
AVIONICS
Ph.D. 29

Control and Data EntryDisplay Integration with Audio/Tactile
Inputs
Integration and
management of display
surfaces by audio/tactile
inputs enables a
significant reduction in
the pilots workload
Voice, Throttle, Stick
control. Combination of
audio/tactile
management, FBW flight
control, and automated
engine control is called:
AVIONICS
Figure 16: Audio-tactile management systems. Note:

Tactile control panels can be integrated with
HDDs.
Ph.D. 30

Control and Data EntryDisplay Integration with Audio/Tactile
Inputs
Eye tracking systems are widely used and evaluated in
simulators for future applications as
Improved target designation accuracy
Data entry by looking at the appropriate data symbol
Prototype helmet mounted eye trackers exploit the principle

of corneal reflection.
Demonstrated 0.5 accuracy at a 50 Hz iteration rate.
However, current helmet mounted sighting systems and
current data entry systems are adequate.
No eye tracking system required at this point.
AVIONICS
Ph.D. 31

Avionics Displays Technology

Hochgeladen von

Dokumentinformationen

Originalbeschreibung:

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Avionics Displays Technology

Hochgeladen von

Copyright:

Verfügbare Formate

AVIONICS

August 28, 2016

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

The current solution to replacing the CRT:

Displays and Man-Machine Interaction

Figure 1: Block diagram of a HUD projected display unit.

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Figure 3: Block diagram of active CGH method

Displays and Man-Machine Interaction

Figure 4: Basic HMD/HUD requirement.

Displays and Man-Machine Interaction

Wide field of view

Very wide dynamic range

Large Exit Pupil

Displays and Man-Machine Interaction

Figure 5: Optical configuration of a typical HMD (courtesy of BAE Systems).

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Figure 7: Schematic illustration of the Q Sight HMD (courtesy of BAE Systems).

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Figure 9: Optical waveguide

The image is ejected normal to

Displays and Man-Machine Interaction

It does not matter if the pilot can

Figure 10: Basic principle of array of multiple

Displays and Man-Machine Interaction

Figure 11: The Q Sight HMD. Inset shows

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

The prototype Q HUD

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Figure 14: Touch panel concept.

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Syntax nodes. About 300.

Displays and Man-Machine Interaction

Figure 15: Speech features spectral analysis

Displays and Man-Machine Interaction

For these reasons, the stored vocabulary templates are

Displays and Man-Machine Interaction

2 intelligent knowledge based systems

Displays and Man-Machine Interaction

Displays and Man-Machine Interaction

Figure 16: Audio-tactile management systems. Note:

Displays and Man-Machine Interaction

Prototype helmet mounted eye trackers exploit the principle

Das könnte Ihnen auch gefallen