VOICE

MORPHING
 CONTENTS

 What Itis?
 Need of Voice Morphing
Description the Morphing.
 Technical details of Morphing.
 Application areas.
 WHAT IS VOICE MORPHING ??
• Voice morphing is a technique for modifying a (source)
speaker's speech to sound as if it were spoken by a
different (target)speaker.

• In Simpler terms it is being able to change the speech of

one speaker to that of another speaker.

• Technology developed at the Los Alamos National

Laboratory in New Mexico, USAby George Papcun.

• Applic ations for Voice Morphing range from rec reational

ones to security ones.
 WHAT IT ACTUALLY PERFORMS ?

• It is a technique to modify a source speaker's speech

to sound as ifitwas spoken by a target speaker.
• Voice morphing enables speech patterns to be
cloned.
• An accurate copy of a person's voice can be made
that can wishes to say, anything in the voice of
someoneelse.
NEED OF VOICE MORPHING

 Text To Speech (TTS).

 In public speech systems.

 For special
effects ( just like video or image
morphing is done).
 To diminish Ethnical barriers.
 HOW TO MORPH VOICE ??

• We need to effectively change the pitch from that of a male

speaker to that of a female speaker. If we reminisce the excitation
signal hasinformationabout the speaker.
• We findtheLPCcoefficients forthe Source and Target Signalsand
using these coefficients we are going to interpolate between the
two Signals.
• Weget theNewLPC(linearpredictive coding) coefficients.
new lpc coeff = [constant*(lpcsource )+( 1- constant )( lpc target)] ;

0<=constant<=1
• The pitch of a female speaker will be close to twice that of
the male speaker. In our example, the pitch of the male
speaker is141Hz and that of the female speaker is210Hz.
• So we need to develop some time stretching algorithm so
that we can implement pitch shifting. We obtain the
residue of the source signal and stretch it according to the
value of the const. The constant indicates what is the
position of morphed signal in between the source and
target.
• For example: if constant = 0.2, then the morphed signal will
be closer in pitch to the source signal and a value of 0.8 for
constant will result in a pitch that is closer to the target
signal.
 HOW DO WE SHIFT THE PITCH ??

We break the residue signal into small windows and

introduce fade in and fade out for each block. We
recombine everything to form the pitch shifted signal.
Based on the alpha we can time stretch the residue
according to ourrequirements.

HOW DO WE MORPH FINALLY ??

We now have the pitch shifted residue signal and the
new LPC coefficients. We should resample the pitch
shifted signal so that it is played at a faster rate.
[Remember when we pitch shift then the residue will
last longer]. If we inverse filter the resampled pitch
shifted residue then we can effect morphing.
BLOCK DIAGRAM
Time Domain Plots of Source and Target featuring the Pitch
 MATCHING ANDWARPING

DTW (Dynamic TimeWarping)

- Dynamic Time Warping (DTW) isused to find the

best match between the pitch of the twosounds.
 SIGNAL RE-ESTIMATION

Loss during Signalre-estimation

- Due to signals being transformed into the cepstral

domain, a magnitude function is used. This results in a
loss ofphaseinformationintherepresentationofthedata.
 LIMITATIONS

• Lots of normalizingproblems.
• Some applications require extensive sound libraries.
• Different languages require differentphonetics.
• It isvery seldom complete.
 ADVANTAG ES

• Allows speech model to be duplicated and an exact

copy of a person’s voice.

• Powerful combat zoneweapon.

 DISADVANTAGES

• Use to pull out the useful information.

• Ithides the actual identity of the user.

 CONCLUSION


The approach we have adopted separates the sounds
intotwo forms:
1. Spectral envelope information
2. Pitch and voicinginformation.
 Dynamic Time Warping

- Aligns the sounds with respect to their pitches.

 Signal re-estimation algorithm

- Frames are c onverted bac k into a time domain

waveform.
 APPLICATION AREAS

 Fake telephone conversations as evidence in courts

of law.

 Powerful battlefield weapon.

- Provide fake orders to the enemy's troops, appearing
to come from their own commanders.
 FUTURE SCOPE

• Extending the functionality oftool.

-Create a powerful and flexible morphing tool.

• Increased userinteraction.

-Graphical User Interface could be designed and

integrated to make the package more ‘user-friendly’.
 BIBLIOGRAPHY:
• Ye, H. and S. Young (2003). "Perceptually Weighted Linear
Transformations for Voice Conversion". Eurospeech 2003,
Geneva.
• Ye, H. and S. Young (2004). "High Quality Voice Morphing".
Int Conference Acoustics Speech and Signal Processing,
Montreal, Canada.
• High quality Voice Morphing Hui Yeand Steve Young.
• Quality-enhanced Voice Morphing
THANK YOU!!!
Questions ?