n mn hc 2

CHNG 1:

2009

M U

Ngn iu chnh l ci mang li cho ting ni con ngi nhng m sc ring bit. Ngn
iu ca li ni lin kt cht ch vi ng iu.Ng iu l s nng cao h thp ca ging ni
trong cu. Ting Vit ta l mt ngn ng kh phc tp bao gm c ngn iu v ng iu. Do
vn nghin cu cc phng php nhn dng ting ni v ang thu ht rt nhiu s u t
v nghin cu ca nh khoa hc.Tuy nhin cho n nay kt qu mang li vn cha hon thin do
tnh cht qu phc tp v khng c nh ca i tng nhn dng l ting ni con ngi,c bit
l ting Vit.
Hin nay c rt nhiu phng php nhn dng ting ni. M hnh Fujisaki c ng dng
rng ri trong h thng ca ting Nht, m hnh MFGI (Mixdorff- Fujisaki model of German
Intonation) c ng dng trong ting c, m hnh HMM (hidden markov models)
Trong cc m hnh y li p dng nhiu phng php nhn dng khc nhau. Mi phng
php mang mt tnh c trng v u im ring.
Phng php LPC (linear predictive coding)-m ha d bo tuyn tnh: nhc im l c
mt s t pht m gn ging nhau th b nhm ln nhiu.
Phng php AMDF (average magnitude difference function)- hm hiu bin trung
bnh: u im l s ng vo t,kch thc mng hun luyn nh,t ph thuc vo cch
pht m nn t l c sai t hn phng php LPC, tuy nhin khuyt im l khng phn
bit v thanh iu,kh s ng trong trng hp t c lin tip.
AMDF & LPC :Do u v nhc im ca hai phng php LPC v AMDF nn cn s
kt hp gia hai phng php .
Phng php th t MFCC (mel-frequency ceptrums coefficients).
Nhn dng ting ni l mt qu trnh nhn dng mu,vi mc ch l phn lp thng tin
u vo l tn hiu ting ni thnh mt dy tun t cc mu c hc trc v lu tr
trong b nh. Cc mu l cc n v nhn dng, chng c th l cc t hay l cc m v. Nu
cc mu ny l bt bin v khng thay i th cng vic nhn dng ting ni tr nn n gin
bng cch so snh d liu ting ni cn nhn dng vi cc mu c hc v lu tr trong
b nh.

Chng 1: M u

2009

n mn hc 2
CHNG 2:

L THUYT M THANH V TING NI

2.1 Ngun gc m thanh:

m thanh l do vt th dao ng c hc m pht ra. m thanh pht ra di dng
sng m. Sng m l s bin i cc tnh cht ca mi trng n hi khi nng lng m truyn
qua. m thanh truyn c n tai ngi l do mi trng dn m. Sng m c th truyn c
trong cht rn ,cht lng, khng kh. C cht dn m rt km gi l cht ht m nh: len,da, cht
xp Sng m khng th truyn trong mi trng chn khng.
Khi kch thch dao ng m trong mi trng khng kh th nhng lp kh s b nn v
dn.Trng thi nn dn ln lt c lan truyn t ngun m di dng sng dc ti ni thu m.
Nu cng ngun m cng ln th m thanh truyn i cng xa.

2.2 Cc i lng c trng cho m thanh:

a/ Tn s ca m thanh: l s ln dao ng ca phn t kh trong mt giy.
n v l Hz , k hiu : f
b/ Chu k ca m thanh: l thi gian m m thanh thc hin mt dao ng
hon ton. n v l thi gian, k hiu l T.
c/ Tc truyn m: l tc truyn nng lng m t ngun ti ni thu.
n v m/s. Tc truyn m trong khng kh nhit t 0- 200 C thng l 331 340 m/s.
d/ Cng m thanh: l nng lng c sng m truyn trong mt n v
thi gian qua mt n v din tch t vung gc vi phng truyn m.
e/ Thanh p: l lc tc dng vo tai ngi nghe hoc ti mt im no ca
trng m thanh. n v : 1pa=1 N/m2 hoc 1bar = 1dyn/cm2 .
f/ m sc: Trong thnh phn ca m thanh, ngoi tn s c bn cn c cc sng
hi ,s lng sng hi biu din sc thi ca m. m sc l mt c tnh ca m nh m ta
phn bit c ting trm, bng khc nhau, phn bit c ting nhc c, ting nam n ,ting
ngi ny vi ngi khc.
k/ m lng: l mc to nh ca ngun. n v l W .

Chng 2: L thuyt m thanh v ting ni

2009

n mn hc 2

2.3 Cc tn s ca m thanh:
F0 gi l tn s c bn ca m thanh. Nam gii f0 = 150 Hz. N gii : f0 = 250 Hz.
Ging nam trm 80 320 Hz
Ging nam trung 100 400 Hz
Ging nam cao 130 480 Hz
Ging n thp 160 600 Hz
Ging n cao 260 1200 Hz
Cng sut ca ting ni , khi ni to nh cng khc nhau.Khi ni thm cng sut 10 -3 mW ,
ni bnh thng 10 mW, ni to 103 mW.

2.4 C ch to lp ting ni ca con ngi:

Cc c quan pht m ca con ngi ch yu gm phi, kh qun, thanh qun, b phn
mi v ming.Thanh qun c hai np gp gi l dy thanh m, dy thanh m s rung khi lung
khng kh i qua khe thanh mn l khe gia hai dy thanh m.B phn ming l mt ng m
khng u.B phn mi cng l mt ng m hc khng u c din tch v chiu di c nh, bt
u t l mi n vm ming mm.
Qu trnh to ra m phi mi: vm ming mm ngn chn b phn mi v m thanh pht
ra thng qua mi.i vi qu trnh to ra m mi :vm ming mm h xung v b phn mi
lin kt b phn ming, lc ny pha trc ca b phn ming khp li hon ton v m thanh ra
thng qua mi.i vi m thanh ni ging mi, m thanh pht ra c mi v mi.
m thanh ca ting ni c th chia lm ba loi khc nhau:
m hu thanh: ging nh m khi chng ta ni a hay e, c to ra khi dy
thanh m cng ln v rung khi p sut khng kh tng ln, lm thanh mm m ra ri ng li khi
lung khng kh i qua.Nhng dy thanh m rung to ra dng sng ca lung khng kh c dng
xp x tam gic.Chu k cao m thanh ca n ng trng thnh thng t 50Hz n 250Hz,
gi tr trung bnh khong 120Hz.i vi ph n trng thnh, gii hn trn cao hn nhiu, c th
ln n 500Hz.
m v thanh: c to ra khi dy thannh m khng rung.C hai loi m v thanh
c bn: m xt v m hi.i vi m xt nh khi ta ni ch s, mt s im trn b phn pht
m co li khi lung khng kh ngang qua n , hn lon xy ra to nn nhiu ngu nhin. i vi
m bt hi, nh khi ta ni ch h , hn lon xy ra gn thanh mn khi dy thannh m b gi
nh mt phn. Ngoi hai loi m c bn ni trn ,cn c mt loi m trung gian va mang tnh
cht nguyn m, va mang tnh cht ph m, c gi l bn nguyn m hay bn ph m. V d
nh i,u trong t ai v u.

Chng 2: L thuyt m thanh v ting ni

2009

n mn hc 2

Ph m n: v d nh m p, t,k hay , b, g trong ting Vit c to ra

do loi kch thch khc.
2.5 M hnh lc ngun to ting ni:
Qu trnh to ting ni l b lc ngun, trong tn hiu t ngun m thanh ( cng c th
l c chu k hay nhiu ) c lc bng b lc bin thin theo thi gian c tnh cht cng hng
tng t vi b phn pht m.Nh vy c th thu c ph tn s ca tn hiu ting ni bng
cch nhn ph ca ngun m thanh vi c tnh tn s ca b lc. Hnh bn di minh ha
ting ni hu thanh v v thanh.Cc li Av v AN xc nh cng ca ngun to m hu
thanh v v thanh.

AV
B to xung
thanh m

Tham s b
lc

B to nhiu
ngu nhin

B lc b
phn pht m

Ting ni

AN
M hnh lc ngun cho qu trnh to ting ni kh n gin nhng khng th lc cm
xt bng cch nh cng hng ca b phn pht m nh m hu thanh hay m bt hi,v vy
m hnh lc ngun hon ton khng chnh xc cho m xt.

2.6 H thng nghe ca ngi:

Qu trnh nghe ca ngi nh sau: sng p sut m thanh tc ng n tai ngi, sng
ny c chuyn thnh chui xung in, chui nay c truyn ti no b thng qua h thn
kinh, no chui c x l v gii m.

Chng 2: L thuyt m thanh v ting ni

2009

n mn hc 2

Khi nghe mt sng m thun ty tc m n (sng sine),nhng im khc nhau trn

mng y s rung ng theo tn s ca m n i vo tai.im lch ln nht trn mng y ph
thuc vo tn s ca m n. Tn s cao to ra im lch ln nht pha y v tn s thp to
ra im lch ln nht pha nh. Nh vy mng y lm nhim v phn tch tn s tn hiu vo
phc tp thnh nhng tn s khc nhau nhng im khc nhau dc theo chiu di ca n. Nh
vy c th xem mi im l b lc thng di v c tn s trung tm v bng thng xc nh.
Ngng nghe ca mt m n tng ln khi c s hin din ca nhng m n ln cn
khc ( m mt n ) v ch c bng tn hp xung quanh m n mi tham gia vo hiu ng mt
n, bng tn ny thng gi l m tn ti hn. Gi tr ca bng tn ti hn ph thuc vo tn s
ca m n cn th.
Tm li qu trnh nghe ca h thnh gic l mt dy cc b lc bng thng, c p
ng ph lp ln nhau v bng thng hiu qu ca chng xp x vi cc gi tr ca bng tn ti
hn.

2.7 Qu trnh sn xut ting ni v thu nhn ting ni ca con ngi:

S biu din qu trnh thu nhn ting ni ca con ngi
NHN DNG TING
NI

SN XUT TING
NI
To thng ip

Hiu thng ip

M ngn ng

M ngn ng

Cc lnh thn kinh

vn ng

Qu trnh thn
kinh

ng dn
m

Sng
m
thanh

Tai trong

Dy
thanh
NGI NI

NGI NGHE
Chng 2: L thuyt m thanh v ting ni

2009

n mn hc 2

Qu trnh sn xut ting ni bt u khi ngi ni mun chuyn ti thng ip ca mnh

cho ngi nghe thng qua ting ni.T chc thn kinh s chu trch nhim chuyn i thng ip
sang dng m ngn ng.Khi mt m ngn ng c chn la,cc lnh thn kinh vn ng iu
khin ng b cc khu vn ng nhm pht ra chui m thanh.Vy u ra cui cng ca qu
trnh l mt tn hiu m hc.
i vi qu trnh thu nhn ting ni, ngi nghe x l tn hiu m thanh thng qua mng
tai trong; n c kh nng cung cp mt phn tch ph cho tn hiu ti. Qu trnh thn kinh s
chuyn i tn hiu ph thnh cc tn hiu hot ng vi thn kinh thnh gic ;c th coi y l
qu trnh ly ra cc c trng.Cui cng cc tn hiu c chuyn thnh m ngn ng v hiu
c thng ip.

2.8 Cc m thanh ting ni v cc c trng:

2.8.1 Nguyn m:
Cc nguyn m c tm rt quan trng trong nhn dng ting ni; hu ht cc h thng
nhn dng da trn c s nhn dng nguyn m u c tnh nng tt. Cc nguyn m ni chung
l c thi gian tn ti di (so vi cc ph m) v d xc nh ph.Chnh v th d dng cho vic
nhn dng ting ni, c i vi con ngi v my mc.
V mt l thuyt, cc cc i ca biu din ph ca tn hiu nguyn m chnh l cc tn
s cng hng(formants) to nn nguyn m. Gi tr ca cc formant u tin (2 hoc 3 formant
u tin) l yu t quyt nh cho php chng ta nhn dng c nguyn m. Do nhiu yu t
bin thin nh s khc nhau v gii tnh, v tui, tnh trng tinh thn ca ngi ni v nhiu
yu t ngoi cnh khc, i vi mt nguyn m xc nnh cc gi tr formant cng c s bin
thin nht nh.Tuy nhin s khc bit v cc gi tr cc formant gia cc nguyn m khc nhau
ln hn nhiu; v trong khng gian formant chng ta c th xc nh mt cch tng i cc
vng ring bit cho tng nguyn m.

2.8.2 Cc m v khc:
Nguyn m i th c s bin thin mt cch lin tc cc formant ca biu din ph theo
thi gian. i vi m v loi ny,cn phi c bit ch n vic phn on theo thi gian khi
nhn dng.
Cc bn nguyn m nh /l/, /r/ v /y/ l tng i kh trong vic biu din c trng. Cc
m thanh ny khng c coi l nguyn m nhng gi l bn nguyn m do bn cht ta nguyn
m ca chng. Cc c trng m hc ca cc m thanh ny chu nh hng rt mnh ca ng
cnh m trong chng xut hin.
i vi cc m mi th ming ng vai tr nh mt khong cng hng c tc dng by
nng lng m ti mt vi tn s t nhin. Cc tn s cng hng ny ca khoang ming xut

Chng 2: L thuyt m thanh v ting ni

2009

n mn hc 2

hin nh cc phn cng hng, hay cc im khng ca hm truyn t. Ngoi ra, cc ph m

mi cn c c trng bi nhng s cng hng mnh hn v ph so vi cc nguyn m.
Cc ph m xc v thanh nh /s/, /sh/. H thng to ra cc ph m xc v thanh bao gm
mt ngun nhiu ti mt im tht m chia ng dn m thnh hai khoang. m thanh c bc x
ti khoang trc. Khoang sau c tc dng by nng lng nh trong trng hp ph m mi, v
nh vy l a cc phn cng hng vo m thanh u ra. Bn cht khng tun hon l c
trng c bn nht ca ngun kch thch xc v thanh.
im khc bit ca cc m xc hu thanh nh /v/, /th/ so vi cc ph m xc v thanh l
ch c hai ngun kch thch lin quan ti vic to ra chng. Nh vy c trng ca ph m xc
hu thanh l bao gm c hai thnh phn kch thch tun hon v nhiu.
Cc m dng l cc ph m /b/, /d/, /g/, /p/, /t/ v /k/ chng c thi gian tn ti rt
ngn.Cc m dng c tnh cht ng v th cc thuc tnh ca chng chu nh hng rt nhiu
bi nguyn m i sau n.

- ht Chng 2 -

Chng 2: L thuyt m thanh v ting ni

2009

n mn hc 2
CHNG 3:

L THUYT NHN DNG TING NI

3.1 Tng quan v nhn dng ting ni

Nhn dng ting ni l mt h thng to kh nng my nhn bit ng ngha ca li
ni. V bn cht, y l qu trnh bin i tn hiu m thanh thu c ca ngi ni qua
Micro, ng dy in thoi hoc cc thit b khc thnh mt chui cc t. Kt qu ca qu
trnh nhn dng c th c ng dng trong iu khin thit b, nhp d liu, son tho vn
bn bng li, quay s in thoi t ng hoc a ti mt qu trnh x l ngn ng mc
cao hn.

D liu ting ni

M hnh
m thanh

Tn hiu
u vo

Trch chn
c trng

M hnh
t vng

M hnh
ha,
Phn lp

M hnh
ngn ng

Tm kim,
i snh

T c
nhn

Hnh 3.1.1: Cc phn t c bn ca mt h thng nhn dng ting ni

Cc h thng nhn dng ting ni c th c phn loi nh sau:
Nhn dng t pht m ri rc/lin tc;
Nhn dng ting ni ph thuc ngi ni/khng ph thuc ngi ni;
H thng nhn dng t in c nh (di 20 t)/t in c ln (hng nghn t);
Nhn dng ting ni trong mi trng c nhiu thp/cao;
Nhn dng ngi ni.
Trong h nhn dng ting ni vi cch pht m ri rc c khong lng gia cc t
trong cu. Trong h nhn dng ting ni lin tc khng i hi iu ny. Ty thuc vo
quy m v phng php nhn dng, ta c cc m hnh nhn dng ting ni khc nhau.
Hnh 3.1.1 l m hnh tng qut ca mt h nhn dng ting ni in hnh .
Tn hiu ting ni sau khi thu nhn c lng t ha s bin i thnh mt tp
cc vector tham s c trng vi cc phn on c di trong khong 10-30 ms. Cc

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

c trng ny c dng cho i snh hoc tm kim cc t gn nht vi mt s rng

buc v m hc, t vng v ng php. C s d liu ting ni c s dng trong qu
trnh hun luyn (m hnh ha/phn lp) xc nh cc tham s h thng.

3.2 Cc nguyn tc c bn trong nhn dng ting ni

Cc nghin cu v nhn dng ting ni da trn ba nguyn tc c bn:
Tn hiu ting ni c biu din chnh xc bi cc gi tr ph trong mt
khung thi gian ngn. Nh vy ta c th trch ra c im ting ni t nhng khong thi
gian ngn v dng cc c im ny lm d liu nhn dng ting ni.
Ni dung ca ting ni c biu din di dng ch vit, l mt dy cc k
hiu ng m. Do ngha ca mt pht m c bo ton khi chng ta phin m pht
m thnh dy cc k hiu ng m.
Nhn dng ting ni l mt qu trnh nhn thc. Ngn ng ni l c ngha, do
thng tin v ng ngha v suy oan c gi tr trong qu trnh nhn dng ting ni nht
l khi thng tin v m hc l khng r rng.

3.3 Cc h thng nhn dng ting ni:

Cc h thng nhn dng ting ni c th c phn chia thnh hai loi khc nhau:
h thng nhn dng t ri rc v h thng nhn dng t lin tc. Trong h thng nhn
dng ting ni lin tc, ngi ta li phn bit h thng nhn dng c kch thc t in
nh v h thng nhn dng vi kch thc t in trung bnh hoc ln. Hnh 3.3.1 cho ta
cc lp h thng nhn dng ting ni khc nhau.

H thng nhn
dng

H thng nhn dng

t ri rc

H thng nhn dng

t lin tc

H thng vi
kch thc b
t in nh

H thng vi kch
thc t in
trung bnh v ln

Hnh 3.3.1: Cc h thng nhn dng ting ni

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Trong h thng nhn dng t ri rc, cc pht m c nhn dng c gi thit

l ch bao gm mt t hoc mt nhm t c lp. Cc t c nhn dng m khng ph
thuc vo ng cnh ca n. Nhn dng ting ni vi cc t ri rc c ng dng trong
cc chng trnh dng cu lnh-iu khin (command-control), chng hn nh ng dng
quay s bng ging ni trong in thoi di ng. Bi ton nhn dng ting ni cc t ri
rc r rng l d hn rt nhiu so vi bi ton nhn dng ting ni lin tc v ranh gii
tri v phi ca cc t c coi mc nhin l c xc nh. Tuy nhin trong thc t
vic tm ranh gii cc t trong mt pht m lin tc khng phi lc no cng l d dng.

3.4 Cc qu trnh nhn dng ting ni:

Hnh 3.4.1 sau y cho ta thy cc bc c bn ca mt h thng nhn dng ting
ni, gm c ba giai on: phn tch c tnh, phn lp mu v x l ngn ng.

Dy cc
Tn hiu
c tnh
ting ni Phn tch
ph
c tnh

Phn lp
mu

Dy cc
t hoc
m v

X l
ngn ng

T, cu
c nhn
dng

Cc t,
m v

Cc t,
cu

M hnh m hc

M hnh ngn ng

Hnh 3.4.1: Cc qu trnh nhn dng ting ni

3.4.1 Phn tch cc c trng (tham s) ting ni
Qu trnh ny loi b nhng thng tin khng quan trng nh ting n ca mi
trng, nhiu trn ng truyn, cc c im ring bit ca ngi ni...Ting ni c
phn tch theo cc khung thi gian gi l frame. Kt qu ra ca giai oan ny l cc
vector c tnh ca mi khung tn hiu ting ni.
C 2 cch thng dng hin nay thng c p dng phn tch tn hiu ting
ni l phng php m phng li qu trnh cm nhn m thanh ca tai ngi v
phng php m phng li qu trnh to m ca c quan pht m. C hai cch ny
u ang c p dng thnh cng trong cc h thng nhn dng. Tuy nhin cc phng
php phn tch ting ni hin nay mi ch thc hin c cng vic nh so vi h thng
pht m v nhn thc m thanh ca con ngi. S ci tin ca cc phng php ny s
dn ti nng cao nng lc nhn dng ca cc h thng nhn dng ting ni.

10

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Hai phng php trch chn c trng ting ni ang c s dng rng ri hin
nay trong cc h thng nhn dng hin nay: MFCC ( melscale frequency cepstral
coefficients) v PLP ( Perceptual Linear Prediction).
Phn tch cepstral theo thang o mel MFCC
Phng php c xy dng da trn s cm nhn ca tai ngi i vi cc di
tn s khc nhau. Vi cc tn s thp (di 1000 Hz), cm nhn ca tai ngi l tuyn
tnh. i vi cc tn s cao, bin thin tun theo hm logarit. Cc bng lc tuyn tnh
tn s thp v bin thin theo hm logarit tn s cao c s dng trch chn cc
c trng m hc quan trng ca ting ni.
Ngi ta chn tn s 1kHz, 40 dB trn ngng nghe l 1000 Mel. Cng thc gn ng
biu din quan h tn s thang mel v thang tuyn tnh nh sau:
mel(f) = 2595*log 10(1+f/700)
Mt phng php chuyn i sang thang mel l s dng bng lc (Hnh 3.4.2),
trong mi b lc c p ng tn s dng tam gic. S bng lc s dng thng trn 20
bng. Thng thng, ngi ta chn tn s t 0 dn Fs/2 (Fs l tn s ly mu ting ni).
Nhng cng c th mt di tn gii hn t LOFREQ n HIFREQ s c dng lc i
cc tn s khng cn thit cho x l. Chng hn, trong x l ting ni qua ng in
thoi c th ly gii hn di tn t LOFREQ=300 n HIFREQ=3400.

Tn s

Tn s mel
Hnh 3.4.2: Cc bng lc tam gic theo thang tn s Mel
Phng php m d on tuyn tnh LPC
M hnh LPC c s dng trch lc cc tham s c trng ca tn hiu ting
ni. Kt qu ca qu trnh phn tch tn hiu thu c mt chui gm cc khung ting
ni. Cc khung ny c bin i nhm s dng cho vic phn tch m hc.

11

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Ni dung phn tch d bo tuyn tnh l: mt mu ting ni c xp x bi t

hp tuyn tnh ca cc mu trc . Thng qua vic ti thiu ha tng bnh phng sai
s gia cc mu hin ti vi cc mu d on c th xc nh c mt tp duy nht cc
h s d bo. Cc h s d bo ny l cc trng s c s dng trong t hp tuyn tnh.
Vi dy tn hiu ting ni s(n), gi tr d bo c xc nh bi:

trong k : l cc h s c trng cho h thng.

Hm sai s d bo c tnh theo cng thc:

cc tiu ha li cn tm tp gi tr { k } ph hp nht.
Phng php PLP
Phng php ny l s kt hp ca hai phng php trnh by trn
3.4.2 Phn lp mu:
bc ny, h thng s gn dy cc vector c tnh thnh dy cc ti u n v
ting ni c bn. C bn phng php hay c p dng l: i snh mu, rule-based,
m hnh Markov n, mng Neuron
Nguyn tc c bn ca i snh mu l ct gi mt s lng cc mu ting
ni, bao gm cc vector c tnh.Tn hiu ting ni cn nhn dng c phn tch v cc
vector c tnh ca chng s c so snh vi cc mu c ct gi trc . Do tc
pht m l rt khc nhau, k thut DWT (Dynamic Time W arping)c p dng
dn hoc co hp thi gian trn trc thi gian nhm gim s khc bit so vi cc mu.
H thng rule-based xy dng mt lot cc tiu chun trn mt cy quyt nh
xc nh xem n v no ca ngn ng nm trong tn hiu ting ni. i vi h thng
nhn dng ting ni ln, phng php ny gp kh khn trong tng qut ha s a dng
ca tn hiu ting ni. Mt vn na l vi cy quyt nh rt kh phc hi li nu nh
mt quyt nh sai c xc nh ngay t khi bt u phn tch.
M hnh Markvo n c nghin cu rng ri gn y nh l mt cng c mnh
c p dng thnh cng trong nhn dng ting ni. a s cc h thng nhn dng ting
ni u dng m hnh Markov n. Chi tit v m hnh Markov n s c trnh by trong
mc 3.6.2.

12

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Mng neuron c p dng trong nhn dng ting ni t nhng nm 1980 vi

mong mun s dng kh nng phn lp mnh ca mng. Mng neuron truyn thng a
lp perceptron thng c s dng trong nhn dng ting ni. Tuy nhin mng neuron
c hn ch v kh nng m hnh ho s bin thin ca ting ni theo thi gian. M hnh
mng Neuron s c trnh by trong chng 4.

3.4.3 X l ngn ng:

Mc ch ca m hnh ny l tm ra xc sut ca t trong pht m theo sau cc t.
Mt phng php n gin hay c p dng l dng N-gram, vi gi thit rng t
ch ph thuc vo n-1 cc t ng trc n.
M hnh ngn ng N-gram cng mt lc cha ng cc thng tin v c php, ng
ngha, suy on v chng tp trung vo s ph thuc ln cn ca mt t. Cc xc sut ca
m hnh ngn ng c th c tnh ton trc tip t c s d liu m khng cn n cc
lut ngn ng nh ng php hnh thc ca ngn ng.
V mt nguyn tc cc xc sut ca m hnh ngn ng c th c tnh ton trc
tip t s ln xut hin ca cc t trong c s d liu.
Tuy nhin vn kh khn c bn ca m hnh ngn ng l s lng cc b ba l
qu ln. Do s c nhiu b ba khng xut hin hoc xut hin rt t ch mt hoc hai
ln trong c s d liu.
Mc d c kh khn v tnh ton, m hnh ngn ng vn chng minh c l
chng ng vai tr quan trng trong cc h thng nhn dng. Trong cc h thng nhn
dng vi kch thc ln hin nay.

3.5 Cc tip cn nhn dng ting ni

V c bn c ba tip cn nhn dng ting ni chnh nh sau:
1. Tip cn m thanh-ng m.
2. Tip cn nhn dng mu.
3. Tip cn tr tu nhn to.
3.5.1 Tip cn m thanh-ng m
Phng php ny da trn l thuyt v m hc-Ng m hc. L thuyt cho
bit c s tn ti ca cc n v ng m trong ngn ng ting ni; cc n v ng m
ny c biu din c trng bi mt tp hp nhng thuc tnh th hin trong tn hiu m
thanh hay biu din ph theo thi gian. Cch tip cn ny c 2 bc:
Bc 1: phn on v gn nhn. Gn mt hoc nhiu nhn ng m cho
mi vng phn on da theo cc thuc tnh m hc.

13

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Bc 2: nhn dng ting ni. C gng xc nh mt t hp l (hay chui

t hp l) t mt chui cc nhn ng m thu c t bc 1 da trn c s cc rng buc
(v t vng v c php) ca tc v cn nhn dng ting ni.
S khi ca phng php ny c biu din Hnh 3.5.1

B tch
c trng

Tn hiu
ting
ni

B tch
c trng
Trch
chn
c trng

.
.
.

Ting ni
c nhn
dng

Phn
on
V

Chn
la

gn nhn

B tch
c trng

Hnh 3.5.1: S khi nhn dng ting ni theo m hc-Ng m hc

Nguyn l hot ng ca phng php c th m t nh sau:
Trch chn c trng: Tn hiu ting sau khi s ha c a ti khi trch chn
c trng nhm xc nh cc ph tn hiu. Cc k thut trch chn c trng ting ni ph
bin l s dng bng lc (filter bank), m ha d on tuyn tnh (LPC)
Tch tn hiu ting ni: nhm bin i ph tn hiu thnh mt tp cc c tnh
m t cc tnh cht m hc ca cc n v ng m khc nhau. Cc c tnh c th l:
tnh cht cc m mi, m xt; v tr cc formant; m hu thanh, v thanh; t s mc nng
lng tn hiu
Phn on v gn nhn: bc ny h thng nhn dng ting xc nh cc
vng m thanh n nh (vng c c tnh thay i rt t) v gn cho mi vng ny mt
nhn ph hp vi c tnh ca n v ng m. y l bc quan trng ca h nhn dng
ting ni theo khuynh hng m hc-Ng m hc v l bc kh m bo tin cy
nht.

14

Chng 3: L thuyt nhn dng ting ni

 n mn hc 2

2009

Nhn dng: Chn la kt hp chnh xc cc khi ng m to thnh cc t

nhn dng.
c im ca phng php nhn dng ting ni theo hng tip cn m hc-Ng
m hc:
Ngi thit k phi c kin thc kh su rng v m hc-Ng m hc.
Phn tch cc khi ng m mang tnh trc gic, thiu chnh xc.
Phn loi ting ni theo cc khi ng m thng khng ti u do kh s dng
cc cng c ton hc phn tch.

3.5.2 Tip cn nhn dng mu

V c bn y l mt quan im s dng trc tip cc mu ting ni (chnh l
on ting ni cn nhn dng) m khng cn xc nh tht r cc c trng v cng
khng cn phn on tn hiu.Phng php ny cng c 2 bc:
Bc 1: tch ly cc mu ting ni: S dng tp mu ting ni (c s d
liu mu ting ni) o to cc mu ting ni c trng (mu tham chiu) hoc cc
tham s h thng.
Bc 2: nhn dng mu: i snh mu ting ni t ngoi vi cc mu c
trng ra quyt nh.
Trong phng php ny, nu c s d liu ting ni cho o to c cc phin
bn mu cn nhn dng th qu trnh o to c th xc nh chnh xc cc c tnh m
hc ca mu (cc mu y c th l m v, t, cm t). Hin nay, mt s k thut
nhn dng mu c p dng thnh cng trong nhn dng ting ni l lng t ha
vector, so snh thi gian ng (DTW), m hnh Markov n (HMM), mng nron nhn
to (ANN). H thng bao gm cc hot ng sau:
Trch chn c trng: Tn hiu ting ni c phn tch thnh chui cc s o
xc nh mu nhn dng. Cc s o c trng l kt qu x l ca cc k thut phn tch
ph nh: lc thng di, phn tch m ha d on tuyn tnh (LPC), bin i Fourier ri
rc (DFT).
Hun luyn mu: Nhiu mu ting ni ng vi cc n v m thanh cng loi
dng o to cc mu hoc cc m hnh i din, c gi l mu tham chiu hay mu
chun.
Nhn dng: Cc mu ting ni c a ti khi phn loi mu. Khi ny i
snh mu u vo vi cc mu tham chiu. Ki nhn dng cn c vo cc tiu chun
nh gi quyt nh mu tham chiu no ging mu u vo.

15

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Tip cn nhn dng mu thng c la chn cho cc ng dng nhn dng ting
ni bi cc l do sau:
Tnh d s dng v d hiu trong thut ton.
Tnh bt bin v kh nng thch nghi i vi nhng t vng, ngi
s dng, cc tp hp c trng, cc thut ton so snh mu v cc quy tc quyt nh
khc nhau.
Khng nh tnh nng cao trong thc t.

3.5.3 Tip cn tr tu nhn to:

Tip cn tr tu nhn to l tip cn c gng my mc ha chc nng nhn dng
theo cch m con ngi p dng tr thng minh ca mnh trong vic quan st, phn tch
v thc hin nhng quyt nh trn cc c trng m hc ca tn hiu. Phng php ng
dng tr tu nhn to kt hp cc phng php trn nhm tn dng ti a cc u im ca
chng. S khi ca phng php tr tu nhn to theo m hnh t di ln (bottom-up)
(Hnh 3.5.3).

Ting ni
Phn tch tn hiu
Trch chn c trng

m hu thanh/V
thanh/ Khong lng

Cc
Phn on
ngun
kin

Gn nhn

Nguyn tc phn loi

thc

Phn lp m thanh

Nguyn tc ng m

Xc nh t

Truy cp t in

Xc nh cu

M hnh ngn ng

Hnh 3.5.3: S khi h nhn dng ting ni theo phng php t di ln

16

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2
c im ca cc h thng nhn dng theo phng php ny l:

S dng h chuyn gia phn on, gn nhn ng m. iu ny lm n gin

ha h thng so vi phng php nhn dng ng m.
S dng mng nron nhn to hc mi quan h gia cc ng m, sau dng
n nhn dng ting ni.
Vic s dng h chuyn gia nhm tn dng kin thc con ngi vo h nhn dng:
Kin thc v m hc: phn tch ph v xc nh c tnh m hc ca cc mu
ting ni.
Kin thc v t vng: s dng kt hp cc khi ng m thnh cc t cn nhn
dng.
Kin thc v c php: nhm kt hp cc t thnh cc cu cn nhn dng.
Kin thc v ng ngha: nhm xc nh tnh logic ca cc cu c nhn dng.
C nhiu cch khc nhau tng hp cc ngun kin thc vo b nhn dng ting
ni.
Phng php thng dng nht l x l t di ln. Theo cch ny, tin trnh x
l ca h thng c trin khai tun t t thp ln cao. Trong Hnh 3.5.3, cc bc x l
mc thp (phn tch tn hiu, tm c tnh, phn on, gn nhn) c trin khai trc
khi thc hin cc bc x l mc cao (phn lp m thanh, xc nh t, xc nh cu).
Mi bc x l i hi mt hoc mt s ngun kin thc nht nh. V d: bc phn
on ting ni cn hiu bit su sc v c tnh m hc-Ng m hc ca cc n v ng
m; bc xc nh t i hi kin thc v t vng; bc xc nh cu i hi kin thc
v m hnh ngn ng (nguyn tc ng php).

3.6 Cc phng php nhn dng ting ni

3.6.1 M hnh Fujisaki:
M hnh Fujisaki:

Fujisaki l mt m hnh nh lng dng m hnh ha ng iu. M hnh

Fujisaki hng vo vic m hnh ha qu trnh sinh ra t n s c bn F0, gii thch v mt
vt l hc, sinh l hc qu trnh sinh ra F0 v cc tnh cht ca qu trnh . M hnh
c p dng ch yu trong ng dng tng hp nhm xy dng phn ng iu trong
ting ni tng hp.
M hnh sinh ra F0 theo 3 cng thc sau:

17

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2
I

i =1

j =1

ln F 0(t ) = ln Fb + Api Gp(t T0i ) + Aa j Ga(t T1 j ) Ga(t T2 j )

2 t exp( t ), t 0
Gp ( t ) =
0, t < 0

(3.6.1.1)

(3.6.1.2)

min[ 1 (1 + t ) exp( t ), ]
Gp ( t ) =
0, t < 0

t 0

(3.6.1.3)

Cc tham s ca m hnh gm c:
Cc hng s: Fb l gi tr khi u ca ng tn s c bn. Fb l gi tr ph
thuc vo ngi ni ch khng ph thuc vo cc mu ting ni. Gi tr l tn s gc t
nhin ca lnh ng. Gi tr l tn s gc t nhin ca lnh trng m. Gi tr l mc gi
tr trn tng ng vi cc thnh phn trng m.
Cc i s: I l s lnh ng. J l s lnh trng m. Api l cng ca lnh ng
th i. Aaj l bin ca trng m th j. T0i l thi im bt u lnh ng th i. T1j v T2j
l thi im bt u v kt thc thanh iu lnh trng m th j.
Trong m hnh, ng F0 c xt min logF0, mc ch ca php bin i
ny l lm cho ging ni ca nam v n ging nhau. Theo (3.6.1.1) cc gi tr =2.0/s v
=20.0/s, trong mt s trng hp c bit =3.0/s. Tuy nhin theo quan st th nm
trong khong [1.0;3.0], cn thuc khang [19.5;20.5].
Cc tham s Ap,,,Aa,T1,T2,Fb c gi l cc tham s Fujisaki v phng php
phn tch bng tng hp bng ng nt F0 s dng m hnh Fujisaki c gi l phn
tch Fujisaki. Cc tham s ca m hnh c th c sinh ra t ng bi nhiu cch khc
nhau ty vo tng ngn ng c phn tch.
Phn tch thanh iu ting Vit bng m hnh Fujisaki:

C s d liu: phn tch ng nt F0 ca thanh iu ting Vit v s lin cu

m gia cc thanh iu lin k, mt tp gm 72 cu ni, mi cu ni gm 6 m tit c
xy dng t cu gc nha mai lm nhan nhiu ng, mi m tit trong cu gc s mang
cc thanh iu khc nhau th hin nhiu t hp thanh iu lin k nh:
1) Nh mai lm nhn nhiu ng
2) Nh mi lm nhan nhiu ng
3) Nha mi lm nhn nhiu ng
.................................................

18

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Cc cu c pht m vi ging chun min Bc bi hai ngi mt nam v mt

n. m bo tnh t nhin ca li ni, hai ngi ni u c chun b trc, cc cu
ni c pht m nhiu ln v kim tra li chn cu ni t nhin nht
Phng php phn tch: phn tch ng nt F0,phn tch cc
tham s ca m hnh Fujisaki. Fb c t bng 96Hz cho ging nam v 210Hz cho
ging n. v cho c ging nam v n c ln lt t bng 2Hz v 25Hz.
Cc bc tin hnh phn tch bao gm:
Tnh ng nt F0
La cc chn lnh ng cu ni.
Da vo thanh iu ca cc m tit la chn cc lnh thanh iu ph hp.
iu chnh cc tham s sao cho ng nt F0 sinh ra sp x F0 thc.
Tng hp li cu ni vi ng nt thanh iu mi s dng phng php
PSOLA.
6) Cm nhn bng tai cu ni tng hp, so snh vi cu ni gc v iu chnh
li.

1)
2)
3)
4)
5)

Kt qu phn tch thanh iu bng m hnh Fujisaki:

Phn tch c s d liu cho thy, cc thanh ngang, sc, ng c biu din bng
mt lnh thanh iu dng, thanh huyn v hi c biu din bng mt lnh thanh iu
m, thanh nng khng cn lnh thanh iu.
Thanh iu
Ngang
Sc
Hi
Huyn
Ng
Nng

Biu din bng lnh thanh iu

1 lnh thanh iu dng trc m tit
1 lnh thanh iu dng
1 lnh thanh iu m
1 lnh thanh iu m
1 lnh thanh iu dng
Khng dng lnh thanh iu

Cc cu c phn tch ch s dng mt lnh ng cho c cu, ph hp vi hin

tng trong cu ni, ngi ni thng ln ging u cu v h ging cui cu.Tuy
nhin trong ting Vit hin tng ny khng r rt nh cc ngn ng khc nn cng
ca lnh ng ny khng ln.
Kt lun:

M hnh v c bn khng th p dng cho bi ton nhn dng ting ni c. L

do ch yu l m hnh ny thc cht tng hp ng F0 mt cch tuyn tnh. Cc kt qu
phn tch thanh iu ting Vit chng t rng c th p dng m hnh fujisaki vo vic
m hnh ha ting Vit.T nng cao cht lng ca h thng tng hp ting ni v cc
kt qu phn tch cng c th p dng kt qu tnh ton ng m hc vo nhn dng ting
ni.

19

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

3.6.2 M hnh Markvo n

a. Qu trnh Markov n:

Ta hy xem xt s tin trin theo thi gian ca mt h thng no (c th l mt

h vt l hay h sinh thi, ...), k hiu qt l v tr ca h ti thi im t. Cc v tr c th c
c ca h c gi l khng gian trng thi, k hiu l S= {S1, S2, S3, ...}. Gi s
thi im s h trng thi Si , nu xc sut h trng thi Sj thi im t trong tng
lai ch ph thuc vo s, t, Si, Sj th c ngha l s tin trin ca h ch ph thuc vo hin
ti v c lp vi qu kh. Ta gi l tnh Markov v h c tnh cht ny c gi l
qu trnh Markov.
Nu khng gian trng thi S ca h l m c th ta gi h l xch Markov. Nu
thi gian t l ri rc t=0,1,2,... th ta c xch Markov ri rc. Ta c th biu din tnh
Markov ca h bng biu thc sau :

P(qt = Sj | qt-1 = Si, qt-2 = Sk,...) = P(qt = Sj | qt-1 = Si)

t P(s,i,t,j) = P(qt = Sj | qs = Si ) l xc sut h ti thi im s trng thi i,
n thi im t chuyn sang trng thi j. Ta gi P(s,i,t,j) l xc sut chuyn ca h. Nu
xc sut chuyn ch ph thuc vo (t-s) tc l

P(s,i,t,j)= P(s+h,i,t+h,j)
th ta ni h l thun nht theo thi gian.

Hnh 3.6.1 Xch Markov vi nm trng thi S1, S2, ..., S5 v

cc xc sut chuyn trng thi.
Ti mi thi im t=0,1,2,... h chuyn trng thi theo xc sut chuyn trng thi
aij tng ng vi mi trng thi.

20

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

Ngai ra ta nh ngha xc sut trng thi khi u (initial state distribution )

={ 1, 2, ..., N}, trong i l xc sut trng thi i c chn ti thi im khi u
t=1.
i=P(q1=Si).

Qu trnh Markov miu t trn c gi l mt m hnh Markov quan st c

(observable Markov model). u ra ca qu trnh l mt tp cc trng thi ti cc thi
im ri rc lin tip nhau, trong mi s kin tng ng vi mt s kin vt l c th
quan st c (observation event).
V d : Ta xt mt m hnh Markov ba trng thi miu t thi tit: S1, S2, S3.
Trong mt ngy thi tit c th l mt trong ba trng thi :
S1: ma
S2: my
S3: nng
ma trn xc sut chuyn l
A= {aij} ={0.4 0.3 0.3; 0.2 0.6 0.2; 0.1 0.1 0.8}
Gi thit l thi tit ti ngy t=1 l nng. Ta s tm xc sut trong 5 ngy lin
tip c thi tit nh sau : nng, nng, ma, ma, my. Tc l ta c mt dy cc quan st
(observation) O= S3, S3, S1, S1, S2, tng ng vi cc thi im t=1,2,3,4,5
P(O|M hnh) = P(S3, S3, S1, S1, S2 | M hnh)
= P(S3).P(S3|S3).P(S1|S3).P(S1|S1). P(S2|S1)
= 3.a33.a33. .a31.a11.a12
= 1. (0.8). (0.8). (0.1).(0.4). (0.3)
= 768. 10-4
b. M hnh Markov n: ( Hidden Markov Model - HMM)

M hnh Markov m mi mt trng thi tng ng vi mt s kin quan st c

m rng bng cch cc quan st (observation) tng ng vi cc trng thi l mt hm
xc sut ca cc trng thi. M hnh ny gi l m hnh Markov n v l mt qu trnh
ngu nhin kp, trong c mt qu trnh ngu nhin khng quan st c. Tp cc quan

21

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

st O c sinh ra bi dy cc trng thi S1, S2, ..., SN ca m hnh, m dy cc trng

thi ny l khng thy c, chnh l l do m hnh c gi l m hnh Markov n
(hidden).
M hnh Markov n l m hnh thng k trong h thng c m hnh ha
c cho l mt qu trnh Markov vi cc tham s khng bit trc v nhim v l xc
nh cc tham s n t cc tham s quan st c, da trn s tha nhn ny. Cc tham
s ca m hnh c rt ra sau c th s dng thc hin cc phn tch k tip, v d
cho cc ng dng nhn dng mu.
M hnh Markvo n s dng k thut lng t ha vector dng ly trung bnh
c tnh ca cc frame cng nh nh nhn cc vector.
M hnh Markvo n c s dng rng ri trong nhn dng ting ni v n c kh
nng m hnh ha thng tin theo thi gian ca tn hiu ting ni,trong khi mng nron c chng minh l mt cng c mnh m cho vic phn lp tnh do bn thn
mang n-ron c tnh phn bit mt cch t nhin.S kt hp gia mng n-ron vi m
hnh Markvo n nhm tng chnh xc nhn dng.

c. Cc thnh phn ca HMM:

M hnh markvo n gm mt xch Markvo. Mi vng trn biu din mt trng

thi ca m hnh v thi im ri rc t, tng ng vi mt frame ting ni, m hnh s
mt trong nhng trng thi ny v to ra mt mu ting ni hay mt quan st. thi
im t+1 m hnh s di chuyn n trng thi mi hay vn trng thi c v to ra mt
mu khc. Lp li qu trnh ny cho n khi to ra ton b cc b mu.
Cc thnh phn ca HMM :
1. N l s trng thi ca m hnh, {1, 2,,N} l cc trng thi, trng thi thi
im t l qt.
2. M l s lng quan st phn bit, k hiu tp cc quan st l V ={v1, v2,vM }.
i vi ting ni, M l s lng vector ca code book sau khi lng t ha vector, cn vi
l m ca tng vector.
3. Ma trn xc sut trng thi v tr A= { aij } aij l xc sut t trng thi i
thi im t n trng thi j thi im t+1
aij = P[qt+1 = j| q t =i]
N

Ch rng

a
j =1

ij

1 i, j N

= 1 vi mi i,j. Tng qut t mt trng thi c th chuyn n

mt trng thi bt k, ngha l aij >0 vi mi i,j. Tuy nhin i vi ting ni c th aij = 0
cp i,j no .

22

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

4. Ma trn xc sut quan st B= {bj(k) } bj(k) l xc sut to ra quan st vk

khi m hnh ang trng thi j.
1kM

bj(k) = P[0 t = vk| qt=j],

M

Ch rng

b (k ) = 1 vi mi j, k.
k =1

5. Ma trn xc sut trng thi ban u ={i } i l xc sut m hnh trng

thi i ti thi im t=0.
i = P[qt = i],
N

Ch rng

i =1

1 i N

= 1 vi mi j.

C th biu din HMM bng s lng trng thi N ,s lng quan st M, ba ma

trn xc sut A, B, . M hnh ny c gi l n v khng th xc nh c cc trng
thi to ra tng ng vi cc quan st cho.Ta k hiu HMM l = ( A, B, ).
d. nh gi xc sut:

Mun tnh xc sut ca quan st O = ( o 1, o 2, , o T ) tc l tnh P(O|) ta s dng

cc thut ton sau:
Thut ton tin hay Baum-welch:
Kho st bin tin t(i) c nh ngha nh sau:
t(i) = P (o1, o2,,ot, qt = i| )
tc l xc sut ca min quan st o1, o 2,,o t ( n thi im t) v trng thi i thi im
t, ng vi m hnh . Ta c th tnh t(i) bng qui np nh sau:
Bc 1: Khi to
t(i) = ibi(o1)

1 i N

Bc 2: Qui np

t +1 ( j ) = t (i)aij b j (ot +1 )
i =1

1 t T 1
1 j N

Bc 3: Kt thc

23

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2
N

P(O | ) = T (i )
i =1

Thut ton li:

Tng t ta nh ngha bin li t(i) nh sau:
t(i) = P (ot+1, ot+2,,oT|qt = i,)
tc l xc sut ca min quan st t t+1 n thi im T v trng thi i thi im t, ng
vi m hnh .
Ta c th tnh t(i) bng qui np nh sau:
Bc 1: Khi to:
T(i)=1

1 i N

Bc 2: Qui np:
t = T 1, T 2,...1
1 i N

t (i) = aij b j (ot +1 ) t +1 ( j)

j =1

Thut ton ny ch cn N2T php tnh v dng cu trc li.

Thut ton Viterbi:
Thut ton Baum-welch khng xc nh c m hnh ang trng thi no.
Nhm khc phc trng thi n ny, ta s dng thut ton Viterbi tm chui trng thi
n tt nht q = ( q 1, q2, qT) ng vi chui quan st O = ( o1, o2, , o T ) cho.Ta cn
nh ngha i lng
t(i) = max P[q1q2qt-1,qt = i, o 1, o2, , o t| ]
tc l t(i) c im tt nht (xc sut ln nht) trn con ng n, ti thi im t ng
vi quan st cho v kt thc trng thi i. Qui np ta c:
t +1 ( j) = [max t (i)aij ].b j (ot +1 )
i

Mun xc nh chui trng thi, ta s dng mng t(j) lu li i s lm cho

phng trnh trn cc i tng thi im t v trng thi i.
Thut ton tm chui trng thi tt nht c m t nh sau:
Bc 1: Khi to:

24

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

1(i) =ibi (oi )

1i N

1 (i) = 0
Bc 2: qui

t ( j ) = max t 1 (i)aij b j (ot )

1i N

t ( j ) = argmax t 1 (i )a ij
1i N

2 t T
1 j N
2t T
1 j N

Bc 3: Kt thc

P * = max [ T ( i ) ]
1 i N

q T* = arg max [ T ( i ) ]
1 i N

Bc 4: Ln ngc con ng ( chui trng thi)

qt* =t +1(qt*+1)

t = t 1,T 2,....,1

e. c lng tham s:

Kh khn nht ca m hnh Markvo n l tm ra phng php iu chnh tham s

ca m hnh ( A, B, ) sao cho tha mn tiu chun ti u no . Khng c cch phn
tch no c th iu chnh c tham s ca m hnh sao cho t c xc sut ln nht
ng vi quan st cho. Tuy nhin ta c th chn = ( A, B, ) sao cho xc sut
P(O, ) l cc i a phng theo phng php k vng cc i-expectation
maximization (EM).
Ta cn nh ngha cc i lng sau:

Bin xc sut hu nghim tc l xc sut trng thi i ti thi im t, ng

vi quan st cho l O v m hnh
t(i) = P(qt =i | O, )
t(i) =

25

P (O,qt = i| )
P (O| )

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2
t(i) =

t (i ) t (i )
N

(i) (i)
T

i =1

nh ngha t( i,j) l xc sut ang trng thi i ti thi im t v trng

thi j ti thi im t+1, ng vi quan st cho l O v m hnh tc l:
t ((i, j ) = P(q t = i, q t +1 = j | O , )
t (i, j ) =

P ((qt = i, qt +1 = j | O , ))
P (O | )

(i )a ij b j (o t + 1 ) t + 1 ( j )
P (O | )

t (i )a ij b j (o t +1 ) t +1 ( j )
N

(i)a
t

i =1 j =1

ij

b j (o t +1 ) t +1 ( j)

Mi lin h gia t(i) v t( i,j) l:

N

t (i) = t (i, j ) .
j =1

Vy:
T 1

(i) = k vng s lng v tr ti trng thi i ng vi O.

t

t =1

T 1

(i , j ) =
t =1

k vng s lng v tr t trng thi i ti trng thi j ng

vi O.
Tp cc cng thc c lng A, B v nh sau:

= k vng tn s ( s ln ) trng thi i ti thi im t=1

= 1 (i )

26

P (O ,q1 = i| )
P (O | )

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2
=

1 (i ) 1 (i )

(3.6.2.1)

(i)
T

i =1

K vng s lng v tr t trng thi i ti trng thi j

aij =

K vng s lng v tr t trng thi i

T 1

(i, j )
i =1
T 1

(i)
t

i =1

T 1

(i)a b (o )
t

t =1

ij

t +1

t +1

( j)
(3.6.2.2)

T 1

(i) (i)
t

t =1

K vng s lng trng thi j v quan st v k

b j (k ) =

K vng s lng trng thi j

T

( j) ( j)( o , v )
t =1

(3.6.2.3)

( j) ( j)
t =1

ta k hiu :
1

(o t , v k ) =

ot = v k
0 Ngc li

Nu ta gi m hnh hin ti l =(A,B, ) ri dng m hnh hin ti ny tnh v

phi ca cc phng trnh (3.6.2.1), (3.6.2.2) v (3.6.2.3) ta s c c m hnh
= A, B, Thut ton ny rt phc tp v c nhiu cc i a .Nu ta gn bng v
lp li tnh ton c lng, ta s ci thin c xc sut ca m hnh vi quan st cho
O, cho ti khi t ti trng thi ti hn.Kt qu cui cng ca phng php lp c lng
l c lng ML.Tnh cht quan trng ca phng php lp c lng l cc rng buc
thng k cho m hnh markvo n:

=1

1 i N

i =1

27

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

a
j =1

ij

=1

1 j N

(k ) = 1

k =1

f. Phn loi m hnh Markvo n:

Ta phn loi m hnh markkvo n da vo cu trc ca ma trn v tr A ca xch

markvo. C 2 loi m hnh markvo n:

M hnh markvo n kt ni y , ngha l mi trng thi ca m hnh c

th t ti nhng trng thi khc.

M hnh tri phi hay m hnh Bakis: m hnh nyc s dng thng
thng trong nhn dng ting ni. M hnh c tn gi l tri phi v cc trng thi lin
kt vi m hnh c tnh cht l khi thi gian tng, trng thi s tng ln tc l trng thi
tin dn t tri sang phi. iu ny ph hp vi cu trc t nhin ca ting ni l bin
thin theo thi gian t tri sang phi.Tnh cht c bn ca m hnh ny l cc h s ca
ma trn v tr c tnh cht a ij = 0 ( j<0) tc l khng cho php trng thi sau nh hn
trng thi hin ti. Ngoi ra xc sut trng thi ban u c tnh cht:

0
i =
1

i 1
i =1

bi v trng thi ban u bt buc l 1( v kt thc trng thi N).V m hnh cn rng
buc khng c chuyn t trng thi ny n trng thi khc qu xa,rng buc c dng:
aij= 0

j > i + i

Phn loi m hnh Markvo n theo tnh cht ca hm pht x quan st, th c 3
loi m hnh:
M hnh HMM ri rc : khng gian cc c tnh ph c chia thnh mt s
hu hn cc vng bng phng php lng t ha vector VQ.Trng tm ca mi vng
c biu din bng mt t m m thc cht l mt ch s ch ti mt sch m.Mt
khung tn hiu c bin i thnh mt t m bng cch tm mt vector gn vi n nht
trong sch m.Nhc im ca m hnh ny l c sai s trong qu trnh lng t ha nht
l nu kch thc ca sch m nh, ngc li nu kch thc sch m ln th s lng
tnh ton s tng ln.
M hnh HMM lin tc: khc phc nhc im ca m hnh trn.Trong

28

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

phng php ny th khng gian cc c tnh ph c m hnh ha bng cc hm mt

xc sut ,thng thng l hm trn vi cc hm Gaussian.Nhc im ca phng
php ny l mi trng thi u c cc tham s ca ring chng nn s lng cc tham s
l rt ln v do vy khng th trnh khi cc trng hp khng d liu hun luyn cho
cc trng thi.Ngoi ra thi gian tnh ton kh lu.
M hnh HMM bn lin tc: l s kt hp ca hai m hnh trn.M hnh ny
s ci thin thi gian tnh ton ca m hnh lin tc.
f/ T chc nhn dng t bng m hnh markvo n:
Gi s ta cn nhn dng b t vng c V t,mi t u c m hnh marvo ring
v c ni K ln ta thc hin cc bc sau:
Bc 1: vi mi t v trong b t vng , ta phi xy dng m hnh marvo n ,
tc l ta phi c lng cc tham s ca m hnh (A, B ,) sao cho ML da trn tp d
liu hun luyn.
Bc 2: vi mi t cha bit ta xy dng m hnh nhn dng nh hnh bn
di. Tn hiu ting ni c trch c im bng phng php mel-cepstrum hay LPCcepstrum, thng qua b lng t ha vector ta c c quan st O = ( o 1, o2, , o T ).Tip
theo ta tnh xc sut cho tt c cc m hnh P(O|v), 1 v V , v chn t c xc sut ln
nht, tc l:
v * =arg max[P(O| v )]
1 v V

Bc tnh xc sut thng dng thut ton Viterbi v cn V .N2.T php tnh.Vi
b t vng V=100 t, m hnh 5 trng thi v T=40 quan st cho mi t cha bit tng
cng c 103 php tnh. iu ny c th chp nhn c cho cc my tnh ngy nay.

29

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

HMM
t 1

Tnh ton
xc sut
Tn
hiu
ting
ni S

Chui
quan
Lng st O
t ha
vector

P(O|1)

HMM
t 2
2

Tnh ton
xc sut

P(O| )

[(

v * = arg max P O | V
1 v V

Chn ln
nht

.
.
.

Ch s ca t
nhn dng

HMM
t V

Tnh ton
xc sut

P(O|V)

Hnh 3.6.2: S khi h nhn dng t bng m hnh markvo n

3.6.3 M hnh mng neuron:
Mng Neuron cng c ng dng trong nhn dng ting ni. u im ca mng
neuron trong nhn dng ting ni l: th nht v tc hun luyn cng nh tc
nhn dng t ra vt tri,c th m rng b t vng. Do mng neuron c tnh linh
hot ,mm do d thch nghi vi mi trng.Ta s xem xt chi tit hn v m hnh
ny chng 4.

3.7 Nhng thun li v kh khn trong nhn dng ting Vit

Mt s c im d thy l ting Vit l ngn ng n m, khng bin hnh (
cch c cch ghi m khng thay i trong bt c tnh hung ng php no). Theo
thng k trong ting Vit c khong 6000 m tit. Nhn v mt ghi m: m tit c cu
to chung l: ph m vn. Ph m l mt m v v m v ny lin kt rt lng lo vi
phn cn li ca m tit. Vn trong ting vit li c cu to t cc m v nh hn,
trong c mt m v chnh l nguyn m

30

Chng 3: L thuyt nhn dng ting ni

)]

2009

n mn hc 2

Do nhng c im nh vy, nhn dng ting ni ting Vit c mt s thun li:

Ting Vit l ngn ng n m, s lng m tit khng qu ln. iu ny

s gip h nhn dng xc nh ranh gii cc m tit d dng hn.

Ting Vit l ngn ng khng bin hnh t. m tit ting Vit n nh, c
cu trc r rng. c bit khng c 2 m tit no c ging nhau m vit
khc nhau. iu ny s d dng trong vic xy dng cc m hnh m tit
trong nhn dng

Ngoi nhng thun li trn, nhn dng ting ni ting Vit cng gp rt nhiu kh
khn nh sau:

Ting Vit l ngn ng c thanh iu ( 6 thanh). Thanh iu l m v siu

on tnh, c trng v thanh iu th hin trong tn hiu ting ni khng
r nt nh cc thnh phn khc ca m tit.
Cch pht m ting vit thay i theo tng vng a l.
H thng ng php ng ngha ting Vit rt phc tp, rt kh p dng
vo h nhn dng vi mc ch tng hiu nng nhn dng. H thng phin
m cng cha thng nht.
Cc nghin cu nhn dng cng cha nhiu v t ph bin.

Nhng kh khn c bn trong nhn dng ting ni l ting ni bin thin theo
thi gian v c s khc bit ln gia ting ni ca nhng ngi ni khc nhau, tc ni,
ng cnh v mi trng m hc khc nhau.

- ht Chng 3 -

31

Chng 3: L thuyt nhn dng ting ni

2009

n mn hc 2

MNG NEURON

CHNG 4:

4.1 nh ngha mng neuron:

L thuyt mng neuron nhn to c xy dng xut pht t thc tin l b no
con ngi lun lun thc hin cc tnh ton mt cch hon ton khc so vi cc my tnh
s. C th coi b no l mt my tnh hay mt h thng x l thng tin song song, phi
tuyn v cc k phc tp. S m phng b no con ngi ca mng neuron l da trn c
s mt s tnh cht c th rt ra t cc nghin cu v thn kinh.
Mt neuron nhn to l mt n v tnh ton hay n v x l thng tin c s cho
hot ng ca mt mng neuron. V c bn, mng neuron l s kt hp cc thnh phn
phi tuyn vi nhau. Hnh 4.1 ch ra m hnh ca mt neuron nhn to.

Cc
tn
hiu
u
vo

H s hiu
chnh bk

x1

Wk1

x2

Wk2

.
.
.
xn

(.)

u ra
yk

Hm kch
hot

B t hp
tuyn tnh

Wkn

Cc trng
s synpase
Hnh 4.1: M hnh ca mng neuron
Mt m hnh mng neuron c ba thnh phn c bn:
1.
Mt tp hp cc synpase hay cc kt ni, m mi mt trong chng c
c trng bi mt trng s ring ca n.Tc l mt tn hiu xj ti u vo ca synpase j
ni vi neuron k s c nhn vi trng s synpase wkj. k l ch s ca neuron ti

32

Chng 4: Mng Neural

2009

n mn hc 2

u ra ca synapse ang xt. Cc trng s synpase c th nhn c gi tr m v gi tr

dng.
2.
Mt b cng tnh tng cc tn hiu u vo ca neuron, c nhn
vi cc trng s synpase tng ng; php ton c m t y to nn mt t hp
tuyn tnh.
3.
Mt hm kch hot ( activation function) gii hn bin u ra ca
neuron. Hm kch hot cng c xem nh l mt hm nn; n nn (gii hn ) phm vi
bin cho php ca tn hiu u ra trong mt khong gi tr hu hn. Hm kch hot c
nhiu kiu nh: hm ngng ,hm vng tuyn tnh, hm sigma, hm tang hyperbol.Trong
hm tan sigmoid (4.1.1) hay log sigmoid (4.1.2) hayc dng nht:
(x)= tanh(x)

( x) =

1
1 + exp( x)

(4.1.1)
(4.1.2)

Ngoi ra cn c mt h s hiu chnh bk tc ng t bn ngoi c tc dng tng

ln hoc gim i u vo thc ca hm kch hot, ty theo n dng hay m.
Tn hiu u ra c cho bi:

y k = wki xi + b
i =1

Mng neuron nhn to ang c ng dng rng ri trong cc ngnh k thut nh:
trong k thut iu khin, mng neuron c ng dng nhn dng, d bo v iu
khin cc h thng ng; trong in t vin thng th ng dng x l nh, nhn dng
nh v truyn thng; trong h thng in th ng dng nhn dng, d bo v iu
khin cc trm bin p...

4.2 Kin trc mng neuron:

Thng thng th c ba loi mng neuron:
4.2.1 Perceptron mt hay nhiu lp:
Perceptron mt lp, ch c mt lp neuron, l kin trc xut hin u tin trong
lnh vc mng neuron v khng cn s dng na v n qu n gin. Perceptron nhiu
lp-multiple layer perceptron (MLP) c s dng rng ri nht.

33

Chng 4: Mng Neural

2009

n mn hc 2
Mng Perceptron tuyn tnh n SLP

Mng SLP (Simple Linear Perceptron) bao gm mt lp nt vo (input) v lp

nt ra (output). V i mi mt vector gi tr u vo, cc gi tr input c a vo cc nt
input, v mng ANN s cho kt qu tng ng ti cc nt output. K hiu cc nt u
vo xi l x1, x2 xni , trong ni l s lng nt vo; cc nt u ra yi l y1, y2yno, n0 l
s lng nt ra. Mi mt nt input xi lin h u c mt ni kt (connection hay
synapses) vi mt nt output y i. Mi ni kt c gn mt gi tr, gi l trng s
(synapses strength), k hiu l wij. Cc tn hiu vo c lan truyn theo cc ni kt v
c nhn vi cc trng s ca mi ni kt. Tnh ton ti lp vo s c lan truyn sang
lp k tip v do vy mng c gi l lan truyn thng (feed-forward).

Hnh 4.2.1: Mng neuron Perceptron n

Ti mi nt output ca mng, cc tn hiu vo s c nhn vi cc trng s v

sau c cng li thnh gi tr output nh c miu t bi cng thc sau:

(4.2.1.1)
Gi tp d liu mu dng hun luyn l (xk, yk ). Vi tp d liu mu, mng
ANN vi cc trng s, bi ton hun luyn mng c t ra nh l iu chnh cc trng
s sao cho vi mi vector gi tr vo xk , mng cho mt kt qu tng ng y^k , gn nht
vi kt qu mong mun theo mt tiu chun no . La chn thng dng cho mt hm
tiu chun l hm bnh phng ti thiu (least square criterion).

(4.2.1.2)

34

Chng 4: Mng Neural

2009

n mn hc 2

trong , y^i,k l gi tr output ca nt ra th i tng ng vi vector gi tr vo xk. yi.k l

gi tr mong mun tng ng ca tp d liu hun luyn. K l s lng cc mu trong tp
hun luyn. Gi tr 1/2 trong cng thc vi mc ch thun tin cho tnh ton, khi ly o
hm v phi ca (4.2.1.2). Qu trnh hun luyn c thc hin vi mc ch gim gi tr
hm li E. Mt phng php thng dng gim gi tr hm li E c p dng trong
hu ht cc mng l phng php gim gradient.
Phng php gim gradient l mt k thut ti u ho m bo hi t v mt gi
tr cc tiu cc b. Phng php c tin hnh theo nhiu vng lp, mi vng lp cc
gi tr trng s c iu chnh theo hng ngc vi gi tr gradient. Gi w l gi tr
trng s ti mt bc ca thut ton, gi tr trng s mi c tnh ton cho bc tip
theo:
w = w + w
trong w biu din s thay i ca trng s, t l vi gi tr w C , l gi tr li
vector gradient c tnh ton theo trng s w
w = -w C
Cc gi tr trng s c biu din bng cng thc:

Trong c gi l h s hc (learning rate). H s hc quyt nh tc hi

t ca mng. Nu h s hc nh tc hi t s chm, ngc li nu h s hc ln th tc
hi t s nhanh hn. Tuy nhin nu h s hc qu ln s lm thut ton kh tip cn
gn n im cc tiu. Gi tr tt nht ca h s hc phi m bo mng hi t nhanh,
mt khc m bo gi tr hm li E l nh nht.
Trong qu trnh hun luyn, bc lp u tin s bt u vi cc trng s c
khi to trc. Sau qua cc bc lp mng s iu chnh cc trng s theo hng
gim gradient cui cng hi t ti mt im cc tiu a phng (local minimum). V
mt l thuyt, qu trnh hc c th b kt (stuck) ti mt gi tr cc tiu a phng m
khng th ti c gi tr cc tiu ton cc (global). gii quyt vn ny, mng c
th c hun luyn vi ln vi tp cc trng s c khi to khc nhau.
Qu trnh hun luyn thng c tin hnh vi tt c tp d liu mu ti mi
bc lp (c gi l tnh ton theo l, batch mode), qu trnh hun luyn thng mt rt
nhiu thi gian. Trong thc t thay cho tnh ton gi tr gradient (4.2.1.2) ca ton b d
liu mu, gi tr gradient c tnh ton trc tip vi mi mt cp d liu mu (xk, yk).

(4.2.1.3)

35

Chng 4: Mng Neural

2009

n mn hc 2

Cc trng s c cp nht vn theo cc cng thc nh trnh by trn.

Phng php ny c gi l gim gradient ngu nhin (stochastic gradient descent) v
c chng minh l hiu qu hn nu s mu hun luyn l ln (khong vi trm tr
ln).
T phng trnh (4.2.1.3) ly o hm ring theo tng trng s ta c:

(4.2.1.4)
T phng trnh (4.2.1.1) ta c

= xi

(4.2.1.5)

T hai phng trnh (4.2.1.4) v (4.2.1.5) ta c

wij = (yi y^i) xj

(4.2.1.6)

Phng trnh (4.2.1.6) cho thy s bin thin ca trng s ca mng sau khi c
mt gi tr vo mng, gi tr ny t l vi hiu s gia gi tr ti cc nt output v gi tr
ra mong mun nhn c.
Ta nh ngha i lng

= yi y^i
Khi phng trnh (4.2.1.6) c vit li l
wij = xj

(4.2.1.7)

Phng trnh (4.7) c gi l lut delta (delta rule).

Mng Perceptron a lp MLP
Mt trong nhng cu trc thng dng nht ca mng neuron l mng Perceptron
a lp MLP (MultiLayer Perceptron). Mng MLP gm c mt lp vo (input), mt lp ra

36

Chng 4: Mng Neural

2009

n mn hc 2

(output) v mt hoc nhiu lp n. Mng MLP cng c th c hiu l mng Perceptron

mt lp c b sung thm mt hoc nhiu lp n. Mt vector u vo s c a vo
lp vo (input) ca mng v sau cc tnh ton c thc hin lan truyn thng (feedforward) t lp vo input sang cc lp n v kt thc lp ra output. Hm kch hot kt
hp vi cc nt n hay cc nt output c th l hm tuyn tnh hay phi tuyn v c th
khc nhau gia cc nt. Hnh 4.2.2 miu t mt v d mng Perceptron a lp.
Qu trnh hun luyn mng MLP l qu trnh hc c gim st, cc trng s gia
cc nt ca hai lp k tip c iu chnh theo mt hm tiu chun no (criterion
function). Hm tiu chun thng dng hay c dng ging nh mng Perceptron n
lp l hm tng bnh phng hiu s gia cc gi tr output v cc gi tr mong mun ca
cc nt ra.

Hnh 4.2.2: Mng neuron Perceptron a lp MLP

Gi thit rng mng MLP gm c ba lp, trong c mt lp n nh miu t

trong Hnh 4.2.2. Gi hm kch hot i vi cc nut n l (x) , hm kch hot i vi
nt ra l (x) , ta c trng s wij gia nt n j v nt ra i c iu chnh theo hm li E
nh sau:

Ta c th tnh

37

Chng 4: Mng Neural

2009

n mn hc 2

(4.2.1.8)
Trong ta c th tnh:

(4.2.1.9)
T hai phng trnh (4.2.1.8) v (4.2.1.9) ta c
wij = ( yi y^i )i(yi) j
t:
(4.2.1.10)
Cui cng ta c cng thc iu chnh trng s tng t nh trng hp ca mng
Perceptron n lp nh sau:

(4.2.1.11)
By gi ta xem xt trng hp ca trng s vjk gia nt vo k v nt n j c
iu chnh theo hm li E:

38

Chng 4: Mng Neural

 n mn hc 2

2009

Ta c th tnh

(4.2.1.12)

Ta c th thy t phng trnh (4.2.1.12) l s thay i ca trng s vjk lin quan

n ton b cc nt ra output ca mng.

(4.2.1.13)
T hai phng trnh (4. 2.1.8) v (4. 2.1.9) ta c

t:
Cui cng ta c cng thc iu chnh trng s tng t nh trng hp ca mng
Perceptron a lp nh sau:
(4.2.1.14)
By gi ta xem xt trng hp ca trng s vjk gia nt vo k v nt n j c
iu chnh theo hm li E:

39

Chng 4: Mng Neural

 n mn hc 2

2009

(4.2.1.15)
Ta c th tnh

(4.2.1.16)
Ta c th thy t phng trnh (4.12) l s thay i ca trng s vjk lin quan n
ton b cc nt ra output ca mng.

(4.2.1.17)
Trong :

(4.2.1.18)
Trong hj^ l gi tr u ra ca nt n th j. Ta tip tc tnh:

40

Chng 4: Mng Neural

2009

n mn hc 2

(4.2.1.19)

T cc phng trnh (4. 2.1.15), (4. 2.1.16), (4. 2.1.17) v (4. 2.1.19) ta c

(4.2.1.20)

ta s c cng thc cp nht trng s tng t nh cng thc (4. 2.1.11):

(4.2.1.21)

Cc phng trnh (4.2.1.11) v (4.2.1.21) to thnh mt tp phng trnh c

gi l qui tc delta tng qut (Generalized Delta Rule)
T cng thc (4.2.1.20) cho ta thy trong qu trnh hc, gi tr hm li l bnh
phng hiu s gia gi tr output ca mng v gi tr mong mun ca tp mu c
tnh ton to thnh gi tr delta ca lp output, gi tr ny c dng hiu chnh
cc trng s lin kt vi lp output. Sau gi tr delta ny lan truyn ngc v pha
lp n cho php tnh ton cc trng s lin kt vi lp n theo phng trnh

41

Chng 4: Mng Neural

 n mn hc 2

2009

(4.2.1.20). Chnh v vy qu trnh ny c gi l hc lan truyn ngc sai s (Error

Back Propagation).
4.2.2 Mng neuron hi quy (RNN)
Mng neuron hi quy (Recurrent neural networks-RNN): n c mt hoc nhiu
con ng quay li t u ra tr li u vo. Nhng vng lp quay lui ny lm cho mng
ghi nh c cc s kin trc .V vy RNN rt hu ch nhng lnh vc nhn dng
mu theo thi gian. Trong n ny, mng hi quy v mng t t chc s khng c
ni n mt cch chi tit.
4.2.3 Mng t t chc
Cc neuron sp xp c th t trong mt mng ln nhiu chiu. Loi mng ny
gn ging vi lng t ha vector. im c bit ca mng ny l kh nng hc m
khng cn thy hoc khng cn gim st.

4.3 c trng ca mng neuron:

4.3.1 Tnh cht phi tuyn:
Mt mng neuron, cu thnh bi s kt ni cc neuron phi tuyn th t n
s c tnh phi tuyn. Hn na, iu c bit l tnh phi tuyn ny c phn tn trn ton
mng. Tnh phi tuyn l thuc tnh rt quan trng, nht l khi cc c ch vt l sinh ra cc
tn hiu u vo vn l phi tuyn.
4.3.2 Tnh cht tng ng u vo u ra:
Tnh cht ny ny lin quan ti vn hc hay tch ly ca mng
neuron. Mt m hnh hc ph bin c gi l hc vi mt ngi dy hay hc c gim
st lin quan n vic thay i cc trng s synapse ca mng neuron bng vic p dng
mt tp hp cc mu tch ly hay cc v d tch ly. Mi mt v d tch ly bao gm mt
tn hiu u vo v mt u ra mong mun tng ng. Mng neuron nhn mt v d ly
mt cch ngu nhin t tp hp ni trn ti u vo ca n, v cc trng s synapse ca
mng c bin i sao cho c th cc tiu ha s sai khc gia u ra mong mun v
u ra thc s ca mng theo mt tiu chun thng k thch hp.Nh vy mng neuron
hc t cc v d bng cch xy dng nn mt tng ng u vo- u ra cho vn cn
gii quyt.

42

Chng 4: Mng Neural

2009

n mn hc 2
4.3.3 Tnh cht thch nghi:

Cc mng neuron c mt kh nng mc nh l bin i cc trng s

synapse ty theo s thay i ca mi trng xung quanh. c bit, mt mng neuron
tch ly hot ng trong mt mi trng xc nh c th tch ly li mt cch d dng
khi c nhng thay i nh ca cc iu kin mi trng hot ng. Khi hot ng trong
mi trng khng n nh, mt mng neuron c th c thit k sao cho c kh nng
thay i cc trng s synapse ca n theo thi gian thc. Tuy nhin tnh cht ny khng
phi lc no cng em n sc mnh m n c th lm iu ngc li.

4.3.4 Tnh cht a ra li gii c bng chng:

Trong ng cnh phn loi mu, mt mng neuron c th c thit k
a ra thng tin khng ch v mu c phn loi, m cn v s tin cy ca quyt nh
c thc hin. Thng tin ny c th c s dng loi b cc mu m h hay
nhp nhng.
4.3.5 Tnh cht chp nhn sai st:
Mt mng neuron c ci t di dng phn cng, vn c kh nng
chp nhn li hay kh nng tnh ton th, vi ngha l tnh nng ca n ch thoi ha
(ch khng v) khi c nhng iu kin hot ng bt li. m bo rng mng
neuron thc s c kh nng chp nhn li, c l cn phi thc hin nhng o c hiu
chnh trong vic thit k thut ton tch ly mng neuron.
4.3.6 Tnh cht ng dng trong phn tch v thi t k:
c tnh ny th hin mt s im nh sau :
Cc neuron di dng ny hoc dng khc biu din mt thnh phn
chng cho tt c cc mng neuron.
Tnh thng nht em li kh nng chia s cc l thuyt v cc thut
ton hc trong nhiu ng dng khc nhau ca mng neuron.
Cc mng t hp c th c xy dng thng qua mt s tch hp cc
m hnh khc nhau.

- ht Chng 4 -

43

Chng 4: Mng Neural

 n mn hc 2

2009

GII THIU HM V TOOBOX TRONG

MATLAB CN XY DNG H THNG NHN
DNG TING NI BNG MNG NEURON
CHNG 5:

Nh chng ta bit, Matlab (Matrix Laboratory) l mt mi trng tr gip tnh ton v

hin th rt mnh c hng MathWorks pht trin. Mc pht trin ca Matlab ngy nay
chng t Matlab l mt phn mm c giao din cc mnh cng nhiu li th trong k thut lp
trnh gii quyt nhng vn a dng trong nghin cu KHKT.
Ngoi th vin cc hm tnh ton, vo-ra, ho c bn, Matlab cn c cc toolbox l
cc th vin cho tng lnh vc c th. V d c toolbox cho x l tn hiu (Signal Processing), m
phng m hnh (SimulLink), logic m (Fuzzy Logic), mng nron (NNet), thm ch cho c
thit k my bay (Aerospace) hay gii phng trnh vi phn (PDE)
Chng ny tp trung ch yu vo gii thiu cc hm v toolbox v hm cn thit xy
dng m m hnh nhn dng ting ni dung mng nron, m c th l xy dng mng MLP ba
lp.

Cc hm x l m thanh:
[y fs]=wavread(wavfile)

wavwrite(y,fs,wavfile)

sound(y)
y=wavrecord(n, fs)

c tn hiu m thanh t file wav cho bi xu

wavfile, y l vector m t tn hiu m thanh (c
gi tr thc t 0 n 1), fs l tn s ly mu (gi
tr nguyn)
Ghi tn hiu m thanh t file wav cho bi xu
wavfile, y l vector m t tn hiu m thanh, fs
l tn s ly mu.
Pht m thanh ra loa, y l vector m t tn hiu
m thanh.
Ghi m (t micro) vi tn s ly mu fs v n
mu. Kt qu l vector y.
on lnh sau ghi m trong 2 giy vi tn s
ly mu 8kHz, ri ghi vo file:
y=wavrecord(16000,8000);
wavwrite(y,8000,temp.wav);

44

Chng 5: Cc hm Matlab

2009

n mn hc 2

VoiceBox toolbox
V oiceBox l mt toolbox ca Matlab chuyn v x l ting ni do Mike Brookes pht
trin. V oiceBox yu cu Matlab phin bn 5 tr ln. V oicebox c th ti v t
http://webscripts.softpedia.com/script/Scientific-Engineering-Ruby/Signal-Processing/V oicebox34702.html.
V oiceBox gm cc hm c th chia thnh mt s nhm chc nng sau:

X l file m thanh (c, ghi file wav v mt s nh dng file m thanh khc)
Phn tch ph tn hiu
Phn tch LPC
Tnh ton MFCC, chuyn i spectral - cepstral
Chuyn i tn s (mel-scale, midi,...)
Bin i Fourier, Fourier ngc, Fourier thc...
Tnh khong cch (sai lch) gia cc vector v dy vector.
Loi tr nhiu trong tn hiu ting ni.

Chc nng quan trng nht l trch c trng tn hiu ting ni, m y l 2 loi ph
bin nht LPC v MFCC.
Hm tnh MFCC ca tn hiu trong VoiceBox l hm :
melcepst(s,fs,w,nc,p,n,inc,fl,fh)
Hm c nhiu tham s, mt s tham s quan trng l:
s l vector tn hiu ting ni (c c sau khi dng hm hoc ), fs l tn s ly mu
(mc nh l 11050).

nc l s h s MFCC cn tnh (tc l s phn t ca vector c trng, mc nh l

p l s b lc mel-scale.

12).
w l mt xu m t cc la chn khc: nu c th tnh thm log nng lng, c th tnh
thm c trng delta.
Mc d vy hm c th gi mt cch n gin l:
c=melcepst(s,fs);
Li gi hm sinh ra ma trn c, mi dng ca ma trn l 12 h s MFCC ca mt frame.
km thm log nng lng v d liu delta nh trong cc h nhn dng khc, ta dng lnh:

45

Chng 5: Cc hm Matlab

2009

n mn hc 2

c=melcepst(s,fs,ed);
Khi mi dng ca c l vector 26 h s MFCC ca frame tng ng.

NetLab toolbox
NetLab do Ian T. Nabney pht trin. Chng ti s dng toolbox NetLab xy dng,
hun luyn v th nghim mng nron MLP cho h thng nhn dng trong n ny. Link ti
v:
http://webscripts.softpedia.com/script/Scientific-Engineering-Ruby/Controls-and-SystemsModeling/Netlab-32705.html
Lnh khi to MLP trong NetLab c c php nh sau:
net = mlp(inode, hnode, onode, func, anpha);
Trong :
inode, hnode, onode ln lt l s nron ca lp vo, lp n v lp ra.
func l kiu hm kch hot, func c th c cc gi tr logistic,
softmax
anpha l ngng ca gi tr trng s, thng ly bng 0.01.
net l mng MLP do hm to ra.
Mng MLP sau khi iu kin khi to c th hun luyn vi mt b d liu hun luyn
cho trc. Lnh hun luyn MLP trong NetLab c c php nh sau:
[net, error] = mlptrain(net, x, t, its)
Trong :
x, t l b d liu hun luyn. x l cc vector u vo, t l cc vector u ra cn t
n (target).
its l s vng hun luyn (s ln thc hin thut ton lan truyn ngc li).
net l mng nron.
error l tng sai s ca ln hun luyn cui cng.
Sau khi hun luyn ta c th dng mng MLP tnh u ra ng vi cc u vo bt k
Lnh tnh u ra y ca MLP ng vi u vo x nh sau:
y = mlpfwd(net, x)

46

Chng 5: Cc hm Matlab

2009

n mn hc 2

Trong :
x l mt hay nhiu vector u vo
y l cc vector u ra tng ng.

- ht Chng 5 -

47

Chng 5: Cc hm Matlab

2009

n mn hc 2

XY DNG CHNG TRNH M PHNG

NHN DNG TING NI BNG MNG NEURON MLP
CHNG 6:

Nhn dng ting ni l mt lnh vc tuy khng mi nhng v cng phc tp. Nhn dng
ting ni c th gii bt u nghin cu cch y hn 50 nm, tuy nhin nhng kt qu thc t
t c v cng khim tn. Cn phi rt lu na con ngi mi t n vic xy dng mt h
thng hiu c ting ni nh con ngi. Trong phm vi ch l mt n mn hc, chng ti ch
xy dng mt chng trnh nh nhn dng mi ch s ting Vit bng nhng cng c c
sn ca Matlab. Chng ti cng rt mun xy dng mt h thng nhn dng ting Vit vi b t
in ln hn, c th ng dng c vo thc t. Tuy nhin do ch mi tip xc lnh vc ny
nn kh nng, kin thc ca chng ti cn rt hn ch, cng vo l nhng kh khn v thi
gian, phng tinnn chng ti ch c th xy dng mt h thng nhn dng nh. Trong tng
lai nu c iu kin tip xc v nghin cu su hn v lnh vc ny, chng ti mong mun pht
trin n ny ln c th ng dng trong thc t.

6.1 Cc bc xy dng
H thng nhn dng mi ch s ting Vit c xy dng vi cc c trng nh sau:

Phng php: nhn dng t n (isolate word recognition).

Input: file wav, mi file ch cha mt t. Hoc ghi m trc tip.
Output: ch s c nhn dng trong file u vo.
B t vng: 11 t n m cc ch s ting Vit (khng, mt, hai...

mi).
S khi h thng nhn dng ting ni cc ch s ting Vit bng mng nron MLP
trn mi trng Matlab c m t trong hnh 6.1. Chc nng ca tng khi c m t nh
sau:
Thu thp v tin x l: tn hiu ting ni giai on hun luyn c thc hin bng
phng php th cng: s dng phn mm ghi m, lc nhiu v ct thnh cc t ring r, mi t
ghi vo mt file (tn file ghi t tng ng).
B d liu do chng ti t xy dng gm:

48

File wav 16 bit 8kHz, mi file l pht m ca mt t.

Chng 6: Xy dng chng trnh m phng

2009

n mn hc 2

T l cc ch s ting Vit t 1 n 10 . (Mc d mi khng phi l ch s

nhng vn cn trong h nhn dng ch s v c cc s pht m l mi mt, mi hai...).

Hnh 6.1: S khi h thng nhn dng ting ni cc ch s ting Vit bng mng
nron MLP trn mi trng Matlab
Vic thu thp v tin x l (ct cc vng khng cha tn hiu ting ni) c thc hin
bi cc lnh sau:
x = wavrecord(10000,8000); %tn s ly mu 8kHz, ghi m chng hn 1s
x = x';
%chuyn x thnh ma trn dng
y = endcut(x, 64, 1.5E-3); %ct khon lng

Hm endcut dng ct cc khong lng khng cha tn hiu m, s gii thut miu t
trong hnh 6.2. Cc lnh miu t nh sau:
function y = endcut(x, n, es)
% cat khoang lang ra khoi x.
% n l di frame, es l ngng nng lng.
x = x - mean(x); %dk: x d c chun ha

if nargin < 3
es = 2E-3;
end;

49

%mc nh l 2e-3

Chng 6: Xy dng chng trnh m phng

2009

n mn hc 2

if nargin < 2
n = 128;
end;

%mc nh l 128 mu

y=[]; i=1;
while i<=length(x)-n
t=x(i:i+n-1);
e=mean(t.^2);
if (e>es)
y = [y t];
end;
i=i+n;
end;

Begin

c file wav, chiu di

frame, ngng nng lng

Chia wav thnh frame,

tnh nl tng frame

nl frame>
nl ngng

Lu frame

end

Hnh 6.2: Gii thut ct khon lng trong file wav

Mi file m thanh c trch chn c trng MFCC thnh mt dy cc vector MFCC
bng hm wave2mfcc:
function mfcc = wave2mfcc(wav, fs, p);
if nargin < 3 % mc nh ly vector MFCC 8pt

50

Chng 6: Xy dng chng trnh m phng

2009

n mn hc 2

p = 8;
end;
if nargin < 2 % mc nh tn s ly mu = 8kHz
fs = 8000;
end;
if isstr(wav) % nu wav l tn file th c
[wav fs] = wavread(wav);
end;
% chun ho max(wav)=1.

mx = max(wav);
wav = wav ./ mx;
% tnh vector MFCC p phn t, gm c nng lng

mfcc = melcepst(wav,fs,'e',p-1);

V cc file wav c di ngn khc nhau nn dy cc vector c trng MFCC tng ng

cng khng c cng s phn t. Nhng u vo ca mng nron MLP li phi c nh. Do
chng ti thc hin mt bin php n gin l chia dy c trng thnh 5 phn u nhau, tnh
trung bnh ca tng phn c 5 vector ri ghp li thnh mt vector . Kt qu u vo ca
mng nron l mt vector 8x5=40 thnh phn.
function x = VecAvr(ft,k);
% trch ft thnh k phn chia trung bnh.

n = length(ft); m = floor(n/k); x=[];

i=0;t=1;
while i<k
i=i+1;
f=sum(ft(t:t+m-1,:))./m;
x=[x f];
t=t+m;
end;

i vi b t vng cng thc hin tng t cc bc trn, ta c c b d liu dng

hun luyn mng neural.
n lc ny, vic chun b cc d liu u vo cho mng neural xong, chng ta s i
xy dng mng neural MLP 3 lp dng nhn dng. Ta dng lnh mlp xy dng:
net = mlp(inode, hnode, onode, func, anpha);
%inode, hnode, onode: so neural vo, n, ra
%func: hm kch hot
%alpha: ngng ca gi tr trng s.

Chng ta hun luyn mng bng lnh :

51

Chng 6: Xy dng chng trnh m phng

2009

n mn hc 2

[net err]=mlptrain(net, xtrain, target, loop);

%net: mang mlp; xtrain: d lin u vo
%taget: d liu ra cn t n
%err: sai khc gia xtrain v target

D liu ra target c xy dng rt n gin, n l mt vactor 11 phn t. V ector ny c

c im l phn t th i tng ng vi s i cn nhn dng bng 1, cc phn t cn li bng 0.
V d target dng hun luyn cho pht m s mt th s c dng [1 0 0 0 0 0 0 0 0 0 0],
target dng hun luyn cho pht m s hai th s c dng [0 1 0 0 0 0 0 0 0 0 0].... target
dng hun luyn cho pht m s khng th s c dng [0 0 0 0 0 0 0 0 0 0 1].
Nhn dng thng qua hm:
ytest = mlpfwd(net, xtest);
%net: mang mlp; xtest: d liu cn nhn dng
%ytest: d liu ra

Xtest s l vector c trng MFCC gm 40 phn t tnh trn, ytest l mt vector 11

phn t. Nu qu trnh hun luyn tt, phn t th i ca ytest tng ng vi ch s i cn nhn
dng s c gi tr ln nht.

6.2 Chng trnh nhn dng pht m mi ch s ting Vit

Giao din chnh ca chng trnh nh sau:

Hnh 6.2.1: Giao din chnh ca chng trnh

52

Chng 6: Xy dng chng trnh m phng

2009

n mn hc 2

Trc tin ta phi to mt mng neural MLP 3 lp vi y cc thng s: s neural lp

vo, s neural lp n, s eural lp ra, hm kch hot, ngng gi tr trng s. Giao din ca
chng trnh to neural nh hnh 6.2.2. Mng MLP sau khi to c m t nh sau:
net =
type: 'mlp'
nin: 40
nhidden: 100
nout: 11
nwts: 5211
outfn: 'logistic'
alpha: 0.0100
w1: [40x100 double]
b1: [1x100 double]
w2: [100x11 double]
b2: [0.1124 -0.1461 -0.0608 0.0194 -0.0348 0.0377
0.0656 -0.0049 0.0018 0.0889 -0.1626]

Sau , mng c th nhn dng c pht m cc ch s ting Vit ta cn phi hun

luyn cho mng. D liu dng hun luyn l file .wav c thu m sn. Trong chng
trnh hun luyn ny bao gm c vic tin x l nh: ct cc khon lng trong file, trch c
trng MFCC a vo mng... Giao din chng trnh hun luyn nh hnh 6.2.3.

Hnh 6.2.2: To mng neural MLP 3 lp

53

Chng 6: Xy dng chng trnh m phng

2009

n mn hc 2

Hnh 6.2.3: Chng trnh hun luyn mng MLP

Sau khi hun luyn, chng ta c th nhn dng cc pht m ch s ting Vit. Chng ta
c th nhn dng trc tip t micro hay t file.wav. Nhn chung, khi nhn dng t file .wav cho
kt qu chnh xc hn nhn dng trc tip, l do cc gii thut tin x l cha c tt. Hnh
6.2.4 m t chng trnh nhn dng t file wav, hnh 6.2.5 m t chng trnh nhn dng trc
tip t micro.

Hnh 6.2.4: Chng trnh nhn dng t file

54

Chng 6: Xy dng chng trnh m phng

2009

n mn hc 2

Hnh 6.2.5: Chng trnh nhn dng trc tip t micro

- ht Chng 6 -

55

Chng 6: Xy dng chng trnh m phng

Ni dung ca n:
PHN I:

L THUYT

Chng 1: M u
Chng 2: L thuyt m thanh v ting ni
2.1 Ngun gc m thanh
2.2 Cc i lng c trng cho m thanh
2.3 Cc tn s c bn ca ting ni
2.4 C ch to lp ting ni con ngi.
2.5 M hnh lc ngun to ting ni.
2.6 H thng nghe ca ngi.
2.7 Qu trnh sn xut v thu nhn ting ni ca con ngi.
2.8 Cc m thanh ting ni v cc c trng
2.8.1 Nguyn m
2.8.2 Cc m v khc
Chng 3: L thuyt nhn dng ting ni
3.1 Tng quan v nhn dng ting ni
3.2 Cc nguyn tc c bn trong nhn dng ting ni.
3.3 Cc h thng nhn dng ting ni.
3.4 Cc qu trnh nhn dng ting ni.
3.4.1 Phn tch cc c tnh ting ni
3.4.2 Phn lp mu
3.4.3 X l ngn ng
3.5 Cc tip cn nhn dng ting ni
3.5.1 Tip cn m thanh-ng m
3.5.2 Tip cn nhn dng mu
3.5.3 Tip cn tr tu nhn to
3.6 Cc phng php nhn dng ting ni.
3.6.1 M hnh Fujisaki
3.6.2 M hnh Markvo n
3.6.3 M hnh mng neuron
3.7 Nhng thun li v kh khn trong nhn dng ting Vit
Chng 4: Mng neuron v ng dng trong nhn dng ting ni
4.1 nh ngha mng neuron
4.2 Kin trc mng neuron
4.3 c trng ca mng neuron
PHN II:

M PHNG NHN DNG TING NI BNG MNG NEURON TIN A

LP BNG MA TLAB

Chng 5: Gii thiu cc hm v toolbox trong matlab

`

Chng 6: Xy dng chng trnh nhn dng pht m mi ch s ting

Vit bng cc toobox ca matlab
PHN III:

KT LUN V TI LIU THAM KHO