Beruflich Dokumente
Kultur Dokumente
============================================================================================
3Health Check Before Upgrade
============================================================================================
3.st iublink
4.st iublink dis
5.lst iublink dis
8.st gigabit|ipaccesshost
11. st IpEthPacketDataRouter
FTC switch
<<< RNC3810 >>>
1)bl 001100
2)acc 001100 manualrestart
3)getAttrObj me
4)deb 001100
5)lh coremp mirror s
6)getAttrObj me
<<< RNC3820 >>>
1)bl 002400
2)acc 002400 manualrestart
3)getAttrObj me
4)deb 002400
5)lh coremp mirror s
6)getAttrObj me
3.5.2Set the latest CV in Rollback list and check the rollback list (Night)
1.cvls
2.cv rbset < Latest CV >
3.cvls
4.lh coremp cat /d/rollback.lst
cksum CXP9014711%4_R2EA.xml
cat CXP9014711%4_R2EA.xml | egrep "confirm|WaitForConfirm_BeforeRestart"
3.9.2Get MO dump
<<< RNC3810 >>>
Terminal 1
1.l+m [Node]_dump_[SWname]_beforeUp.log
2.lhsh 001200 capi prio
3.lt all
4.lhsh 001200 capi prio
5.kget
6.lhsh 001200 capi prio
7.l-
Terminal 2
1.l+ [Node]_dump_[SWname]_beforeUp_ldmon.log
2.for 2000
3.lhsh 001200 capi prio
4.done
Terminal 2
1.l+ [Node]_dump_[SWname]_beforeUp_ldmon.log
2.for 2000
3.lhsh 000500 capi prio
4.done
============================================================================================
4RNC Software Install
============================================================================================
4.4Check and Store the Si CV for recovery GPB (Night)
1.lh coremp cv csum <Si_xxxx>
2.ftget /d/configuration/cv/Si_xxxx
4.5Put prepared CV to increase heap size for prevention of cyclic restarts after rollback
============================================================================================
5RNC Software Upgrade
============================================================================================
6.acl ReliableProgramUniter=xxxxxxxxxxx
(xxxx = ReliableProgramUniterId)
7.acc ReliableProgramUniter=xxxxxxxxxxx switch
(xxxx = ReliableProgramUniterId)
8.sget ReliableProgramUniter=xxxxxxxx
9.lsget ReliableProgramUniter userLabel target
10. lh coremp sma -all(Find the targetmonitor RPU)
(Extra info)
<<< RNC3810 >>>
1.lhsh 001000 sma -all
2.sget ReliableProgramUniter rpuid <RPU id>
3.sget ReliableProgramUniter=<MO identity>
<<< RNC3820 >>>
1.lhsh 000500 sma -all
2.sget ReliableProgramUniter rpuid <RPU id>
3.sget ReliableProgramUniter=<MO identity>
1.
lt upgradepackage
2.
pr upgradepackage
sget UpgradePackage=CXP9014711/4_R2EA prog|stat
3.
actl UpgradePackage=CXP9014711/4_R2EA
acc UpgradePackage=CXP9014711/4_R2EA rebootNodeUpgrade
actl UpgradePackage=CXP9014711/4_R2EA
acc UpgradePackage=CXP9014711/4_R2EA confirmUpgrade
5.7.1Check the UE connectivity to the Core network
<<< RNC3810 >>>
1.l+ xrncxx_PostQHC.log
2.lhsh 001700 ueregprint sum
3.lhsh 001700 ranap status
4.lhsh 001700 ranap conn
5.lhsh 001800 rnsap status
6.lhsh 001800 rnsap conn
7.lgevsmur 30m
================================
a)Terminal 1 (logfile1) repeatably collect:
for ever
;lhsh 000700 rof_info_esig lap;lhsh 000700 poolinfo -l
wait 1
done
then moshell
for ever
;lhsh 000700 sigs 000101d5;lhsh 000700 sigs 00010320
wait 1
done
================================
2.lgsemr 10m
3.cv cu
(RNC3810)
4.lhsh 001000 sma -all
lhsh 001100 sma -all
5.cv cu
6.lgsemr 10m
7.lhsh 001000 sma -all
lhsh 001100 sma -all
alt
8.lst 001000
9.bl 001000
10. lst 001000
11. lhsh 001000 sma -all
lhsh 001100 sma -all
12. alt
13. lst 001000
14. deb 001000
15. lst 001000
16. lgsemr 10m
17. lhsh 001000 sma -all
lhsh 001100 sma -all
(RNC3820)
4.lhsh 000500 sma -all
lhsh 002400 sma -all
5.cv cu
6.lgsemr 10m
7.lhsh 000500 sma -all
lhsh 002400 sma -all
alt
8.lst 000500
9.bl 000500
10. lst 000500
11. lhsh 000500 sma -all
lhsh 002400 sma -all
12. alt
13. lst 000500
14. deb 000500
15. lst 000500
16. lgsemr 10m
17. lhsh 000500 sma -all
lhsh 002400 sma -all
5.7.5Normality check
< Read MO's ><1>
1.lt ^utrancell|^pch|rach|fach|hsdsch|eul|iublink|nbap|nodesync
2.lt mtp3b|sccp|m3ua|sctp|ranap|rnsap|gigabit|ipacc|ipinter|ipeth|ether|vcltp
3.lt ccdev|dcdev|pdr|packetd|spm|plugin|spdev|rncfeature
<RNC3810>
2. each capi check
lh ranapmp capi tot
lh ranapmp capi tot
lh ranapmp capi prio--> select high load pri -> x
lh ranapmp capi type pri <x>
lh ranapmp capi tot
lh ranapmp capi tot
lh ranapmp capi prio--> select high load pri -> y
lh ranapmp capi type pri <y>
<RNC3820>
2. each capi check (Repeat the following for 3 times)
lh sccpmp capi tot
lh sccpmp capi tot
lh sccpmp capi prio--> select high load pri -> x
lh sccpmp capi type pri <x>
lh sccpmp capi tot
lh sccpmp capi tot
lh sccpmp capi prio--> select high load pri -> y
lh sccpmp capi type pri <y>
6.acl ReliableProgramUniter=xxxxxxxxxxx
(xxxx = ReliableProgramUniterId)
7.acc ReliableProgramUniter=xxxxxxxxxxx switch
(xxxx = ReliableProgramUniterId)
8.sget ReliableProgramUniter=xxxxxxxx
9.lsget ReliableProgramUniter userLabel target
10. lh coremp sma -all(Find the targetmonitor RPU)
(Extra info)
<<< RNC3810 >>>
1.lhsh 001000 sma -all
2.sget ReliableProgramUniter rpuid <RPU id>
3.sget ReliableProgramUniter=<MO identity>
<<< RNC3820 >>>
1.lhsh 000500 sma -all
2.sget ReliableProgramUniter rpuid <RPU id>
3.sget ReliableProgramUniter=<MO identity>
9.
<<< RNC3810 >>>
Tokyo, tp03)/export/home/tpuser/users/p3/bin/startmon4.sh trncxx
Tokai, tp03)/export/home/tpuser/users/p3/bin/startmon4.sh crncxxx
Kansai, tp01)/export/home/tpuser/users/p3/bin/startmon4.sh krncxxx
<<< RNC3820 >>>
Tokyo, tp03)/export/home/tpuser/users/p3/bin/startmon4_3820.sh trncxx
Tokai, tp03)/export/home/tpuser/users/p3/bin/startmon4_3820.sh crncxxx
Kansai, tp01)/export/home/tpuser/users/p3/bin/startmon4_3820.sh krncxxx
<RNC3810>
9. each capi check
lh ranapmp capi tot
lh ranapmp capi tot
lh ranapmp capi prio--> select high load pri -> x
lh ranapmp capi type pri <x>
lh ranapmp capi tot
lh ranapmp capi tot
lh ranapmp capi prio--> select high load pri -> y
lh ranapmp capi type pri <y>
<RNC3820>
9. each capi check
lh sccpmp capi tot
lh sccpmp capi tot
lh sccpmp capi prio--> select high load pri -> x
lh sccpmp capi type pri <x>
lh sccpmp capi tot
lh sccpmp capi tot
lh sccpmp capi prio--> select high load pri -> y
lh sccpmp capi type pri <y>
10. cvls
11. acc 0 manualrestart
17. alt
18. lst ranap
19. lk Ranap=<target ranap>
20. u+ ranap_rec
21. del ranap=<target ranap>
22. u-
23. run <created mos>
24. alt
25. lst ranap
26. lk ranap=<target ranap>
(Optional)
lh <MOD> te e trace1 trace6 trace7 DLCODE_CELL
lh <MOD> te e trace3 trace6 trace7 HSDSCH_CONFIG_CELL
lh <MOD> te e trace5 trace6 trace7 rnhCellRoC[<CELL_RO>]
lh ommp te e trace6 trace7 roamFroUtranCellRoProxyC
lh ommp te e trace6 trace7 roamFroHsdschRoRnhProxyC
lh <MOD> cellenable -cid <CELL_ID>
<MOD>, <CELL_ID>, CELL_CAPS> - on cedr printout pick affected cell and use values from proper columns:
<MOD> - 'MOD' column
<CELL_ID> - 'cid' column
<CELL_RO> - value from 'ro' column
<CELL_CAPS> - 'ro' column increased by 1 ('ro' + 1)
18. cvls
19. acc 0 manualrestart
20. strt
21. acc mod<target mod> manualrestart
22. st utrancell
- If the impacted RBS use a same Ccdevice, restart SPB board which has the Ccdevice
bl (target board name)
st XXX
acc XXX manualrestart
3.
tpuser@nrjtotp03 trnc83]$ gzip -dc 2011-11-25_120* | /opt/tools/decoder/3.1t/decoder/concat_segmented_rlib_traces.pl
| grep -i wcdmacarrier
ex)
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 4
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 5
4.
ex) perl ichigo_wcdmacarrier_remedy_paX.pl -rnc krnc569 -carrier 1,2,3,4,5,6
Tokyo, tp03)perl ichigo_wcdmacarrier_remedy_pa4.pl -rnc trncxx -carrier 1,2,3,4,5,6
5.
ex) perl ichigo_wcdmacarrier_detection_paX.pl -rnc krnc569 -carrier 1,2,3,4,5,6
Tokyo, tp03)cd /home/tpuser/users/emotshi/111124_TRNC83_wcdmacarrier/
perl ichigo_wcdmacarrier_detection_pa7.pl -rnc trncxx -carrier 1,2,3,4,5,6
6.
tpuser@nrjtotp03 trnc83]$ gzip -dc 2011-11-25_120* | /opt/tools/decoder/3.1t/decoder/concat_segmented_rlib_traces.pl
| grep -i wcdmacarrier
ex)
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 1
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 2
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 3
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 4
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 5
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 6
7.shget wcdmacarrier
lt RabHandling
sget RabHandling=1 tnResAllocSrbHspa
============================================================================================
6Health Check After Upgrade
============================================================================================
6.2.1Get MO dump
<<< RNC3810 >>>
Terminal 1
1.l+m [Node]_dump_[SWname]_afterUp.log
2.lhsh 001200 capi prio
3.lt all
4.lhsh 001200 capi prio
5.kget
6.lhsh 001200 capi prio
7.l-
Terminal 2
1.l+ [Node]_dump_[SWname]_afterUp_ldmon.log
2.for 2000
3.lhsh 001200 capi prio
4.done
Terminal 2
1.l+ [Node]_dump_[SWname]_beforeUp_ldmon.log
2.for 2000
3.lhsh 000500 capi prio
4.done
3.st iublink
4.st iublink dis
5.lst iublink dis
8.st gigabit|ipaccesshost
6.6.2Check final CV
1.lh coremp cv csum <xRNCxx>
============================================================================================
8Rollback
============================================================================================
8.2.2ET-M4 Overload
1.lgsemr 10m
2.lhsh xxxxxx(target ETB) capi tot
(RNC3810)
4.lhsh 001000 sma -all
lhsh 001100 sma -all
5.cv cu
6.lgsemr 10m
7.lhsh 001000 sma -all
lhsh 001100 sma -all
alt
8.lst 001000
9.bl 001000
10. lst 001000
11. lhsh 001000 sma -all
lhsh 001100 sma -all
12. alt
13. lst 001000
14. deb 001000
15. lst 001000
16. lgsemr 10m
17. lhsh 001000 sma -all
lhsh 001100 sma -all
(RNC3820)
4.lhsh 000500 sma -all
lhsh 002400 sma -all
5.cv cu
6.lgsemr 10m
7.lhsh 000500 sma -all
lhsh 002400 sma -all
alt
8.lst 000500
9.bl 000500
10. lst 000500
11. lhsh 000500 sma -all
lhsh 002400 sma -all
12. alt
13. lst 000500
14. deb 000500
15. lst 000500
16. lgsemr 10m
17. lhsh 000500 sma -all
lhsh 002400 sma -all
8.2.5Normality check
< Read MO's ><1>
1.lt ^utrancell|^pch|rach|fach|hsdsch|eul|iublink|nbap|nodesync
2.lt mtp3b|sccp|m3ua|sctp|ranap|rnsap|gigabit|ipacc|ipinter|ipeth|ether|vcltp
3.lt ccdev|dcdev|pdr|packetd|spm|plugin|spdev|rncfeature
6.acl ReliableProgramUniter=xxxxxxxxxxx
(xxxx = ReliableProgramUniterId)
7.acc ReliableProgramUniter=xxxxxxxxxxx switch
(xxxx = ReliableProgramUniterId)
8.sget ReliableProgramUniter=xxxxxxxx
9.lsget ReliableProgramUniter userLabel target
10. lh coremp sma -all(Find the targetmonitor RPU)
(Extra info)
<<< RNC3810 >>>
1.lhsh 001000 sma -all
2.sget ReliableProgramUniter rpuid <RPU id>
3.sget ReliableProgramUniter=<MO identity>
<<< RNC3820 >>>
1.lhsh 000500 sma -all
2.sget ReliableProgramUniter rpuid <RPU id>
3.sget ReliableProgramUniter=<MO identity>
9.
<<< RNC3810 >>>
Tokyo, tp04)/export/home/tpuser/users/p3/bin/startmon4.sh trncxx
Tokai, tp03)/export/home/tpuser/users/p3/bin/startmon4.sh crncxxx
Kansai, tp01)/export/home/tpuser/users/p3/bin/startmon4.sh krncxxx
<<< RNC3820 >>>
Tokyo, tp04)/export/home/tpuser/users/p3/bin/startmon4_3820.sh trncxx
Tokai, tp03)/export/home/tpuser/users/p3/bin/startmon4_3820.sh crncxxx
Kansai, tp01)/export/home/tpuser/users/p3/bin/startmon4_3820.sh krncxxx
8.7Check the KPI after RNC restart
1.pmrup -m 1
(0.25 and 0.5 should be used 1st and 2nd ROP)
10. cvls
11. acc 0 manualrestart
17. alt
18. lst ranap
19. lk Ranap=<target ranap>
20. u+ ranap_rec
21. del ranap=<target ranap>
22. u-
23. run <created mos>
24. alt
25. lst ranap
26. lk ranap=<target ranap>
(Optional)
lh <MOD> te e trace1 trace6 trace7 DLCODE_CELL
lh <MOD> te e trace3 trace6 trace7 HSDSCH_CONFIG_CELL
lh <MOD> te e trace5 trace6 trace7 rnhCellRoC[<CELL_RO>]
lh ommp te e trace6 trace7 roamFroUtranCellRoProxyC
lh ommp te e trace6 trace7 roamFroHsdschRoRnhProxyC
lh <MOD> cellenable -cid <CELL_ID>
<MOD>, <CELL_ID>, CELL_CAPS> - on cedr printout pick affected cell and use values from proper columns:
<MOD> - 'MOD' column
<CELL_ID> - 'cid' column
<CELL_RO> - value from 'ro' column
<CELL_CAPS> - 'ro' column increased by 1 ('ro' + 1)
20. strt
21. acc mod<target mod> manualrestart
22. st utrancell
- If the impacted RBS use a same Ccdevice, restart SPB board which has the Ccdevice
bl (target board name)
st XXX
acc XXX manualrestart
3.
tpuser@nrjtotp03 trnc83]$ gzip -dc 2011-11-25_120* | /opt/tools/decoder/3.1t/decoder/concat_segmented_rlib_traces.pl
| grep -i wcdmacarrier
ex)
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 4
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 5
4.
ex) perl ichigo_wcdmacarrier_remedy_paX.pl -rnc krnc569 -carrier 1,2,3,4,5,6
Tokyo, tp03)perl ichigo_wcdmacarrier_remedy_pa4.pl -rnc trncxx -carrier 1,2,3,4,5,6
5.
ex) perl ichigo_wcdmacarrier_detection_paX.pl -rnc krnc569 -carrier 1,2,3,4,5,6
Tokyo, tp03)cd /home/tpuser/users/emotshi/111124_TRNC83_wcdmacarrier/
perl ichigo_wcdmacarrier_detection_pa7.pl -rnc trncxx -carrier 1,2,3,4,5,6
6.
tpuser@nrjtotp03 trnc83]$ gzip -dc 2011-11-25_120* | /opt/tools/decoder/3.1t/decoder/concat_segmented_rlib_traces.pl
| grep -i wcdmacarrier
ex)
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 1
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 2
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 3
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 4
[2011-11-25 03:04:47.832] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 5
[2011-11-25 03:07:31.380] 010200/RncLmUePT(uehUeCtxtFroObjectWcdmaCarrierC)
../src/UehUeCtxtFroObjectWcdmaCarrierC.cpp:140 ERROR:setWcdmaCarrierValidData(): could not retrive data from config
for FRO id = 6
7.shget wcdmacarrier
==========================================================================