Beruflich Dokumente
Kultur Dokumente
Bert.Scalzo@Quest.com
Learning Objectives
Apply low hanging fruit fixes to speed up Oracle performance on Linux well look at both database and operating system level mods Goal is simple how can we maximize Oracle performance in Linux servers!
Speakers Qualifications
Oracle Solutions Product Architect for Quest Software Chief architect for Quests popular TOAD product Oracle DBA for 20+ years, versions 4 through 10g Worked for Oracle Education & Consulting Holds several Oracle Masters (DBA & CASE) BS, MS, PhD in Computer Science and also an MBA LOMA insurance industry designations: FLMI and ACS Books The TOAD Handbook (Feb 2003) Oracle DBA Guide to Data Warehousing and Star Schemas (Mar 2003) The TOAD Pocket Reference 2nd edition (June 2005) Articles Oracle Magazine Oracle Technology Network (OTN) Oracle Informant PC Week (now E-Magazine) Linux Journal www.Linux.com
#1 OS !!!
www.netcraft.com/survey/index-200007.html
http://survey.netcraft.com/index-200106.html
http://news.netcraft.com/archives/2003/07/index.html
Popularity = Performance
Operating System
Database Network
Linux Tuning
Application
SQL Tuning
SQL Tuning Advice focus on application first, and then database and possibly network. Linux Tuning Advice focus on hardware, LINUX and Oracle database configurations.
Performance Pyramid
Network
Hardware
OS DBMS Application
10g
10g 10g 10g 10g 10g 9.2 9.2 9.2
Certified
Certified Certified Certified Certified Certified Certified Certified Certified
9.2
9.2 9.2 9.2 9.2
Certified
Certified Certified Certified Certified
9.2
9.2
Certified
Certified
Test Method
TPC benchmark (www.tpc.org)
TPC Benchmark C (TPC-C) is an OLTP workload. It is a mixture of read-only and update intensive transactions that simulate the activities found in complex OLTP application environments. It does so by exercising a breadth of system components associated with such environments, which are characterized by: The simultaneous execution of multiple transaction types that span a breadth of complexity On-line and deferred transaction execution modes Multiple on-line terminal sessions Moderate system and application execution time Significant disk input/output Transaction integrity (ACID properties) Non-uniform distribution of data access through primary and secondary keys Databases consisting of many tables with a wide variety of sizes, attributes, and relationships Contention on data access and update Excerpt from TPC BENCHMARK C: Standard Specification, Revision 3.5
Test Platform
If your customer or management are willing to buy more hardware for better performance, then there is obviously budget for tuning tools press the issue! Golden Rule #1: Use OS & DB tuning tools! Golden Rule #2: Dont rely on free tools only!
Tools Used
This is not a sales pitch Im a DBA (a.k.a techno-nerd)!
Benchmark Factory Create, populate and index the test database (200 megs) Simulate 200 concurrent users via a single or many PCs LINUX Freebies Command line utilities: X-Windows utilities:
sar, mpstat, iostat, vmstat, linmon, ipcs, top, free, hdparm, linuxconf, slmon, gtop, ktop, xload, xosview, kperfmeter, gkrellmm, procmeter, gpowertweak,
sar r 01:00:00 01:10:00 01:20:00 01:30:00 01:40:03 01:50:01 02:00:00 Average: PM kbmemfree kbmemused PM 465132 48128 PM 463352 49908 PM 463356 49904 PM 1652 511608 PM 1604 511656 PM 376852 136408 295324 vmstat 217936 %memused kbmemshrd kbbuffers 9.37 0 2708 9.72 0 2784 9.72 0 2784 99.67 0 532 99.68 0 768 26.57 0 1120 42.46 0 1782 kbcached kbswpfree kbswpused 26136 525288 0 26732 525288 0 26736 525288 0 18216 447360 77928 17228 369024 156264 25692 503344 21944 23456 482598 42690 %swpused 0.00 0.00 0.00 14.83 29.74 4.17 8.12
procs r b 0 5 0 1 0 3 0 1 0 1 0 0 0 0 0 5 1 2 1 0 0 1 1 0 1 1 0 3 1 2 1 2 1 1 0 2 0 5 0 2 0 0
w 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
swpd 122308 124608 127132 128836 130428 132052 133240 134920 136800 138400 139764 140780 141984 143044 143944 144940 146092 146820 147580 148144 148652
free 1588 1588 1588 1588 1592 1596 1600 1588 1592 1600 1588 1596 1588 1588 1588 1588 1596 1588 1588 1596 1588
memory buff cache 440 17492 440 16992 432 17140 440 17344 468 17024 460 16940 444 16508 452 16596 448 16500 432 16576 468 16516 456 16680 444 16756 456 16516 464 16468 464 16320 468 16588 460 16416 440 16284 444 15776 448 15480
swap si so 0 124 0 230 0 253 0 171 0 159 2 164 1 120 0 168 12 190 0 160 0 136 5 102 0 120 0 106 0 90 2 100 0 115 18 73 2 76 0 56 0 51
io
bi 145 194 164 172 189 181 166 138 184 158 183 126 157 185 138 179 147 135 125 134 109 bo 81 97 155 88 143 131 124 122 104 128 135 65 93 137 115 133 82 111 84 89 47
system in cs 906 338 1114 435 992 373 987 394 1104 426 1059 407 1006 394 870 344 1074 419 991 394 1086 433 815 332 957 388 1097 441 899 348 1099 442 910 367 882 338 841 343 890 361 767 316
us 5 8 11 8 11 7 8 6 7 9 9 9 10 10 12 8 8 7 8 6 7
cpu sy id 5 90 6 86 5 84 5 87 7 82 5 87 5 87 7 87 7 86 6 86 6 84 8 83 9 81 9 81 7 82 8 84 8 84 7 86 6 87 5 89 6 87
Here We Go
Work up Performance Pyramid:
Database Block Size = 2K SGA Buffer Cache = 64M SGA Shared Pool = 64M SGA Redo Cache = 4M Redo Log Files = 4M Tablespaces = Dictionary
Database Block Size = 2K SGA Buffer Cache = 128M SGA Shared Pool = 128M SGA Redo Cache = 4M Redo Log Files = 4M Tablespaces = Dictionary
Database Block Size = 2K SGA Buffer Cache = 128M SGA Shared Pool = 128M SGA Redo Cache = 16M Redo Log Files = 16M Tablespaces = Dictionary
Database Block Size = 4K SGA Buffer Cache = 128M SGA Shared Pool = 128M SGA Redo Cache = 16M Redo Log Files = 16M Tablespaces = Dictionary
Database Block Size = 4K SGA Buffer Cache = 128M SGA Shared Pool = 128M SGA Redo Cache = 16M Redo Log Files = 4M Tablespaces = Local
Database Block Size = 8K SGA Buffer Cache = 128M SGA Shared Pool = 128M SGA Redo Cache = 16M Redo Log Files = 16M Tablespaces = Local
Database Block Size = 8K SGA Buffer Cache = 128M SGA Shared Pool = 128M SGA Redo Cache = 16M Redo Log Files = 64M Tablespaces = Local
DB2 DB3 DB4 DB5 DB6 load time 48.57 41.39 17.35 15.07 11.42 % Improved -1.73% -17.35% -138.56% -15.13% -31.96% trans/sec 8.15 9.15 10.09 10.18 10.43 10.68 % Improved 10.88% 9.33% 0.89% 2.36% 2.42%
DB1 49.41
DB7 DB Final 10.48 10.48 -8.97% -371.47% 10.72 10.72 0.32% 23.93%
Linuxconf = monolithic
Shared memory
/usr/src/linux-2.2.16/include/asm/shmparam.h #define SHMMAX 0x13000000
Monolithic Kernel - If you compile everything into the kernel to exactly match your hardware and thus make minimal use of modules.
Semaphors
/usr/src/linux-2.2.16/include/linux/sem.h #define SEMMNI 100 #define SEMMSL 512 #define SEMMNS (SEMMNI*SEMMSL) #define SEMOPM 100 #define SEMVMX 32767
Linuxconf = monolithic
Shared memory
/usr/src/linux-2.2.16/include/asm/shmparam.h #define SHMMAX 0x13000000
Semaphors
/usr/src/linux-2.2.16/include/linux/sem.h #define SEMMNI 100 #define SEMMSL 512 #define SEMMNS (SEMMNI*SEMMSL) #define SEMOPM 100 #define SEMVMX 32767
Linuxconf = monolithic
Shared memory
/usr/src/linux-2.4.00/include/linux/shm.h #define SHMMAX 0x13000000
Semaphors
/usr/src/linux-2.4.00/include/linux/sem.h #define SEMMNI 128 #define SEMMSL 512 #define SEMMNS (SEMMNI*SEMMSL) #define SEMOPM 128 #define SEMVMX 32767
Linuxconf = monolithic
Shared memory
/usr/src/linux-2.4.00/include/linux/shm.h #define SHMMAX 0x13000000
Semaphors
/usr/src/linux-2.4.00/include/linux/sem.h #define SEMMNI 128 #define SEMMSL 512 #define SEMMNS (SEMMNI*SEMMSL) #define SEMOPM 128 #define SEMVMX 32767
Edit /etc/fstab
/dev/sda6 /dev/sda1 /dev/cdrom /dev/md0 /dev/fd0 none none /dev/sda5 / /boot /mnt/cdrom /u01 /mnt/floppy /proc /dev/pts swap ext2 ext2 iso9660 ext2 auto proc devpts swap defaults,noatime defaults,noatime noauto,owner,ro defaults,noatime noauto,owner defaults,noatime gid=5,mode=620 defaults,noatime 1 1 0 1 0 0 0 0 1 2 0 2 0 0 0 0
NtfsDisableLastAccessUpdate=1
1st parm is max # of dirty buffers in cache. Higher = delayed disk writes.
2nd parm is max # of dirty buffers per write. Higher = delayed, bursty I/O.
3rd parm is # of buffers added to list of free buffers by refill_freelist. 4th parm refill_freelist comes across more than nref_dirt dirty buffers, it will wake up bdflush. 5th parm is max time Linux waits before writing dirty buffers to disk for data blocks.
Restart daemon
/etc/rc.d/init.d/network restart
6th parm is max time Linux waits before writing dirty buffers to disk for file system metadata.
Create TPC-C Database EXT2 348 EXT3 228 Reiser 378 IBM JFS 351 RAW 396 RAW X 2 396
DB1 DB Final OS1 OS2 OS3 OS4 OS5 OS6 OS7 OS Final Total load time 49.41 10.48 9.54 9.40 8.32 8.20 5.58 4.43 3.80 3.80 3.80 % Improved -371.47% -9.85% -1.49% -12.98% -1.46% -46.95% -25.96% -16.58% -151.05% -1200.26% trans/sec 8.15 10.72 11.51 11.52 12.82 12.90 13.88 14.99 20.51 20.51 20.51 % Improved 23.93% 6.90% 0.10% 10.09% 0.66% 7.09% 7.37% 26.92% 43.88% 60.25%