Beruflich Dokumente
Kultur Dokumente
3
NASDAQ – Business Objective
4
<Insert Picture Here>
5
The Databases
• MDSS
• Staging Database
• This is not partitioned
• MDSP
• Permanent Database
• Monthly & Non-Monthly Tables
• Partitioned
• Typical day loads 400m rows
• Historical Databases
6
Staging Database MDSS
Oracle
“Staging
7
Interim Solution
sources
sources
MDSS MDSP
Oracle
SQL Oracle Database
Server “Staging
10g Release 2
... Permanent
• Use publish/subscribe
• Feed to SQL Server
• Push data to Unix system
• Load into Oracle
• During day & market shutdown
• Copy to permanent database
External customers, e.g. NASD
8
Save Costs by using ISAM files
sources
sources
MDSS MDSP
Oracle
“Staging Oracle Database
10g Release 2
ISAM Files ... Permanent
• Use publish/subscribe
• Feed to ISAM Files
• Files sent in batches to Unix System
• Load into Oracle
• During day & market shutdown
• Copy to permanent database
External customers, e.g. NASD
9
Copy Performance MDSS to MDSP
MDSS
Oracle MDSP
“Staging
Oracle Database
...10g Release 2
• Quote and BBO tables in the Permanent
Permanent Database
• Originally
• Daily Partitions
• New Solution in MDSP
• 5 Daily Range/List partitions • Loading 70m records
• 5 extracts using insert /*append */ • Save 2-3 hrs load time
to load simultaneously into the
subpartitions
10
Partitioning in MDSP
• Partitioning scheme
• Daily or Monthly depending on volume
• Range and Range/List partitioning
• Across 53 tables
• 12123 user partitions
• 1490 sub-partitions on 2 tables
• Placed in monthly tablespaces
• Tablespace set to read-only when all data for that month is
loaded
11
Compression Reduced Costs
12
Database Implementation without ILM
Data Lifecycle
Active Less Historical Archive
Active
13
Match Lifecycle to Storage to Optimise Cost
Data Lifecycle
Less Offline
Active Historical
Active Archive
14
Reduce Costs using 4 Tiers of Storage
15
Tier 2 – Mid Range
• Tier 2 (Mid-Range)
• Best balance of price performance & reliability
• SLA is 99.99%
• Capable to support wide variety of hosts, applications and
workloads
• Fibre-channel
• Typically 146gb and 300gb 10k RPM drives
16
Tier 3 – Online Archive
17
Tier 4 – Offline Archive
• Tier 4 (Offline)
• Archive to Tape
• Used only for Backups
18
Storage Tier Costs
Tier 1 $72
Tier 2 $14
Tier 3 $7
Tier 4 $1.5
19
How is Tiered Storage Used
20
Storage Cost Savings for MDSP
21
Moving Data Across Storage Tiers
22
Historical Data
23
Consolidating the Historical Data
24
Archiving
25
Controlling Access to Data
• Roles
• determine tables have access to
• Views
• Limit data that can be viewed
26
Auditing
27
Conclusion
28
29