EXALOGIC Communication Osm WP 1956581

An Oracle White Paper
June 2013
Performance Test of Oracle Communications Service Fulfillment Solution on Oracle
Exadata Database Machine and Oracle Exalogic Elastic Cloud
Performance Test of Oracle Communications Service Fulfillment Solution on Oracle Exadata Database Machine and Oracle Exalogic Elastic Cloud
Disclaimer
The following is intended to outline our general product performance and throughput. It is
intended for information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon in
making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracles products remains at the sole discretion of Oracle.
Performance Test of Oracle Communications Service Fulfillment Solution on Oracle Exadata Database Machine and Oracle Exalogic
Elastic Cloud
Performance Test of Oracle Communications Service

Fulfillment Solution on Oracle Exadata Database Machine
and Oracle Exalogic Elastic Cloud ................................................. 0
Executive Overview ........................................................................... 1
Background ....................................................................................... 2
Solution Overview ............................................................................. 2
Business Processes .......................................................................... 3
Data Composition & Workload Model ................................................ 3
Test Scenario Flow ............................................................................ 4
Performance Test Environment ......................................................... 5
Performance Test Topology .............................................................. 6
Benchmark Test Results ................................................................... 8
Recommendations........................................................................... 11
Performance Testing Environment .................................................. 11
Hardware Configuration ............................................................... 11
Software Configuration ................................................................ 11
Executive Overview
This paper presents the results of a performance benchmark, conducted by Oracle in
conjunction with a large Western European communications service provider (CSP), to confirm
that Oracle Communication Order and Service Management (OSM) and Automatic Service
Activation Program (ASAP) are able to meet and exceed the performance requirements for
service fulfillment of fixed and mobile communication services for large, tier-1 CSPs. The
benchmark was conducted on Oracle Exalogic X2-2 (Applications) and Oracle Exadata X2-2
(DB) machines. Table 1 below depicts the end-to-end performance achieved on the
OSM+ASAP based solution on Exadata and Exalogic hardware.
Table 1: Summary of Scalability Tests Results
Test Case /
Targeted
Achieved
Order
Application
Database
Load Factor
Orders
Orders
Lifetime
(Exalogic)
(Exadata)
(hourly)
(hourly)
(Seconds)
Utilization
Utilization
(%)
(%)
T.75 / 75%
187,500
187,835
0.21s 3.05s
5.2%
9.4%
T.100 / 100%
250,000
252,535
0.21s 3.15s
6.3%
12%
T.150 / 150%
375,000
377,567
0.23s 3.39s
9.1%
17%
T.200 / 200%
500,000
512,287
0.26s 3.78s
11.7%
22%
Oracles engineered systems approach delivered a highly-optimized configuration,

which maximizes the performance of the entire technology stack from application to
disk. This is evident in the following order processing results:
o
500,000+ service orders per hour, representing twice the CSPs expected
future hourly peak load. It provides ample spare capacity for future business
growth.
Revenue impacting orders completed with latencies of less than 300

milliseconds.
Performance tests achieved the highest and stable OSM/ASAP Service Order
Fulfillment throughput results across all types of orders.
Oracle Confidential
It was demonstrated that the solution achieved linear scalability with

75%:100%:150%:200% load test results, from order throughput, order
lifetimes and system capacity utilization perspectives.
The OSM/ASAP based Service Fulfillment solution was validated on a full Exadata
and Exalogic rack. This large scale benchmark demonstrated that the solution required
less than 10% of the total compute capacity. Such a configuration provides CSPs
considerable additional capacity to meet future growth and also consolidate other
compute intensive applications on to the same platform.
Background
The throughput objective was devised to prove that OSM and ASAP can scale and meet the
performance requirements of a typical Tier 1 CSP, by measuring throughput under different
peak load scenarios. Additionally, latency/response time objective was devised to understand
and analyze the impact of increased order throughput on order lifetimes and hardware
resource utilization. In order to meet the real-world scenarios, a number of benchmark tests
which reflect the complexity of todays mobile provisioning processes were devised specifically
for this benchmark.
Solution Overview
The benchmark solution was developed to run using Oracle Communications OSM and ASAP
products. OSM is built to help customers address their long standing challenges in the end to
end lifecycle of order. ASAP provides a convergent service activation platform that
automatically activates services in a heterogeneous network and IT environment. OSM and
ASAP can be further referenced at the following locations:
Oracle Communications Order and Service Management
Oracle Communications ASAP
Oracle Confidential
Business Processes
The service fulfillment scenarios consisted of processing a pre-determined number of orders in
a timed manner. There were five different order types which were received by the solution in
predetermined ratios according to the load scenarios. The five order types were:
Table 2: Service Order Types and Description
Order Type
Order Description
TYPE_1
Activate a VPN service for a subscriber
TYPE_2
TYPE_3
TYPE_4
TYPE_5
Modify IMSI and MSISDN of a subscriber
Deactivate a subscriber from a DCC device
Change five to fifty subscriber profile data attributes
Change one to five subscriber profile data attributes
Data Composition & Workload Model

The workload model was a mixed order load, consisting of five types of orders in different
prescribed proportions.
The number of orders for the 250k Mixed Orders Throughput Test was formulated as the
baseline for the Scalability tests. The workload mix and the number of orders processed during
the baseline test, which will be further referenced in this document as the T.100 Benchmark, is
shown below:
Oracle Confidential
Table 3: Scalability Test Workload Model

Order Type
Orders per Hour
Tasks per Order
Tasks per Hour
TYPE_1
8.500
15
127,500
TYPE_2
3,250
60
195,000
TYPE_3
225,000
450,000
TYPE_4
3,250
55
178,750
TYPE_5
10,000
50,000
TOTAL
250,000
1,001,250
In each scenario, the throughput of the orders (orders/hour) as well as order processing times
were captured and analyzed by order type. The two most important metrics were number of
orders processed/hour and Average Order Lifetime on a per order type basis
Test Scenario Flow

Input order volumes were generated by a load test client, which were sent to a front-end HTTP
proxy server of the OSM cluster. The Proxy then load balanced the incoming order creation
and subsequent processing requests to OSM managed servers in the OSM cluster using a
uniform, round-robin algorithm.
This benchmark utilized an HTTP-based load test client as order submission method to OSM
due to need to model the carriers legacy integration accurately. However, customers are
advised to use JMS for order submission into OSM for reliability. Also, Weblogics built-n proxy
server was utilized for this benchmark, though it is advisable that customers use alternatives
such as F5 or Oracle HTTP Server. With these alternatives, the results in this benchmark
would not have been materially affected.
Oracle Confidential
Each service order request was transformed into corresponding activation request by OSM
and was then sent to the respective ASAP instance (one of the eight total available ASAP
environments) for execution of the appropriate network configuration and activation
commands. When the final activation task was completed for the service order, OSM
proceeded to mark the order as completed, thus signaling the finalization of processing.
Figure 1 Order Flow in Performance Test
External
System /
Load Client
Order
Flow
Inbound
Flows
Response
Flows
Persistence
Oracle DB
OSM
CLUSTER
Act
Flow
ASAP #1
ASAP #1
ASAP #1
WS /
JMS
Persistence
Flows
OSM/
ASAP
Config
Flow
ASAP #n
Network
Devices
Performance Test Environment

The hardware platform consisted of Oracle Exalogic X2-2 and Exadata X2-2 machines to
handle application logic and database transactions for the Service Fulfillment solution. All
machines ran Oracle Enterprise Linux 5.8. The database was Oracle Enterprise Edition Real
Application Cluster (RAC), v11.2.0.3.0. The WebLogic 11g application instances hosted the
application logic and provided for the scalability of the application tier. The available QDR
Infiniband network interfaces were utilized to setup internal networking for application and
database tiers to route the internal as well as cross-tier traffic over this high bandwidth
network. Additionally, the Exalogic tier was connected to a 7320 ZFS Storage Appliance, which
was consistently leveraged to host application packages, domains, JTA Logs and JMS
Persistent Stores. The Exadata tier hosted application schemas with dedicated storage
provided by a full rack of Exadata Storage machines.
ORACLE EXALOGIC ELASTIC CLOUD X2-2
Oracle Confidential
ORACLE EXADATA MACHINE X2-2
Multiple tests were conducted to collect the metrics presented in this summary. All tests were
conducted in a controlled environment in Oracle Communications Performance Engineering
lab with no other applications running on the platform which could interfere with the results.
Performance Test Topology

A large-scale OSM/ASAP deployment was constructed to allow for end-to-end performance
testing of the service fulfillment solution. The OSM application was deployed in a WebLogic
cluster, using RAC Active/Active for database tier scalability. Each ASAP was deployed as its
own WebLogic server.
Since OSM was responsible for the bulk of the workload, it was more resource intensive than
ASAP. Hence, OSM was scaled out to 16 managed servers in the cluster, with each managed
server running in a separate Exalogic physical compute node. In order to balance the
processing demands from such a large OSM Cluster, eight independent ASAP environments
were deployed. The eight ASAPs were integrated with the single, sixteen nodes OSM Cluster,
using a Store and Forward Agent mechanism, which is the recommended best practice for
Oracle CGBU OSS integration.
Oracle Confidential
This single deployment topology was consistently used for all benchmark scenarios, as shown
in the figure below:
Figure 2: Test Deployment Topology
In this performance test, sufficient hardware was available to process half a million mobile
service orders. Since just one OSM managed server did not require the full computing capacity
of its hosting Exalogic compute node, the first eight compute nodes also ran one unique ASAP
environment each (out of total eight ASAP environments used). Hence, the first 8 nodes of the
Exalogic tier hosted one instance of OSM and ASAP each, the next eight compute nodes
hosted the remaining eight OSM nodes.
Oracle Confidential
Benchmark Test Results

The detailed scalability results for mixed orders scenarios are given below:
Table 4: Scalability Tests Results Throughput vs. Average Order Lifetime
Test Case
Throughput
Average Order Lifetimes (Seconds)
(Orders /
Hour)
Type 1
Type 2
Type 3
Type 4
Type 5
T.75
187,835
1.73s
2.73s
0.21s
3.05s
0.93s
T.100
252,535
1.76s
2.79s
0.21s
3.15s
0.95s
T.150
377,967
1.89s
3.02s
0.23s
3.39s
1.03s
T.200
512,287
2.12s
3.27s
0.26s
3.78s
1.15s
Figure 3: Throughput vs Order Lifetime Chart
600
12
500
10
400
300
200
100
0
70
120
Order Lifetime (Seconds)
Thousands
Throughput (Orders/Hour)
Throughput vs Order Lifetime (OLT)

Scalability
Throughput
OLT Type1
OLT Type2
OLT Type3
OLT Type4
OLT Type5
170
Test Case
Oracle Confidential
The detailed application and database utilization results are depicted below:
Table 5: Scalability Tests Results Throughput vs. Utilization
Test Case / Load
Throughput
Application CPU
Database CPU
Factor (%)
(Orders / Hour)
Utilization (%)
Utilization (%)
T.75
187,835
5.2%
9.4%
T.100
252,535
6.3%
12%
T.150
377,967
9.1%
17%
T.200
512,287
11.7%
22%
Figure 4: Throughput vs. Utilization
600
500
25
400
20
300
15
200
10
100
0
CPU Utilization (%)
Thousands
Throughput (Orders/hour)
Throughput vs Appl. & DB CPU Utilization %
Throughput
Application CPU%
Database CPU %
5
50
100
150
200
250
Test Case
The key observations from the test results are detailed below:
While varying the work load between 75% and 200% of the targeted peak load the
average order lifetimes, shown in Figure 3, remained nearly constant for all order
types. Only marginal increases have been observed. From a scalability point of view
Oracle Confidential
this represents an ideal system behavior. This demonstrated predictable results from a
scalability perspective to understand the effect of increased workloads on processing
latency (Order Lifetime).
As shown in Figure 4, the system scaled also linearly from a hardware utilization point
of view. Both, the Application CPU utilization as well as the Database CPU utilization
matched perfectly with the increased throughput.
This Benchmark proved that Oracle's Service Fulfillment Solution running on Oracle's
Engineered Systems scales not only perfectly for high-end service provider's
workloads but also offers plenty of spare capacity giving Tier-1 service providers
sufficient headroom for future growth and flexibility for IT platform consolidations.
10
Oracle Confidential
Recommendations
After completing this OSM/ASAP service fulfillment benchmark, the following
recommendations are being offered to enable customers achieve optimal performance from
their investment in these Oracle products.
Deploying OSM/ASAP on Oracles Engineered Systems delivers outstanding

performance both in absolute terms and in terms of price/performance.
Customers are advised to follow the hardware and software configuration devised by
this performance test study.
Performance Testing Environment

Hardware Configuration
Application Tier ORACLE EXALOGIC ELASTIC CLOUD X2-2
Database Tier ORACLE EXADATA MACHINE X2-2
Software Configuration
Oracle Communications OSM 7.2.0
Oracle Communications ASAP 7.2.0
Oracle Communications Service Fulfillment Solution Design Studio Cartridges
Oracle Enterprise Linux 5.8
Oracle Weblogic Server 11g R1 PS5
Oracle Enterprise Edition Real Application Cluster (RAC), 11.2.0.3.0 (with Exadata
Feb 2013, 15846185 - DATABASE, CRS, DISKMON patch)
11
Oracle Confidential
Performance Test of Oracle Communications
Copyright 2013, Oracle and/or its affiliates. All rights reserved. This document is provided for information purposes only and the
Service Fulfillment Solution on Oracle Exadata
contents hereof are subject to change without notice. This document is not warranted to be error-free, nor subject to any other
Database Machine and Oracle Exalogic Elastic
warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability or
Cloud
fitness for a particular purpose. We specifically disclaim any liability with respect to this document and no contractual obligations are
formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any
June 2013
means, electronic or mechanical, for any purpose, without our prior written permission.
Author: Oracle Communications Performance

Group
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.
Oracle Corporation
AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices.
World Headquarters
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license
500 Oracle Parkway
and are trademarks or registered trademarks of SPARC International, Inc. UNIX is a registered trademark licensed through X/Open
Redwood Shores, CA 94065
Company, Ltd. 1010
U.S.A.
Worldwide Inquiries:
Phone: +1.650.506.7000
Fax: +1.650.506.7200
oracle.com

EXALOGIC Communication Osm WP 1956581

Hochgeladen von

Dokumentinformationen

Originaltitel

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

EXALOGIC Communication Osm WP 1956581

Hochgeladen von

Copyright:

Verfügbare Formate

An Oracle White Paper

Performance Test of Oracle Communications Service

Oracles engineered systems approach delivered a highly-optimized configuration,

Revenue impacting orders completed with latencies of less than 300

It was demonstrated that the solution achieved linear scalability with

Activate a VPN service for a subscriber

Modify IMSI and MSISDN of a subscriber

Deactivate a subscriber from a DCC device

Change five to fifty subscriber profile data attributes

Change one to five subscriber profile data attributes

Data Composition & Workload Model

Table 3: Scalability Test Workload Model

Orders per Hour

Tasks per Order

Tasks per Hour

Test Scenario Flow

Performance Test Environment

ORACLE EXADATA MACHINE X2-2

Performance Test Topology

Benchmark Test Results

Average Order Lifetimes (Seconds)

Figure 3: Throughput vs Order Lifetime Chart

Order Lifetime (Seconds)

Throughput vs Order Lifetime (OLT)

Figure 4: Throughput vs. Utilization

CPU Utilization (%)

Throughput vs Appl. & DB CPU Utilization %

Deploying OSM/ASAP on Oracles Engineered Systems delivers outstanding

Performance Testing Environment

Performance Test of Oracle Communications

Service Fulfillment Solution on Oracle Exadata

Database Machine and Oracle Exalogic Elastic

Author: Oracle Communications Performance

500 Oracle Parkway

Redwood Shores, CA 94065

Company, Ltd. 1010

Das könnte Ihnen auch gefallen