Beruflich Dokumente
Kultur Dokumente
Udayasuryan Kodoly
Billy Robinson
June 2011
Introduction
High-performance computing applications for oil and gas exploration revolve around processing
extremely large amounts of very rich data such as prestack seismic data, which can involve simulation
that spans long time periods. Prestack data can be hundreds of terabytes (TB) and even petabytes (PB)
before the final seismic-imaging application is complete. Today’s highly-complex seismic data-acquisition
systems employ new techniques, such as wide-azimuth towed streamer (WATS) and coil shooting for
offshore data acquisition, resulting in full azimuth (FAZ) seismic data, which is stored for later processing.
All the data-generation techniques can create hundreds of gigabytes per hour. To effectively manage, use
and quickly access this data, companies need a proven, highly-scalable and available, high performance,
enterprise-reliable data-storage solution such as IBM® Scale Out Network Attached Storage (IBM
SONAS) for enterprise demands and IBM Storwize® V7000 Unified, both of which address the
requirements of the midrange market.
IBM SONAS and the Storwize V7000 Unified storage system offer significant flexibility. Either can have a
single file system that can range in size from terabytes to petabytes and that is capable of accessing the
entire set of seismic data. IBM SONAS and Storwize V7000 Unified are ideal storage systems that can
provide a highly-scalable file system to handle the exponential growth of seismic data. Both IBM SONAS
and Storwize V7000 Unified provide exceptional performance for raw storage for seismic processing.
For seismic data processing to yield reliable results, IBM SONAS or the Storwize V7000 Unified storage
system and the Paradigm Epos 4 integrated solution has the following key attributes:
• Well-defined, high-performance storage architecture with attractive economic benefits
• High-density storage enclosures (up to 21.6 PB for SONAS)
• Highly-available file system with outstanding performance
• Simple-to-manage, comprehensive business-continuity capabilities
Both IBM SONAS and Storwize V7000 Unified as well as the Paradigm Epos 4 integrated seismic
processing solution meets all of these requirements by offering a reference configuration that is suitable
for the seismic-processing industry.
Intended audience
This technical report is intended for:
• Integrators, suppliers and vendors in the oil and gas industries
• Oil and gas companies
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
1
Prerequisites
This technical paper assumes familiarity with the following prerequisites:
• Basic knowledge of the IBM SONAS or Storwize V7000 Unified storage system
• Basic knowledge of Paradigm Rock & Fluid Canvas 2009 | Epos 4
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
2
Figure 1: Real-time seismic data analysis
Collecting and processing large data sets obtained by a variety of onshore and offshore seismic-
acquisition systems is essential to the upstream exploration industry. The IBM SONAS advanced
architecture offers an economical and reliable enterprise-class, high-performance computing storage
environment suitable for the high throughput required for seismic processing.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
3
IBM Storwize V7000 Unified overview
The IBM Storwize V7000 Unified system is a virtualizing Redundant Array of Independent Disks (RAID)
storage system that supports both block protocols and file protocols. This unified system includes the
Storwize V7000 file module and the Storwize V7000 storage system.
The file module is a clustered system that consists of two units, providing file systems for use by network-
attached storage (NAS). The file module uses Storwize V7000 to provide the file module with volumes.
Other volumes, which are block volumes, are provided on the SAN to be presented to hosts.
The Storwize V7000 storage system consists of a drive enclosure called the control enclosure. Both hard
disk drives (HDDs) and solid state drives (SSDs) are supported. The control enclosure contains disk
drives and two node canisters that are managed as a single clustered system. Expansion enclosures
contain drives and are attached to the control enclosure. Expansion canisters include the serial-attached
SCSI (SAS) interface hardware that enables the node hardware to use the drives of the expansion
enclosures (see Figure 1).
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
4
• Improve space utilization from 33 to 50 percent compared to other storage solutions, and
reduce capacity requirements by up to 75 percent with the space-efficient IBM Tivoli® Storage
FlashCopy® Manager offering.
• Increase storage performance up to 200 percent by using IBM System Storage® Easy Tier™
technology.
• Dynamic migration helps speed time-to-value from weeks or months to days, and also
eliminates the cost of add-on migration tools and provides continuous availability of
applications by eliminating downtime.
• Thin-provisioning makes it possible to use (acquire) only the required disk capacity.
• The IBM Storwize V7000 Unified system consolidates block and file storage in a single system
for simplicity and greater efficiency.
• IBM Tivoli Storage Productivity Center for Disk Select Performance Optimization technology
can reduce service times of resource-constrained application by an average of 48 percent and
up to a maximum of 90 percent.
• IBM Systems Director Storage Control, based on Tivoli Storage Productivity Center, can be
used for midsize clients to integrate storage management with server and network
management at 50 percent lower hardware costs (by using a single server instead of two
servers) and requires lower skills to learn (single UI).
• IBM Active Cloud Engine™ technology provides automated policy-based management of files
to reduce costs through the use of tiered storage and improve data governance.
• Clustered systems support the needs of your growing business and enable you to buy
additional hardware only as needed.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
5
Paradigm Epos 4 software benefits
The Paradigm Epos infrastructure and data management system underlies the entire Epos-based
application suite, links the applications to a shared database and provides a common working
environment for individuals or teams across disciplines. It is based on the client-server architecture, which
provides a multiuser, multi-project environment for data sharing and collaborative work.
There are three major components to the Epos infrastructure and software configuration:
• Paradigm Name Service (PNS) provides the ability for users to create and access seismic
projects for use within the Epos software.
• Epos services provide application-level access to seismic data, utility files, well data and other
resources within the software and processing environment.
• Epos applications provide end-to-end seismic processing tasks, which includes 3D prestack
seismic-imaging applications.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
6
Summary of validation solution
Either IBM SONAS or Storwize V7000 Unified and the Paradigm Epos 4 integrated seismic-processing
solution are intended for high-performance random and sequential operations and sustaining exponential
growth in prestack seismic data.
The solution was validated on the IBM SONAS system with six interface nodes and two storage nodes
and Storwize V7000 Unified storage system. The file systems were laid out on 60 1TB SATA 7.2K rpm
disks and 60 2TB Nearline SAS 7.2K rpm disks with a RAID 6 configuration. Paradigm Epos 4 is installed
on the Red Hat RHEL5 server. Then, using the Network File System (NFS) protocol, the file system was
mounted on the Paradigm Epos 4 Red Hat Enterprise Linux® 5 server system. Either IBM SONAS or
Storwize V7000 Unified file systems were accessed by the Paradigm Epos 4 RHEL 5 server system
(through a 10 GbE network infrastructure using the NFS protocol). IBM SONAS interface nodes and
Storwize V7000 Unified enclosure and Paradigm Epos 4 RHEL 5 server systems were connected to the
Cisco Catalyst 6509 series Ethernet switch.
Figure 3: Example of a Paradigm Epos 4 seismic-processing solution configuration with IBM SONAS
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
7
The IBM Storwize V7000 Unified storage system and Paradigm Epos 4 integrated seismic processing
solution combines IBM Storwize V7000 Unified and Paradigm Epos 4 seismic-processing software
installed on an RHEL 5 server system. Figure 4 shows the solution configuration with IBM Storwize
V7000 Unified.
Figure 4: Example of a Paradigm Epos 4 seismic-processing solution configuration with IBM Storwize V7000 Unified
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
8
Unit Device location Optional or mandatory
42 50-port GbE Switch 2 Mandatory
41 50-port GbE Switch 1 Mandatory
40
39 2U blank filler panel
38
37 Management node (2851-SM1) 1 Mandatory
36 36-port IB 2851-I36 2 Mandatory
35 36-port IB 2851-I36 1 Mandatory
34
33 Interface node (2851-SIx) 6
32
31 Interface node (2851-SIx) 5
30
29 Interface node (2851-SIx) 4
28
27 Interface node (2851-SIx) 3 iPDU Mandatory
26
25 Interface node (2851-SIx) 2
24
23 Interface node (2851-SIx) 1 Mandatory
22 1U blank filler panel
21 KVM / Console port Mandatory
20
19 Storage node (2851-SSx) 2 Mandatory
18
17 Storage node (2851-SSx) 1 Mandatory
16
15
14 Disk storage expansion unit (2851-DE1)
13 2.2
12
11
10 Storage controller (2851-DR1) 2.1
9
8
7
6 Disk storage expansion unit (2851-DE1)
5 1.2
4
3
2 Storage controller (2851-DR1) 1.1 Mandatory
1
Table 1: Base rack configuration 3 - FC9005
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
9
Paradigm Epos 4 server configuration
Paradigm Epos 4 server configuration includes:
• Red Hat Enterprise Linux version 5.6
• X86-64 based server architecture
• Processor Intel® Xeon® X5650 2.67 GHz x 2 and 128 GB RAM
• 10 GbE, 2 port QLogic network interface
There are two types of NFS mounts from the Paradigm Epos4 RHEL server system.
• Soft mount: If soft mounts are used and the NFS server is lost, (for example: by reboot, server
crash or lost network connection) the client can close the connection and unmount the network
file system. However, soft mounts require more caching on the client than hard mounts to
maintain this ability. This can have an impact on performance. In addition, data can be lost if the
server crashes or network connection breaks down.
• Hard mount: With a hard mount, the client never gives up trying to reconnect to the server. The
advantage of a hard mount is the minimized risk of losing data. The disadvantage is that open I/O
requests can cause a high client workload, and the client must be rebooted to solve the issue.
It is good practice to use hard mounts with the interrupt (intr) option, which permits unmount of the
network file system in case the server is lost.
For this solution, the intr option is specified in the /etc/fstab configuration file:
With these fstab entries, the file system can be mounted on the Paradigm Epos4 RHEL server system
with the mount –a command and displayed with the df command.
Another setting that is worth consideration is timeo=n, which sets time-out period to n tenths of a second.
The IBM SONAS or Storwize V7000 Unified Information Center recommends a timeout of 100 seconds
(timeo=1000).
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
10
Tests with Paradigm 3D imaging and migration
For testing SONAS or Storwize V7000 Unified with Paradigm Epos software, the test team ran several 3D
prestack migrations. Prestack 3D depth and time migrations account for approximately 70 to 80 percent
of the cycles and resources used today for seismic imaging and processing.
The three migrations used for these tests were as follows: 3D Kirchoff Prestack Time Migration,
3D Common Shot Wave Equation Migration and 3D Common Reflection Angle Migration.
Brief descriptions of these migration applications provided within Paradigm Epos software are given in
this section.
This wave equation migration is the preferred solution for irregular land seismic acquisitions. In this
method, the receiver’s wave field, containing a variety of offsets, and a shot wave field, generated from a
source signal, are downward-extrapolated. The image is obtained by dividing the two wave fields. This
method enables full control of the massive array of nodes, assures redundancy in case of node failure,
and enables stop and restart of the migration at any stage. The downward extrapolation is performed in
space and frequency domains.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
11
velocity. The migration supports isotropic and anisotropic models and can be performed using all
types of marine and land data sets, including OBC-OBS.
• Customizable solution: The migration is extremely versatile and can be adapted to any
exploration objective. It can be used for full-volume imaging with full apertures and on clusters with
massive amount of nodes. It will also be adapted (in future releases) to run over target areas with
a model-driven aperture, for fast turnaround and for extremely high-resolution results.
• Improved success: You can improve exploration and development success by using seismic
data with larger offsets and wider azimuths. CRAM has all the flexibility of the Kirchhoff imaging
solution as well as the main imaging benefits (for example, multiarrival) of the full wave imaging
solutions.
The SEGEAGD salt model survey was used as input and processed during these 3D migration tests. The
salt model seismic and velocity data was registered and stored into Paradigm Name Service (PNS).
PNS is a key component of the Paradigm software infrastructure for providing data access and control.
Each migration was run with and without using IBM SONAS or the Storwize V7000 Unified file systems.
Runtimes for both the sets of jobs were about the same.
Some additional runs were made using the tmp and scratch files stored locally on the compute server
compared to storing all data including tmp and scratch files on SONAS or Storwize V7000 Unified. Again,
there was no noticeable difference in run times for local disks or tmp and scratch files.
This set of tests further shows that users can increase price and performance by configuring multiple
SONAS or Storwize V7000 Unified file systems when running the Paradigms Epos software. One file
system was used for the high-performance tmp and scratch files, and the main file system was used for
PNS-based storage. This basically removes the requirement for local storage on each compute node
when running the application. Additional tests were required to confirm the tmp and scratch file results on
large clusters; however, a configuration consisting of dual file systems might result in a considerable cost
benefit and performance boost for clusters with hundreds or thousands of nodes.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
12
Summary
Paradigm Epos empowers geoscientists and engineers from multiple disciplines to share data,
collaborate on problem solving and interact in a common visualization environment for more effective
decision making.
IBM SONAS, Storwize V7000 Unified and Paradigm Epos 4 can provide the performance, scalability and
functions you need for seismic-processing requirements. This tested solution from IBM and Paradigm
unlocks the trapped value of seismic data assets to help your organization manage acquired seismic
content. The agile, flexible and scalable solution delivers the performance, capacity and information-
lifecycle management capabilities built into the IBM solutions along with the Paradigm Epos
infrastructure.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
13
Appendix A: Glossary
• IBM Scale Out Network Attached Storage (SONAS) is built on IBM high-performance computing
experience, and based upon IBM General Parallel File System (IBM GPFS™), scale out network-
attached storage (NAS) solution, and provides the performance, clustered scalability, high
availability and functions that are essential to meet strategic big data and cloud-storage
requirements.
• IBM Storwize V7000 Unified is a virtualized storage system that is designed to consolidate block
and file workloads into a single storage system for simplicity of management, reduced cost, highly
scalable capacity, performance and high availability. IBM Storwize V7000 Unified Storage also
offers improved efficiency and flexibility through built-in solid state drive (SSD) optimization, thin
provisioning and nondisruptive migration of data from existing storage. The system can virtualize
and reuse existing disk systems that offer a greater potential return on investment.
• Paradigm Epos 4 is among the most advanced digital platforms in the industry for dynamic,
configurable, network-based data management, offering enterprise-wide, secure data access, with
optimal usage of network bandwidth. The Paradigm Epos Data management and interoperability
system presents a new approach, an agile, distributed database that removes the constraints and
data duplication requirements of legacy systems.
• Paradigm Name Service (PNS) provides the ability for users to create and access seismic
projects for use within the Epos software.
• Epos services provide application-level access to seismic data, utility files, well data and other
resources within the software and processing environment.
• Epos applications provide end-to-end seismic processing tasks, which includes 3D prestack
seismic-imaging applications.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
14
Appendix B: Materials used in the lab setup
Infrastructure
Vendor Quantity Details
component
IBM SONAS
1
Management node – 1
Interface nodes – 6
Storage nodes – 2
Nearline SAS and SAS drives
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
15
Appendix C: Resources
The following websites provide useful references to supplement the information contained in this paper:
• IBM Systems on PartnerWorld®
ibm.com/partnerworld/systems
• IBM Redbooks®
ibm.com/redbooks
• Implementing the Storwize V7000 and the IBM System Storage SAN32B-E4 Encryption Switch
www.redbooks.ibm.com/redbooks/pdfs/sg247977.pdf
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
16
Paradigm documentation
• A new method of volume rendering applied to a seismic dataset of the Barnett shale
www.pdgm.com/getattachment/Resources-(2)/Articles---Papers/A-New-Method-of-Volume-
Rendering-Applied-to-a-Seis/ART-2011-3-A-new-method-of-volume-rendering-applied-to-a-
seismic-dataset-of-the-Barnett-shale.pdf.aspx
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
17
About the authors
Udayasuryan Kodoly is a storage technology specialist within the IBM Systems and Technology Group
(ISV Enablement) organization. Uday has several years of experience -n designing, architecting storage
solutions and developing solution best practices on various NAS and SAN appliance data-protection
(backup) solutions. Uday is an expert on virtualization technologies and the virtual-machine data
protection strategies. Presently, Uday is working to enable various ISV backup, disaster recovery and
virtualization solutions for IBM SONAS and IBM Storwize V7000 systems.
Billy Robinson is a senior software engineer and technical consultant within the IBM Systems and
Technology Group. Billy has worked extensively with solution providers and IBM customers who develop
and use seismic-processing software. He is proficient at parallelization and optimization of seismic codes
on UNIX® and Linux based clusters and servers. Billy has been working with IBM for 24 years. Prior to
joining IBM, he worked in the petroleum industry for 11 years (with Phillips Petroleum and Standard Oil
Production Company).
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
18
Trademarks and special notices
© Copyright IBM Corporation 2012.
References in this document to IBM products or services do not imply that IBM intends to make them
available in every country.
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business
Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked
terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these
symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information
was published. Such trademarks may also be registered or common law trademarks in other countries. A
current list of IBM trademarks is available on the Web at "Copyright and trademark information at
www.ibm.com/legal/copytrade.shtml.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both.
Other company, product, or service names may be trademarks or service marks of others.
All customer examples described are presented as illustrations of how those customers have used IBM
products and the results they may have achieved. Actual environmental costs and performance
characteristics may vary by customer.
Information concerning non-IBM products was obtained from a supplier of these products, published
announcement material, or other publicly available sources and does not constitute an endorsement of
such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly
available information, including vendor announcements and vendor worldwide homepages. IBM has not
tested these products and cannot confirm the accuracy of performance, capability, or any other claims
related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the
supplier of those products.
All statements regarding IBM future direction and intent are subject to change or withdrawal without
notice, and represent goals and objectives only. Contact your local IBM office or IBM authorized reseller
for the full text of the specific Statement of Direction.
Some information addresses anticipated future capabilities. Such information is not intended as a
definitive statement of a commitment to specific levels of performance, function or delivery schedules with
respect to any future products. Such commitments are only made in IBM product announcements. The
information is presented here to communicate IBM's current investment and development activities as a
good faith effort to help with our customers' future planning.
Photographs shown are of engineering prototypes. Changes may be incorporated in production models.
Any references in this information to non-IBM websites are provided for convenience only and do not in
any manner serve as an endorsement of those websites. The materials at those websites are not part of
the materials for this IBM product and use of those websites is at your own risk.
IBM SONAS and Paradigm Epos 4 integrated seismic processing solution guide
19