US008315981B2

(12) Ulllted States Patent

(10) Patent N0.:

Prahlad et a].

(45) Date of Patent:

(54) DATA MINING SYSTEMS AND METHODS

FOR HETEROGENEOUS DATA SOURCES

4,641,274 A

(75) Inventors: Anand Prahlad, Bangalore (IN); Parag

Gokhale, Marlboro, NJ (US); Rajiv

Kottomtharayil, Marlboro, N] (U S);

OTHER PUBLICATIONS
Luis-Felipe Cabrera, et a1. ADSM: A Multi-Platform, Scalable,
Backup and Archive Mass Storage System, Digest of Papers of the

S u bj ed to any d'156 l a1mer,t

'
h e term 0 f t hi S

Computer Society Computer Conference (Spring) Compeon, US,

patent is extended or adjusted under 35

LosAlamitos, IEEE Comp. Soc.Press, vol. Conf. (Mar. 5, 1995), pp.

U.S.C. 154(b) by 64 days.

420-427.

(21) Appl. N0.: 12/750,009

(Commued)

Primary Examiner * Angelica Ruiz

Flled'

Mar 30 2010

(65)

(74) Attorney, Agent, or Firm * Knobbe Martens Olson &

Prior Publication Data

US 2010/0332453 A1

Bear LLP

Dec. 30, 2010

(57)

_ _
Related Us Apphcatlon Data

31, 2009

Int_ CL
G06F 7/00

data and can further provide utilities for processing the vari
ous data formats. A data structure including ?elds for storing

(200601)
(2006 01)
_

'

both metadata common to the client device data and value

_

(52) US Cl """ " 707/640 707/641 770171/641 _770171//615622

_

_5O1e manages fiat? from Var10115 backup devleess Whlle retaln'

mg such data 1n 1ts nat1ve format. The management console
can display a hierarchical vieW the client devices and/ or their

G06F 17/00

(58)

ABSTRACT

Systems and methods integrate disparate backup devices With

a uni?ed interface. In certain examples, a management con

(60) Provisional application No. 61/165,095, ?led on Mar.

(51)

_ 8/2010

(comlnued)

N] (US)

ang et a .

2004227949

(73) Assignee: CommVault Systems, Inc., Oceanport,

(22)

g?ambersl

21987 Swank

FOREIGN PATENT DOCUMENTS

AU

PaWar, Marlboro, N] (U S)

N ot1ce:
'

15;;

Nov. 20, 2012

(Continued)

Jun Lu, Tinton Falls, NJ (US); Rahul s.

US 8,315,981 B2

added metadata can be used to mine or process the data of the

disparate client devices. The uni?ed single platform and inter

face reduces the need for multiple data management products

Field of Classi?cation Search ............. ..: ...... .. None

and/Or Customized data utilities for each individual Chem

See aPPheanOn ?le for Complete Search hlstory-

device and provides a single pane of glass vieW into data

_
References Clted

management operations. Integrating the various types of stor

age formats and media alloWs a user to retain existing storage
infrastructures and further facilitates scaling to meet long
term management needs.

(56)

U.S. PATENT DOCUMENTS

4,084,231 A
4/1978 CapoZZiet al.
4,267,568 A

17 Claims, 20 Drawing Sheets

5/1981 Dechantet a1.

I040
IIZa

//00
my

CLIENT A

NORMALIZED DATA

STRUCTURE(S)
1040
I/Zb

"750
m2

CLIENT B
MEDIA
DEVICE

MED'A
DEVICE

no
MANAGEMENT
DATABASE

I010
IIZr:

CONNECTOR B

CLIENT C
CONNECTOR c

INFORMATION
MANAGEMENT
CONSOLE
n/
SECONDARY
STORAGE
I08
USER INTERFACE

1/2

CLIENT N

DEVICE

CONNECTOR N

US 8,315,981 B2
Page 2
7,739,459
7,747,579
7,757,043
7,769,961
7,801,864
7,802,067
7,809,914
7,904,428

US. PATENT DOCUMENTS

4,654,819
4,686,620
4,912,637
4,995,035
5,005,122
5,093,912
5,133,065
5,193,154
5,212,772
5,226,157
5,239,647
5,241,668
5,241,670
5,276,860
5,276,867
5,287,500
5,301,286
5,321,816
5,347,653
5,410,700
5,420,996
5,454,099
5,559,991
5,642,496
6,418,478
6,542,972
6,658,436
6,721,767
6,760,723
6,792,466
7,003,641
7,035,880
7,130,970
7,162,496
7,174,433
7,209,972
7,246,207
7,315,923
7,315,924
7,380,072
7,389,311
7,395,282
7,401,154
7,409,509
7,412,518
7,440,982
7,447,692
7,454,569
7,484,054
7,490,207
7,500,053
7,526,202
7,536,291
7,543,125
7,546,323
7,546,324
7,581,077
7,603,386
7,606,844
7,613,748
7,613,752
7,617,253
7,617,262
7,620,710
7,636,743
7,651,593
7,657,550
7,660,807
7,661,028

E>

B2
B2
B2
B1
B2
B1
B2
B2
B2
B1
B2
B2
B2
B2
B1
B1
B2
B2
B1
B2
B2
B2
B2
B2
B1
B2
B1
B2
B1
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2

3/1987
8/1987
3/1990
2/1991
4/1991
3/1992
7/1992
3/1993
5/1993
7/1993
8/1993
8/1993
8/1993
1/1994
1/1994
2/1994
4/1994
6/1994
9/1994
4/1995
5/1995
9/1995
9/1996
6/1997
7/2002
4/2003
12/2003
4/2004
7/2004
9/2004
2/2006
4/2006
10/2006
1/2007
2/2007
4/2007
7/2007
1/2008
1/2008
5/2008
6/2008
7/2008
7/2008
8/2008
8/2008
10/2008
11/2008
11/2008
1/2009
2/2009
3/2009
4/2009
5/2009
6/2009
6/2009
6/2009
8/2009
10/2009
10/2009
11/2009
11/2009
11/2009
11/2009
11/2009
12/2009
1/2010
2/2010
2/2010
2/2010

Stif?er et al.

Ng
Sheedy et a1.
Cole et a1.
Grif?n et al.

Dong et a1.
CheffetZ et a1.

Kitajima et al.
Masters
Nakano et al.

Anglin et al.
Eastridge et al.
Eastridge et al.
Fortier et al.

Kenley et al.

Stoppani, Jr.

Rajani
Rogan et al.
Flynn et al.
Fecteau et al.

Aoyagi
Myers et a1.
Kan?

Ignatius et al.
Ignatius et al.
Oshinsky et al.
De Meno et al.

Oshinsky et al.
Saulpaugh et al.
Prahlad et al.
Crescenti et al.

Devassy et al.
Amarendran et al.

Kottomtharayil et al.
Ignatius et al.
Kottomtharayil et al.
Vij ayan Retnamma et al.
Prahlad et al.

Kottomtharayil et al.
Crescenti et al.
Crescenti et al.

Ignatius et al.
Devassy et al.
Duigou et a1.
Lu

Oshinsky et al.
Kavuri et al.

Kottomtharayil et al.
Amarendran et al.
Kavuri et al.
Ovadia et al.

Vij ayan Retnamma et al.

Gokhale
Timmins et a1.
Prahlad et al.

Ignatius et al.
Amarendran et al.

Kottomtharayil
Brockway et al.
Prahlad et al.
Prahlad et al.
Prahlad et al.

Kottomtharayil et al.
Erofeev
Prahlad et al.
Prahlad et al.
Prahlad et al.
Erofeev

B2

6/2010 Kottomtharayil et a1.

B2
B2

6/2010 Prahlad et a1.

7/2010 Kavuri et a1.

B2

8/2010 Kottomtharayil et a1.

B2
B2

9/2010 Prahlad et a1.

9/2010 Prahlad et a1.

B2
B2

10/2010 Kottomtharayil et a1.

3/2011 Perry et a1.

2002/0174098 A1*

11/2002

2004/0234263 A1
2005/0066118 A1

11/2004 Ovadia et a1.

3/2005 Perry et a1.

2006/0123189 A1*

2006/0242489
2007/ 0143371
2007/0179995
2008/0133624

A1
A1
A1
A1

2008/0228785 A1*

2008/0307000 A1
2009/0019367 A1*

2010/0179940 A1
2010/0332561 A1
2010/0332990 A1

6/2006

10/2006
6/2007
8/2007
6/2008
9/2008

Wu et a1. ......................... .. 707/1

Bitner et a1. ................ .. 711/111

Brockway et a1.
Kottomtharayil
Prahlad et a1.

Phillips et a1.
Kavuri et a1. ............... .. 707/100

12/2008 Paterson et a1.

1/2009

Cavagnari et a1. .......... .. 715/716

7/2010 Gilder et a1.

12/2010 Prahlad et a1.
12/2010 Prahlad et a1.

FOREIGN PATENT DOCUMENTS

CA
DE
DE
EP
EP
EP
EP
EP
EP
EP
EP
EP
EP
EP
EP
GB
GB
GB
GB
GB
IN
IN
IN
JP
JP
MX
W0
W0

2498174
694151157
600209784
0259912
0405926
0467546
0645709
0774715
0809184
541281
0899662
0981090
1204922
1393181
1384135
2410106
2409553
2425199
2435756
2447361
226655
234083
234518
4198050
4267443
254554
W0 9513580
W0 9912098

4/2010
9/1998
6/2005
3/1988
1/1991
1/1992
9/1994
5/1997
11/1997
4/1998
3/1999
2/2000
7/2000
1/2001
7/2010
9/2006
4/2007
8/2007
12/2008
5/2009
12/2008
5/2009
6/2009
10/2008
2/2009
2/2008
5/1995
3/1999

OTHER PUBLICATIONS

Mendel Rosenblum Operating Systems Review (SIGOPS), vol. 25,

No. 5, May 1991, NewYork, US, The Design and Implementation of
a Log-Structured File System, p. 4, paragraph 3.3ip. 5.
IBM Technical Disclosure Bulletin, vol. 24, No. 5, Oct. 1981 New

York, US, pp. 2404-2406, K.L. Huff, Data Set Usage Sequence
Number.

David A. Arneson, Mass Storage Archiving in Network Environ

ments; IEEE; Oct. 31-Nov. 1988; pp. 45-80.

Eitel, Backup and Storage Management in Distributed Hetero gener

ous Environments, IEEE, 1994, pp. 124-126.

International Search Report, PCT/US2010/029267, dated Jan. 6,

2010.

* cited by examiner

US. Patent

Nov. 20, 2012

Sheet 2 0f 20

US 8,315,981 B2

US. Patent

Nov. 20, 2012

Sheet 3 0f 20

US 8,315,981 B2

US. Patent

Nov. 20, 2012

Sheet 4 0f 20

US 8,315,981 B2

\N.MPHEIQAkaMmwgWor|.@52Q;

US. Patent

Nov. 20, 2012

Sheet 5 0f 20

US 8,315,981 B2

US. Patent

Nov. 20, 2012

Sheet 6 0f 20

US 8,315,981 B2

US. Patent

Nov. 20, 2012

Sheet 7 0f 20

US 8,315,981 B2

2%N0I\$QN

US. Patent

Nov. 20, 2012

Sheet 8 0f 20

US 8,315,981 B2

US. Patent

Nov. 20, 2012

Sheet 9 0f 20

US 8,315,981 B2

QT2u%m

US. Patent

Nov. 20, 2012

Sheet 10 0f 20

US 8,315,981 B2

QN%\\

US. Patent

Nov. 20, 2012

[fawgqnm

Z2915M3481H5286:

NS/
,

5%:9:

Amvohz

Sheet 11 0120

[/@%SNRM

@8@E52%3;: 529o6z:

US 8,315,981 B2

US. Patent

Nov. 20, 2012

Sheet 12 0f 20

US 8,315,981 B2

'/400
4.30

EXCHANGE 1
STORAGE GROUP 1
STORAGE GROUP 2

GALAXY 1

TAPE 1
TAPE 2
TAPE 5

VERITAS 1
TAPE 1

TAPE 2

SHAREPOINT

[/61 444

US. Patent

QQ

"20.2:5
28H

@5.@
E.@

Nov. 20, 2012

Sheet 13 0f 20

US 8,315,981 B2

US. Patent

5.:

Nov. 20, 2012

Sheet 15 0120

US 8,315,981 B2

US. Patent

Nov. 20, 2012

Sheet 16 0f 20

US 8,315,981 B2

50%Q\\

2E3o2.n5
x692m2 %.

E.

US. Patent

Nov. 20, 2012

Sheet 18 0120

US 8,315,981 B2

/, 500
RECEIVE CONFIGURATION /_505
INFORMATION FOR CLIENT

DEV|CE(S)

INSTALL DATA CONNECTOR<S>

/.5/

> DATA INGESTION

EXTRACT DATA AND/0R METADATA /5/5

FROM CLIENT DEV|CE(S)

I
STORE EXTRACTED INFORMATION /5Z0
IN DATA STRUCTURE

I :
GENERATE AND STORE VALUE- fjzf
ADDED METADATA

I
PRESENT UNIFIED VIEW OF DATA /550

ON CLIENT DEvIcE(s)

> DATA PREPARATION

MANAGEMENT

RECEIVE INPUT REGARDING DATA /555

MANAGEMENT/MANIPULATION
OPERAT|0N(S)

I
PREPARE DATA FOR REQUESTED /-540
OPERATION

I
PERFORM DATA OPERATION /~545
ON DATA

[/61 5