Beruflich Dokumente
Kultur Dokumente
QualityStage Essentials
(QS320)
Lab Exercises
Contact:
Learning Services
Ascential Software
50 Washington Street
Westboro, MA 01581
1-888-486-9636 x3345
EdServices@AscentialSoftware.com
This document and the software described herein are the property of Ascential Software Corporation
and its licensors and contain confidential trade secrets. All rights to this publication are reserved. No
part of this document may be reproduced, transmitted, transcribed, stored in a retrieval system or
translated into any language, in any form or by any means, without prior permission from Ascential
Software Corporation.
2004 Ascential Software Corporation.
Ascential Software Corporation reserves the right to make changes to this document and the software
described herein at any time without any notice. No warranty is expressed or implied other than any
contained in the terms and conditions of sale.
Ascential Software Corporation
50 Washington Street
Westboro, MA 01581-1021 USA
Phone: (508) 366-3888
Fax: (508) 366-3669
Ascential is a trademark of Ascential Software Corporation Any other product or company names
mentioned are used for identification purposes only, and may be trademarks or service marks of their
respective owners.
May 26, 2004 /V7.0.1
ii
Table of Contents
AUDIENCE............................................................................................................................................................1
PREREQUISITES.................................................................................................................................................1
STRUCTURE OF THIS COURSE......................................................................................................................1
FILE LOCATIONS ..................................................................................................................................................2
MODULE 1: DATA QUALITY............................................................................................................................4
EXERCISE 1-1 COURSE PROJECT.........................................................................................................................4
MODULE 2: INTRODUCTION TO QUALITYSTAGE..................................................................................8
EXERCISE 2-1 CONFIGURING QUALITYSTAGE.....................................................................................................8
MODULE 3: DEVELOPMENT BASICS.........................................................................................................11
EXERCISE 3-1 DEPLOY & RUN..........................................................................................................................11
EXERCISE 3-2 DEFINE A PROJECT.....................................................................................................................13
EXERCISE 3-3 DEFINE A DATA FILE..................................................................................................................14
EXERCISE 3-4 DEFINE DATAFIELD DEFINITIONS...............................................................................................15
EXERCISE 3-5: COPY AUTOHOME DATA FILE AND FIELD DEFINITIONS TO CREATE LIFE DATA FILE AND
FIELD DEFINITIONS............................................................................................................................................16
MODULE 4: INVESTIGATE............................................................................................................................17
EXERCISE 4-1: CHARACTER DISCRETE TYPE C AUTOHOME POLICIES...................................................17
LAB 4-1: CHARACTER DISCRETE TYPE T AUTOHOME POLICIES..............................................................21
EXERCISE 4-2: CHARACTER CONCATENATE INVESTIGATE................................................................................25
LAB 4-2: CHARACTER DISCRETE TYPE C & T LIFE POLICIES.....................................................................28
EXERCISE 4-3: WORD INVESTIGATION - NAME AUTOHOME POLICIES...................................................29
LAB 4-3: WORD INVESTIGATION ADDRESS & AREA AUTOHOME POLICIES...............................................32
MODULE 5: ADDING A UNIQUE KEY..........................................................................................................33
EXERCISE 5-1: TRANSFER STAGE ADD RECORD KEY TO AUTOHOME......................................................33
MODULE 6: STANDARDIZE...........................................................................................................................37
EXERCISE 6-1 COUNTRY STANDARDIZE............................................................................................................37
EXERCISE 6-2: SELECT STAGE: SPLIT US DATA FROM NON-US DATA............................................................40
EXERCISE 6-3: STANDARDIZE: DOMAIN PRE-PROCESSING................................................................................43
EXERCISE 6-4: STANDARDIZE US NAME, ADDRESS AND AREA DATA..............................................................45
EXERCISE 6-5: INVESTIGATE UNHANDLED NAME PATTERNS........................................................................48
LAB 6-6: INVESTIGATE UNHANDLED ADDRESS AND AREA PATTERNS............................................................51
MODULE 7: RULE SET OVERRIDES............................................................................................................52
EXERCISE 7-1: USNAME RULE SET OVERRIDES..............................................................................................52
LAB 7-1: US ADDRESS RULE SET OVERRIDES.................................................................................................59
MODULE 8: MATCHING.................................................................................................................................60
EXERCISE 8-1: UNDUPLICATION MATCH........................................................................................................60
EXERCISE 8-2: CUSTOM MATCH EXTRACT....................................................................................................63
EXERCISE 8-3: IMPROVE MATCH PASS 1: SET CRITICAL VARTYPES.............................................................66
EXERCISE 8-4: SET MATCH CUTOFFS............................................................................................................68
EXERCISE 8-5: MATCH PASS 2.......................................................................................................................69
MODULE 9: SURVIVORSHIP..........................................................................................................................70
EXERCISE 9-1: SURVIVE BEST OF BREED CUSTOMER RECORD.................................................................70
iii
iv
Course Introduction
Audience
Ascential Software customers currently using or preparing to use QualityStage or
starting data quality and data integration initiatives.
Prerequisites
This course is intended for system/data analysts, developers, and business analysts
working or beginning work on a data integration project. Familiarity with Windows,
the operating system (OS) running QualityStage Server, and a text editor are
required.
Course Introduction
File Locations
In this course the QualityStage Designer and Server are installed locally on your PC.
QualityStage uses the master projects directory to store project libraries and the
results of jobs that you execute. The location of the master projects directory is on
the server. In this course, the location of the Master Projects directory is
C:\Projects.
Note: The sub-folder projectname under the Master Projects directory refers
to the project that you are currently working on in QualityStage. You may
have multiple projects and, consequently, will have multiple project subfolders under the Master Projects directory
PATH
USAGE
CONTENTS
C:\ASCENTIAL\Q UALITYSTAGEDESIGNER70
C:\ ASCENTIAL\QUALITYSTAGEDESIGNER\DOCUMENTATION
The Documentation
folder contains all of
the user guides for this
version of
QualityStage. The
User Guide can be
accessed at anytime
through F1, the help
function.
C:\PROJECTS\PROJECTNAME\DATA
Course Introduction
PATH
USAGE
CONTENTS
C:\PROJECTS\PROJECTNAME\SCRIPTS
C:\PROJECTS\projectname\LOGS
Error Logs
Run Logs
C:\PROJECTS\projectname\CONTROLS
Scripts run
Match Reports
.MAT files
WINN has already identified some data quality issues within their existing systems. In
addition, they have identified several requirements for establishing their Customer
Information (CIF) system. These issues are a serious concern of the management and they
would like to see a comprehensive plan for addressing these problems and requirements.
US records should be split from international address records
There is customer name and address information spread across free-form text fields.
They would like to see this organized into specified fields.
They want to match records across all sources
They have inconsistent naming conventions across their systems. They would like to see
the name fields separate rather than in freeform text fields.
They need to standardize their address formats.
Existing Systems
Source System
Description
AUTOHOME
LIFE
LOB/Operational Function
Policy Maintenance
Policy Maintenance
10
When completing a run profile for a remote server you will need the
following information:
1. Host name or IP address of the host where the QualityStage server is
installed.
2. Directory location of QualityStage server executables.
3. Name and location of the master projects directory on the server.
4. Login ID and password for the host where the QualityStage server is
installed.
5. Port that the QualityStage server is using (this port is chosen when you
start the QualityStage server). When running locally on your PC, you do
not need to start the QualityStage server.
6. Local location for QualityStage temporary report files.
Please refer to the appropriate Server User Guide for additional details.
Alternate Locale: If you are processing data files that contain information in a
language that is different from the server you are running on, you can use the
Alternate Locale field for pointing to location with the correct parameters.
11
8. Click OK
TO
END button
9. Open Windows Explorer and locate the project folders (libraries) under
the Master Projects Directory
WINNCRM
AUTOHOME
DEFAULT
Description
Source System ID
Policy Number
Full Name
Address 1
Address 2
City Name
State
Zip Code
Federal ID
Date of Birth
Date of Death
DataType
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
UseType
S
S
S
S
S
S
S
S
S
S
S
Missing
S
S
S
S
S
S
S
S
S
S
S
Start
1
2
14
60
95
130
165
170
180
190
198
End Length
1
1
13
12
59
46
94
35
129
35
164
35
169
5
179
10
189
10
197
8
205
8
4. Select APPLY after completing each field definition and a new definition
screen will pop-up
5. After defining the last field select OK
Exercise 3-5: Copy AUTOHOME Data File and Field Definitions to Create LIFE
Data File and Field Definitions
Goal: Practice copying data files and fields
Lab information:
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
Name: IAHSDC
Description: Char Disc C All Single Domain fields
Options: Character Discrete
Data File: AUTOHOME
6. Click NEXT
7. Select the fields, one at a time
Choose ADD TO SELECT FIELDS
OR
CLICK AND DRAG the field to the SELECT FIELDS BOX
8. The Field Mask Selection screen will pop-up
9. Choose the ALL C BUTTON
10. Click OK
Module 4: Investigate
SINGLE
16. Select OK
17. Expand the JOBS folder
18. On the right pane select the stage and drag it into the job
Task 2: Run the Job
Exercise steps:
1. Select the job to verify that the stage was moved into the job
2. Click the Run button on the toolbar
3. From the Job Run Options screen
Check DEPLOY
Uncheck RUN
Choose EXECUTE FILE MODE
On the FILE MODE EXECUTION SCREEN Choose RUN FROM START TO END
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
SINGLE
DOMAIN
Module 4: Investigate
16. Select OK
17. Expand the JOBS folder
18. On the right pane select the stage and drag it into the job
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
6. Click NEXT
7. Select the fields, one at a time
Choose ADD TO SELECT FIELDS
OR
CLICK AND DRAG the field to the SELECT FIELDS BOX
8. The Field Mask Selection screen will pop-up
9. Choose the ALL C BUTTON
10. Click OK
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
Module 4: Investigate
6. On the left pane, select the new COMBINED file to display the field definitions
on the right pane
7. On the right pane, right-click and choose NEW FIELD
8. Complete the NEW DATAFIELD screen as follows:
Name: RECKEY
Start position: 1
Length: 12
Description: UNIQUE RECORD KEY
Check the SHIFT ALL SUBSEQUENT FIELDS BOX
Click APPLY
9. Add the FILEID field
Name: FILEID
Start position: 1
Length: 2
Description: SOURCE FILE IDENTIFIER
Click APPLY
10. Add the Recnum field
Name: RECNUM
Start position: 3
Length: 9
Description: SEQUENTIAL RECORD NUMBER
Click OK
Task 2: Build Transfer Stage and Design Job
Exercise steps:
1. Define a Transfer Stage and name it AHKEY
Data File: AUTOHOME
Results File: COMBINE
6. Choose FINISH
7. Design Job named: ADDKEY
8. Add the AHKEY stage to the ADDKEY Job
Task 3: Run the Job
Task 4: Review results
Task 5: Repeat steps 1-8 for the LIFE file (be sure to check Append to File)
Module 6: Standardize
Module 6: Standardize
Exercise 6-1 Country Standardize
Goal: Assign a two byte ISO Country code the records so that we can then split
the US Data from the NON US Data
Exercise Information:
The Standardize stage reads in one input file and writes out one output
file
The output file must be defined in the QualityStage Designer. No output
fields need to be defined. The dictionary file of the rule set will populate
the output field definitions
Define the output file and name it CNTRYOUT
Standardize stages can be added to Jobs with other stages (except
Investigate)
Name the Standardize Country stage: CNTRYSTN
Name the Job: STAN
Tasks:
1. Define the output file
2. Define the Stage
3. Design the Job
4. Add the CNTRYSTN Stage to the STAN Job
5. Run the Job
6. Review Results
Task 1: Define the Output File
Exercise steps:
1. Create a Datafile Definition for the file: CNTRYOUT
Task 2: Define the Stage
Exercise steps:
1. Create a new Standardize stage named: CNTRYSTN
Data File: COMBINE
Results File: CNTRYOUT
Options: APPEND ALL
Default Output format: UPPERCASE ALL
41
Module 6: Standardize
NEXT
Choose the rule set COUNTRY
In THE LITERAL BOX type in the meta data label for US: ZQUSZQ
Click the ARROW BOX to add the meta data label to the STANDARD FIELDS
box
Add the fields below to the STANDARDS FIELDS box:
A. Address1
B. Address2
C. City
D. State
E. Zip
Choose ADD RULE
42
Module 6: Standardize
ChoosE FINISH
Task 3: Run the Job
Task 4: Review results
43
Module 6: Standardize
44
Module 6: Standardize
NEXT
Choose the field to split the data, the two byte ISO country code:
CCCOUNT
NEXT
Enter the value, US, to select the records with an ISO country CODE OF
US and reject the records that do not have US as their ISO country code
FINISH
Add the SPLIT stage to the STAN Job
45
Module 6: Standardize
International Data
46
Module 6: Standardize
47
Module 6: Standardize
48
Module 6: Standardize
Module 6: Standardize
ChoosE FINISH
5. Add the stage to the Job: STAN
50
Module 6: Standardize
51
Module 6: Standardize
52
Module 6: Standardize
9. Choose OK
10. Choose FINISH
53
Module 6: Standardize
54
Module 6: Standardize
UNHANDLED ADDRESS
and
Exercise Information:
The Investigate stage output files are reports
Reports are pre-formatted text files and do not require a file definition in
QualityStage
Investigate stages must be the only stage within a job
Advanced settings:
Increase the sample size to 5
Leave the frequency set to 1
Name the Investigate stage: INUPADDR (Investigate unhandled address
and area patterns)
Name the job the same as the stage
55
This pattern +FI represents unclassified last name (standard rule set approach),
a first name, followed by a middle initial
56
Unhandled
Pattern
+FI
+FI
+FI
+FI
+FI
Unhandled Data
Input
Pattern
DAMORA WILLIAM H
PEPE NANCY J
KOPPLIN ELDEN E
KRATOCHWILL TOMAS R
LEININGER SALLY P
+FI
+FI
+FI
+FI
+FI
DAMORA WILLIAM H
PEPE NANCY J
KOPPLIN ELDEN E
KRATOCHWILL TOMAS R
LEININGER SALLY P
Original Value
No Leading Space
6. Repeat the process for the remaining tokens using the following settings
F TOKEN
Dictionary Field: FN-FIRST NAME
Move Current
Original Value
Leading Space
I TOKEN
Dictionary Fields: MN-MIDDLE NAME
Move Current
Original Value
Leading Space
7. Under Override Summary choose ADD
8. Select APPLY, then OK
Task 3: Test the Override Using the Standardization Rules Analyzer
1. From the QualityStage main menu choose Rules from the menu bar, and then
choose STANDARDIZATION RULES ANALYZER. Then select the rule set
USNAME.
2. Enter the text string from the first record listed in the Investigate Unhandled
Pattern report
3. Select TEST THIS STRING
58
4. See how the pattern is now correctly processed by the rule set
5. Test all the names for this pattern
6. Select EXIT
UNHANDLED PATTERN +,+
This pattern +,+ represents unclassified last name (standard rule set approach),
a comma, and an unclassified first name
The first name values appear to not be classified as first names. One approach
would be to review the first names for addition to the classification table
You may also want to check the report IAHNMN.DLT to check the frequency of
the data value, the more often it occurs the more likely we are to classify that
word
Unhandled
Pattern
+,+
+,+
+,+
+,+
+,+
Unhandled Data
Input
Pattern
HOCHREITER, CAROLYNNE
HAYWARD, WINSLOW
ESHAGHIAN, JOUBIN
SODIA, MARVYN
SAKURAZAWA, HARUKO
+,+
+,+
+,+
+,+
+,+
HOCHREITER, CAROLYNNE
HAYWARD, WINSLOW
ESHAGHIAN, JOUBIN
SODIA, MARVYN
SAKURAZAWA, HARUKO
59
1. From the QualityStage main menu select Rules from the menu bar, then
choose STANDARDIZATION OVERRIDES. Select the USNAME rule set.
2. Select the CLASSIFICATION tab
This pattern FFI represents a last name that was recognized as a first name, a
classified first name and an initial. Notice this data does not include a comma
providing context to the first and last name tokens
In this case the input pattern for all the sample records is not the same as the
unhandled pattern. There are 2 distinct input patterns and one distinct unhandled
pattern
60
Applying the override to the unhandled pattern will allow us to add one override.
If we had chosen the input pattern override then we would need to add an
override for each pattern.
This is an indication that the pattern did not match any patterns in the pattern
action file and an UNHANDLED PATTERN OVERRIDE would cause this pattern to be
processed
Unhandled
Pattern
FFI
FFI
FFI
FFI
FFI
Unhandled Data
Input
Pattern
HARRIS MARJORIE M
ROSS JOSEPH P
YOUNG THERESA C
OLIVA LAWRENCE M
LANG LEE B
+FI.
+FI
+FI.
+FI
+FI
HARRIS MARJORIE M.
ROSS JOSEPH P
YOUNG THERESA C.
OLIVA LAWRENCE M
LANG LEE B
62
Tasks:
1. Review Investigate results of Unhandled Address Patterns
2. Add User Override
3. Use Standardization Rules Analyzer to test the override
4. Apply all overrides
5. Re-run STAN job to apply the overrides to the results file
6. Review Results
63
Module 8: Matching
Module 8: Matching
64
Module 8: Matching
DESCRIPTION
START
LENGTH
SHIFT
SUBSEQUENT
FIELDS
TEMP
22
SETID
TYPE
11
PASS
13
WEIGHT
15
Module 8: Matching
Name: MATCH
Options: UNDUP
2. SELECT CUSTOM
2. Choose ADD to add Pass Number 1
Description: P1 NAME & STREET ADDRESS
B.
C.
D.
Length: 3
ADD
4. Click NEXT
66
Module 8: Matching
DESCRIPTION
TYPE OF
COMPARISON
GCUSNAM
Gender Code
CHAR
MNUSNAM
48
Middle Name
CHAR
MFUSNAM
203
NAME_UNCERT
800
LNUSNAM
73
Primary Name
UNCERT
800
HNUSADD
607
House Number
CHAR
HSUSADD
617
House Suffix
CHAR
PDUSADD
627
Pre-direction
CHAR
SNUSADD
650
Street name
UNCERT
800
SDUSADD
685
Suffix Directional
CHAR
RVUSADD
691
CHAR
BVUSADD
708
Box Value
CHAR
BNUSADD
763
Building Name
UNCERT
800
ZCUSARE
1055
Zip code
CNT_DIFF
FEDID
2040
Federal ID
CNT_DIFF
FIELD
PARAMETERS
6. Click OK
67
Module 8: Matching
68
Module 8: Matching
ARGUMENT
LITERAL/VARIABLE
MOVE
Variable
@SET9
MOVE
Literal
MOVE
Variable
@TYPE
MOVE
Variable
@PASS
MOVE
Literal
MOVE
Variable
@WGT
MOVE
Literal
MOVEALL
Of A
69
Module 8: Matching
9. Choose OK
10. Choose RUN FROM START
TO
END
70
Module 8: Matching
71
Module 8: Matching
TO
END
72
Module 8: Matching
MATCH: 25
CLERICAL: 25
6. Click OK
7. RUN the Match job
Task 2: Review Results
1. Locate the UNDUP output file
73
Module 8: Matching
74
Module 9: Survivorship
Module 9: Survivorship
EXERCISE 9-1: Survive Best of Breed Customer Record
Goal: Survive one customer record for load into Winns new CRM system
Tasks:
1. Add field overlay definitions to the input file ( UNDUP)
2. Copy UNDUP Datafile Definition to SURVOUT
3. Define Survive stage
4. Run Survive job and review results
Task 1: Add Field Overlay Definitions to the Input File (UNDUP)
1. On the left pane select the UNDUP DATAFILE DEFINITION folder, on the right
pane right-click, choose NEW FIELD
2. Add the following fields:
FIELD NAME
DESCRIPTION
START
LENGTH
SURVREC
Fields to Survive
1270
NAMEC
25
150
ADDRC
629
236
AREAC
1044
44
2. Click NEXT
3. From the QUALITYSTAGE SURVIVE WIZARD, choose the SETID field
4. Click NEXT
75
Module 9: Survivorship
ANALYZE FIELD
TECHNIQUE
DATA
SURVREC
TYPE
EQUALS
XA
NAMEC
NAMEC
ADDRC
ADDRC
AREAC
AREAC
SURVREC
TYPE
EQUALS
RA
6. Click EXIT
Task 4: Add Stage to Job, Run & Review Results
1. Define the SURVIVE job
2. Add the SURVIVE stage to the SURVIVE job
3. RUN the SURVIVE job
Task 5: Review Results
76
77
Description
Auto and Home Policies
Data with Appended ISO Country Code
Auto and Home Policies
Records with International Address Data
Life Policies
Pre-processed US Data
Standardized Name
Identify duplicate records
Records with USDATA for further
process
Survived Best of Breed Customer
Records
Description
Source System
ID
Policy Number
Full Name
Address 1
Address 2
City Name
State
Abbreviation
Zip Code
Federal ID
Date of Birth
Date of Death
DataType
UseTyp
e
Missin
g
Star
t
En
d
Lengt
h
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
S
S
S
S
S
S
S
S
S
S
S
S
1
2
14
60
95
130
0
0
0
0
0
0
1
12
46
35
35
35
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
ALPHANUM
S
S
S
S
S
S
S
S
S
S
165
170
180
190
198
0
0
0
0
0
5
10
10
8
8
78
Description
DataType
UseTyp
e
Missin
g
Star
t
En
d
Lengt
h
SYSSRC
Source System ID
ALPHANUM
POLNUMB
Policy Number
ALPHANUM
NAME
Full Name
ALPHANUM
12
14
ADDR1
Address 1
ALPHANUM
46
60
ADDR2
Address 2
35
ALPHANUM
95
CITY
35
City Name
ALPHANUM
130
35
STATE
State
ALPHANUM
165
ZIPCODE
Zip Code
ALPHANUM
170
10
FEDID
Federal ID
ALPHANUM
180
10
DOB
Date of Birth
ALPHANUM
190
DOD
Date of Death
ALPHANUM
198
Description
DataType
UseType
Missin
g
Star
t
En
d
Lengt
h
RECKEY
ALPHANUM
12
FILEID
ALPHANUM
RECNUM
SYSSRC
Source System ID
ALPHANUM
ALPHANUM
13
POLNUMB
NAME
Policy Number
ALPHANUM
14
12
Full Name
ALPHANUM
26
46
ADDR1
Address 1
ALPHANUM
72
35
ADDR2
Address 2
ALPHANUM
107
35
CITY
City Name
ALPHANUM
142
35
STATE
State Abbreviation
ALPHANUM
177
ZIP
Zip Code
ALPHANUM
182
10
FEDID
Federal ID
ALPHANUM
192
10
DOB
Date of Birth
ALPHANUM
202
DOD
Date of Death
ALPHANUM
210
79
Description
DataType
UseTyp
e
Missin
g
Star
t
En
d
Lengt
h
CCCOUNT
ISOCountryCode
ALPHANUM
IFCOUNT
IdentifierFlag
ALPHANUM
RECKEY
ALPHANUM
12
FILEID
RECNUM
ALPHANUM
ALPHANUM
SYSSRC
Source System ID
ALPHANUM
18
POLNUMB
Policy Number
ALPHANUM
19
12
NAME
Full Name
ALPHANUM
31
46
ADDR1
Address 1
ALPHANUM
77
35
ADDR2
Address 2
ALPHANUM
112
35
CITY
City Name
ALPHANUM
147
35
STATE
State Abbreviation
ALPHANUM
182
ZIP
Zip Code
ALPHANUM
187
10
FEDID
Federal ID
ALPHANUM
197
10
DOB
Date of Birth
ALPHANUM
207
DOD
Date of Death
ALPHANUM
215
Star
t
En
d
Lengt
h
3
Description
DataType
UseTyp
e
Missin
g
CCCOUNT
ISOCountryCode
ALPHANUM
IFCOUNT
IdentifierFlag
ALPHANUM
RECKEY
ALPHANUM
12
FILEID
ALPHANUM
RECNUM
ALPHANUM
SYSSRC
Source System ID
ALPHANUM
18
POLNUMB
Policy Number
ALPHANUM
19
12
NAME
Full Name
ALPHANUM
31
46
ADDR1
Address 1
ALPHANUM
77
35
ADDR2
Address 2
ALPHANUM
112
35
CITY
City Name
ALPHANUM
147
35
STATE
State Abbreviation
ALPHANUM
182
ZIP
Zip Code
ALPHANUM
187
10
FEDID
Federal ID
ALPHANUM
197
10
DOB
Date of Birth
ALPHANUM
207
DOD
Date of Death
ALPHANUM
215
80
Description
DataType
UseTyp
e
Missin
g
Star
t
En
d
Lengt
h
NAUSPRE
NameDomain
ALPHANUM
100
ADUSPRE
AddressDomain
ALPHANUM
ARUSPRE
AreaDomain
ALPHANUM
101
100
201
P1USPRE
Field1Pattern
100
ALPHANUM
301
P2USPRE
20
Field2Pattern
ALPHANUM
321
20
P3USPRE
Field3Pattern
ALPHANUM
341
20
P4USPRE
Field4Pattern
ALPHANUM
361
20
P5USPRE
Field5Pattern
ALPHANUM
381
20
P6USPRE
Field6Pattern
ALPHANUM
401
20
IPUSPRE
InputPattern
ALPHANUM
421
88
OPUSPRE
OutboundPattern
ALPHANUM
509
88
UOUSPRE
UserOverrideFlag
ALPHANUM
597
CFUSPRE
CustomFlag
ALPHANUM
599
CCCOUNT
ISOCountryCode
ALPHANUM
601
IFCOUNT
IdentifierFlag
ALPHANUM
604
RECKEY
ALPHANUM
606
12
FILEID
ALPHANUM
606
RECNUM
ALPHANUM
608
SYSSRC
Source System ID
ALPHANUM
618
POLNUMB
Policy Number
ALPHANUM
619
12
NAME
Full Name
ALPHANUM
631
46
ADDR1
Address 1
ALPHANUM
677
35
ADDR2
Address 2
ALPHANUM
712
35
CITY
City Name
ALPHANUM
747
35
STATE
State Abbreviation
ALPHANUM
782
ZIP
Zip Code
ALPHANUM
787
10
FEDID
Federal ID
ALPHANUM
797
10
DOB
Date of Birth
ALPHANUM
807
DOD
Date of Death
ALPHANUM
815
81
Description
DataType
UseTyp
e
Missin
g
Star
t
En
d
Lengt
h
NTUSNAM
NameType
ALPHANUM
GCUSNAM
GenderCode
ALPHANUM
NPUSNAM
NamePrefix
ALPHANUM
20
FNUSNAM
FirstName
MNUSNAM
MiddleName
ALPHANUM
23
25
ALPHANUM
48
LNUSNAM
25
PrimaryName
ALPHANUM
73
50
NGUSNAM
NameGeneration
ALPHANUM
123
10
NSUSNAM
NameSuffix
ALPHANUM
133
20
ANUSNAM
AdditionalNameInformation
ALPHANUM
153
50
MFUSNAM
MatchFirstName
ALPHANUM
203
25
NFUSNAM
NYSIISofMatchFirstName
ALPHANUM
228
SFUSNAM
RSoundexofMatchFirstName
ALPHANUM
236
MLUSNAM
MatchPrimaryName
ALPHANUM
240
50
HKUSNAM
HashKeyofMatchPrimaryName
ALPHANUM
290
10
PKUSNAM
PackedKeyofMatchPrimaryName
ALPHANUM
300
20
NWUSNAM
NumberofMatchPrimaryWords
ALPHANUM
320
W1USNAM
MatchPrimaryWord1
ALPHANUM
321
15
W2USNAM
MatchPrimaryWord2
ALPHANUM
336
15
W3USNAM
MatchPrimaryWord3
ALPHANUM
351
15
W4USNAM
MatchPrimaryWord4
ALPHANUM
366
15
W5USNAM
MatchPrimaryWord5
ALPHANUM
381
15
N1USNAM
NYSIISofMatchPrimaryWord1
ALPHANUM
396
S1USNAM
RSoundexofMatchPrimaryWord1
ALPHANUM
404
N2USNAM
NYSIISofMatchPrimaryWord2
ALPHANUM
408
S2USNAM
RSoundexofMatchPrimaryWord2
ALPHANUM
416
UPUSNAM
UnhandledPattern
ALPHANUM
420
30
UDUSNAM
UnhandledData
ALPHANUM
450
100
IPUSNAM
InputPattern
ALPHANUM
550
30
EDUSNAM
ExceptionData
ALPHANUM
580
25
UOUSNAM
UserOverrideFlag
ALPHANUM
605
HNUSADD
HouseNumber
ALPHANUM
607
10
HSUSADD
HouseNumberSuffix
ALPHANUM
617
10
PDUSADD
StreetPrefixDirectional
ALPHANUM
627
PTUSADD
StreetPrefixType
ALPHANUM
630
20
SNUSADD
StreetName
ALPHANUM
650
25
STUSADD
StreetSuffixType
ALPHANUM
675
SQUSADD
StreetSuffixQualifier
ALPHANUM
680
SDUSADD
StreetSuffixDirectional
ALPHANUM
685
RTUSADD
RuralRouteType
ALPHANUM
688
RVUSADD
RuralRouteValue
ALPHANUM
691
10
BTUSADD
BoxType
ALPHANUM
701
BVUSADD
BoxValue
ALPHANUM
708
10
FTUSADD
FloorType
ALPHANUM
718
FVUSADD
FloorValue
ALPHANUM
723
10
UTUSADD
UnitType
ALPHANUM
733
UVUSADD
UnitValue
ALPHANUM
738
10
82
MTUSADD
MultiUnitType
ALPHANUM
748
MVUSADD
MultiUnitValue
ALPHANUM
753
10
BNUSADD
BuildingName
ALPHANUM
763
30
AAUSADD
AdditionalAddressInformation
ALPHANUM
793
50
ATUSADD
AddressType
ALPHANUM
843
NSUSADD
NYSIISofStreetName
ALPHANUM
844
SSUSADD
ReverseSoundexofStreetName
ALPHANUM
852
UPUSADD
UnhandledPattern
ALPHANUM
856
30
UDUSADD
UnhandledData
ALPHANUM
886
50
IPUSADD
InputPattern
ALPHANUM
936
30
EDUSADD
ExceptionData
ALPHANUM
966
50
UOUSADD
UserOverrideFlag
ALPHANUM
1016
CNUSARE
CityName
ALPHANUM
1022
30
SAUSARE
StateAbbreviation
ALPHANUM
1052
ZCUSARE
ZipCode
ALPHANUM
1055
ZIP3
ALPHANUM
1055
Z4USARE
Zip4AddonCode
ALPHANUM
1060
CCUSARE
CountryCode
ALPHANUM
1064
NCUSARE
CityNYSIIS
ALPHANUM
1066
SCUSARE
CityReverseSoundex
ALPHANUM
1074
UPUSARE
UnhandledPattern
ALPHANUM
1078
30
UDUSARE
UnhandledData
ALPHANUM
1108
50
IPUSARE
InputPattern
ALPHANUM
1158
30
EDUSARE
ExceptionData
ALPHANUM
1188
50
UOUSARE
UserOverrideFlag
ALPHANUM
1238
NAUSPRE
NameDomain
ALPHANUM
1244
100
ADUSPRE
AddressDomain
ALPHANUM
1344
100
ARUSPRE
AreaDomain
ALPHANUM
1444
100
P1USPRE
Field1Pattern
ALPHANUM
1544
20
P2USPRE
Field2Pattern
ALPHANUM
1564
20
P3USPRE
Field3Pattern
ALPHANUM
1584
20
P4USPRE
Field4Pattern
ALPHANUM
1604
20
P5USPRE
Field5Pattern
ALPHANUM
1624
20
P6USPRE
Field6Pattern
ALPHANUM
1644
20
IPUSPRE
InputPattern
ALPHANUM
1664
88
OPUSPRE
OutboundPattern
ALPHANUM
1752
88
UOUSPRE
UserOverrideFlag
ALPHANUM
1840
CFUSPRE
CustomFlag
ALPHANUM
1842
CCCOUNT
ISOCountryCode
ALPHANUM
1844
IFCOUNT
IdentifierFlag
ALPHANUM
1847
RECKEY
ALPHANUM
1849
12
FILEID
ALPHANUM
1849
RECNUM
ALPHANUM
1851
SYSSRC
Source System ID
ALPHANUM
1861
POLNUMB
Policy Number
ALPHANUM
1862
12
NAME
Full Name
ALPHANUM
1874
46
ADDR1
Address 1
ALPHANUM
1920
35
ADDR2
Address 2
ALPHANUM
1955
35
CITY
City Name
ALPHANUM
1990
35
STATE
State Abbreviation
ALPHANUM
2025
ZIP
Zip Code
ALPHANUM
2030
10
FEDID
Federal ID
ALPHANUM
2040
10
83
DOB
Date of Birth
ALPHANUM
2050
DOD
Date of Death
ALPHANUM
2058
84
Description
DataType
UseTyp
e
Missin
g
Start
En
d
Lengt
h
TEMP
ALPHANUM
22
SETID
ALPHANUM
SURVREC
ALPHANUM
1270
PASS
TYPE
WEIGHT
ALPHANUM
11
ALPHANUM
13
NTUSNAM
NameType
ALPHANUM
15
ALPHANUM
23
GCUSNAM
GenderCode
ALPHANUM
24
NPUSNAM
NamePrefix
ALPHANUM
25
20
NAMEC
ALPHANUM
25
150
FNUSNAM
FirstName
ALPHANUM
45
25
MNUSNAM
MiddleName
ALPHANUM
70
25
LNUSNAM
PrimaryName
ALPHANUM
95
50
NGUSNAM
NameGeneration
ALPHANUM
145
10
NSUSNAM
NameSuffix
ALPHANUM
155
20
ANUSNAM
AdditionalNameInformation
ALPHANUM
175
50
MFUSNAM
MatchFirstName
ALPHANUM
225
25
NFUSNAM
NYSIISofMatchFirstName
ALPHANUM
250
SFUSNAM
RSoundexofMatchFirstName
ALPHANUM
258
MLUSNAM
MatchPrimaryName
ALPHANUM
262
50
HKUSNAM
HashKeyofMatchPrimaryName
ALPHANUM
312
10
PKUSNAM
PackedKeyofMatchPrimaryName
ALPHANUM
322
20
NWUSNAM
NumberofMatchPrimaryWords
ALPHANUM
342
W1USNAM
MatchPrimaryWord1
ALPHANUM
343
15
W2USNAM
MatchPrimaryWord2
ALPHANUM
358
15
W3USNAM
MatchPrimaryWord3
ALPHANUM
373
15
W4USNAM
MatchPrimaryWord4
ALPHANUM
388
15
W5USNAM
MatchPrimaryWord5
ALPHANUM
403
15
N1USNAM
NYSIISofMatchPrimaryWord1
ALPHANUM
418
S1USNAM
RSoundexofMatchPrimaryWord1
ALPHANUM
426
N2USNAM
NYSIISofMatchPrimaryWord2
ALPHANUM
430
S2USNAM
RSoundexofMatchPrimaryWord2
ALPHANUM
438
UPUSNAM
UnhandledPattern
ALPHANUM
442
30
UDUSNAM
UnhandledData
ALPHANUM
472
100
IPUSNAM
InputPattern
ALPHANUM
572
30
EDUSNAM
ExceptionData
ALPHANUM
602
25
UOUSNAM
UserOverrideFlag
ALPHANUM
627
HNUSADD
HouseNumber
ALPHANUM
629
10
ADDRC
ALPHANUM
629
236
HSUSADD
HouseNumberSuffix
ALPHANUM
639
10
PDUSADD
StreetPrefixDirectional
ALPHANUM
649
PTUSADD
StreetPrefixType
ALPHANUM
652
20
SNUSADD
StreetName
ALPHANUM
672
25
STUSADD
StreetSuffixType
ALPHANUM
697
SQUSADD
StreetSuffixQualifier
ALPHANUM
702
SDUSADD
StreetSuffixDirectional
ALPHANUM
707
85
RTUSADD
RuralRouteType
ALPHANUM
710
RVUSADD
RuralRouteValue
ALPHANUM
713
10
BTUSADD
BoxType
ALPHANUM
723
BVUSADD
BoxValue
ALPHANUM
730
10
FTUSADD
FloorType
ALPHANUM
740
FVUSADD
FloorValue
ALPHANUM
745
10
UTUSADD
UnitType
ALPHANUM
755
UVUSADD
UnitValue
ALPHANUM
760
10
MTUSADD
MultiUnitType
ALPHANUM
770
MVUSADD
MultiUnitValue
ALPHANUM
775
10
BNUSADD
BuildingName
ALPHANUM
785
30
AAUSADD
AdditionalAddressInformation
ALPHANUM
815
50
ATUSADD
AddressType
ALPHANUM
865
NSUSADD
NYSIISofStreetName
ALPHANUM
866
SSUSADD
ReverseSoundexofStreetName
ALPHANUM
874
UPUSADD
UnhandledPattern
ALPHANUM
878
30
UDUSADD
UnhandledData
ALPHANUM
908
50
IPUSADD
InputPattern
ALPHANUM
958
30
EDUSADD
ExceptionData
ALPHANUM
988
50
UOUSADD
UserOverrideFlag
ALPHANUM
1038
CNUSARE
CityName
ALPHANUM
1044
30
AREAC
ALPHANUM
1044
44
SAUSARE
StateAbbreviation
ALPHANUM
1074
ZCUSARE
ZipCode
ALPHANUM
1077
Z4USARE
Zip4AddonCode
ALPHANUM
1082
CCUSARE
CountryCode
ALPHANUM
1086
NCUSARE
CityNYSIIS
ALPHANUM
1088
SCUSARE
CityReverseSoundex
ALPHANUM
1096
UPUSARE
UnhandledPattern
ALPHANUM
1100
30
UDUSARE
UnhandledData
ALPHANUM
1130
50
IPUSARE
InputPattern
ALPHANUM
1180
30
EDUSARE
ExceptionData
ALPHANUM
1210
50
UOUSARE
UserOverrideFlag
ALPHANUM
1260
NAUSPRE
NameDomain
ALPHANUM
1266
100
ADUSPRE
AddressDomain
ALPHANUM
1366
100
ARUSPRE
AreaDomain
ALPHANUM
1466
100
P1USPRE
Field1Pattern
ALPHANUM
1566
20
P2USPRE
Field2Pattern
ALPHANUM
1586
20
P3USPRE
Field3Pattern
ALPHANUM
1606
20
P4USPRE
Field4Pattern
ALPHANUM
1626
20
P5USPRE
Field5Pattern
ALPHANUM
1646
20
P6USPRE
Field6Pattern
ALPHANUM
1666
20
IPUSPRE
InputPattern
ALPHANUM
1686
88
OPUSPRE
OutboundPattern
ALPHANUM
1774
88
UOUSPRE
UserOverrideFlag
ALPHANUM
1862
CFUSPRE
CustomFlag
ALPHANUM
1864
CCCOUNT
ISOCountryCode
ALPHANUM
1866
IFCOUNT
IdentifierFlag
ALPHANUM
1869
RECKEY
ALPHANUM
1871
12
FILEID
ALPHANUM
1871
RECNUM
ALPHANUM
1873
SYSSRC
Source System ID
ALPHANUM
1883
86
POLNUMB
Policy Number
ALPHANUM
1884
12
NAME
Full Name
ALPHANUM
1896
46
ADDR1
Address 1
ALPHANUM
1942
35
ADDR2
Address 2
ALPHANUM
1977
35
CITY
City Name
ALPHANUM
2012
35
STATE
State Abbreviation
ALPHANUM
2047
ZIP
Zip Code
ALPHANUM
2052
10
FEDID
Federal ID
ALPHANUM
2062
10
DOB
Date of Birth
ALPHANUM
2072
DOD
Date of Death
ALPHANUM
2080
87
Description
DataType
UseTyp
e
Missin
g
Star
t
End
Lengt
h
TEMP
ALPHANUM
22
SETID
ALPHANUM
SURVREC
ALPHANUM
1270
PASS
TYPE
WEIGHT
ALPHANUM
11
ALPHANUM
13
NTUSNAM
NameType
ALPHANUM
15
ALPHANUM
23
GCUSNAM
GenderCode
ALPHANUM
24
NPUSNAM
NamePrefix
ALPHANUM
25
20
NAMEC
ALPHANUM
25
150
FNUSNAM
FirstName
ALPHANUM
45
25
MNUSNAM
MiddleName
ALPHANUM
70
25
LNUSNAM
PrimaryName
ALPHANUM
95
50
NGUSNAM
NameGeneration
ALPHANUM
145
10
NSUSNAM
NameSuffix
ALPHANUM
155
20
ANUSNAM
AdditionalNameInformation
ALPHANUM
175
50
MFUSNAM
MatchFirstName
ALPHANUM
225
25
NFUSNAM
NYSIISofMatchFirstName
ALPHANUM
250
SFUSNAM
RSoundexofMatchFirstName
ALPHANUM
258
MLUSNAM
MatchPrimaryName
ALPHANUM
262
50
HKUSNAM
HashKeyofMatchPrimaryName
ALPHANUM
312
10
PKUSNAM
PackedKeyofMatchPrimaryName
ALPHANUM
322
20
NWUSNAM
NumberofMatchPrimaryWords
ALPHANUM
342
W1USNAM
MatchPrimaryWord1
ALPHANUM
343
15
W2USNAM
MatchPrimaryWord2
ALPHANUM
358
15
W3USNAM
MatchPrimaryWord3
ALPHANUM
373
15
W4USNAM
MatchPrimaryWord4
ALPHANUM
388
15
W5USNAM
MatchPrimaryWord5
ALPHANUM
403
15
N1USNAM
NYSIISofMatchPrimaryWord1
ALPHANUM
418
S1USNAM
RSoundexofMatchPrimaryWord1
ALPHANUM
426
N2USNAM
NYSIISofMatchPrimaryWord2
ALPHANUM
430
S2USNAM
RSoundexofMatchPrimaryWord2
ALPHANUM
438
UPUSNAM
UnhandledPattern
ALPHANUM
442
30
UDUSNAM
UnhandledData
ALPHANUM
472
100
IPUSNAM
InputPattern
ALPHANUM
572
30
EDUSNAM
ExceptionData
ALPHANUM
602
25
UOUSNAM
UserOverrideFlag
ALPHANUM
627
HNUSADD
HouseNumber
ALPHANUM
629
10
ADDRC
ALPHANUM
629
236
HSUSADD
HouseNumberSuffix
ALPHANUM
639
10
PDUSADD
StreetPrefixDirectional
ALPHANUM
649
PTUSADD
StreetPrefixType
ALPHANUM
652
20
SNUSADD
StreetName
ALPHANUM
672
25
STUSADD
StreetSuffixType
ALPHANUM
697
SQUSADD
StreetSuffixQualifier
ALPHANUM
702
SDUSADD
StreetSuffixDirectional
ALPHANUM
707
88
RTUSADD
RuralRouteType
ALPHANUM
710
RVUSADD
RuralRouteValue
ALPHANUM
713
10
BTUSADD
BoxType
ALPHANUM
723
BVUSADD
BoxValue
ALPHANUM
730
10
FTUSADD
FloorType
ALPHANUM
740
FVUSADD
FloorValue
ALPHANUM
745
10
UTUSADD
UnitType
ALPHANUM
755
UVUSADD
UnitValue
ALPHANUM
760
10
MTUSADD
MultiUnitType
ALPHANUM
770
MVUSADD
MultiUnitValue
ALPHANUM
775
10
BNUSADD
BuildingName
ALPHANUM
785
30
AAUSADD
AdditionalAddressInformation
ALPHANUM
815
50
ATUSADD
AddressType
ALPHANUM
865
NSUSADD
NYSIISofStreetName
ALPHANUM
866
SSUSADD
ReverseSoundexofStreetName
ALPHANUM
874
UPUSADD
UnhandledPattern
ALPHANUM
878
30
UDUSADD
UnhandledData
ALPHANUM
908
50
IPUSADD
InputPattern
ALPHANUM
958
30
EDUSADD
ExceptionData
ALPHANUM
988
50
UOUSADD
UserOverrideFlag
ALPHANUM
1038
CNUSARE
CityName
ALPHANUM
1044
30
AREAC
ALPHANUM
1044
44
SAUSARE
StateAbbreviation
ALPHANUM
1074
ZCUSARE
ZipCode
ALPHANUM
1077
Z4USARE
Zip4AddonCode
ALPHANUM
1082
CCUSARE
CountryCode
ALPHANUM
1086
NCUSARE
CityNYSIIS
ALPHANUM
1088
SCUSARE
CityReverseSoundex
ALPHANUM
1096
UPUSARE
UnhandledPattern
ALPHANUM
1100
30
UDUSARE
UnhandledData
ALPHANUM
1130
50
IPUSARE
InputPattern
ALPHANUM
1180
30
EDUSARE
ExceptionData
ALPHANUM
1210
50
UOUSARE
UserOverrideFlag
ALPHANUM
1260
NAUSPRE
NameDomain
ALPHANUM
1266
100
ADUSPRE
AddressDomain
ALPHANUM
1366
100
ARUSPRE
AreaDomain
ALPHANUM
1466
100
P1USPRE
Field1Pattern
ALPHANUM
1566
20
P2USPRE
Field2Pattern
ALPHANUM
1586
20
P3USPRE
Field3Pattern
ALPHANUM
1606
20
P4USPRE
Field4Pattern
ALPHANUM
1626
20
P5USPRE
Field5Pattern
ALPHANUM
1646
20
P6USPRE
Field6Pattern
ALPHANUM
1666
20
IPUSPRE
InputPattern
ALPHANUM
1686
88
OPUSPRE
OutboundPattern
ALPHANUM
1774
88
UOUSPRE
UserOverrideFlag
ALPHANUM
1862
CFUSPRE
CustomFlag
ALPHANUM
1864
CCCOUNT
ISOCountryCode
ALPHANUM
1866
IFCOUNT
IdentifierFlag
ALPHANUM
1869
RECKEY
ALPHANUM
1871
12
FILEID
ALPHANUM
1871
RECNUM
ALPHANUM
1873
SYSSRC
Source System ID
ALPHANUM
1883
89
POLNUMB
Policy Number
ALPHANUM
1884
12
NAME
Full Name
ALPHANUM
1896
46
ADDR1
Address 1
ALPHANUM
1942
35
ADDR2
Address 2
ALPHANUM
1977
35
CITY
City Name
ALPHANUM
2012
35
STATE
State Abbreviation
ALPHANUM
2047
ZIP
Zip Code
ALPHANUM
2052
10
FEDID
Federal ID
ALPHANUM
2062
10
DOB
Date of Birth
ALPHANUM
2072
DOD
Date of Death
ALPHANUM
2080
90