Beruflich Dokumente
Kultur Dokumente
October 2016
Governance
Automation
For any questions regarding the contents of this presentation please contact us at info@AnalytiXds.com and we will assist you as soon as possible. The contents of this presentation are
protected under NDA. All rights reserved by AnalytiX DS 2016
Standard Agenda
Introductions
Company & Unified Platform Introduction (15)Mins
1. AnalytiX DS Unified platform governance & lifecycle management of the data mapping process
Modified Agenda
Snap Shot
Company Overview
Founded
2006
Offices
HQ: Chantilly, VA USA
USA: Development Center: Dallas, TX
Global Delivery Center: Hyderabad, India
Partners/ Resellers
Innovation Award
Informatica, 2010, 2012 Winner
Informatica, 2012
Leadership
50+ years experience in Integration
Market Leader
Enterprise Data Mapping & Automation
ETL Conversion Technology
Employees
More than 200
Bloor Research,
2012
Michael Boggs
CTO and Founder
Madan Kalakuntla
Managing Partner, Global Delivery Center
Sam Benedict
John Carter
VP of Strategic Accounts
Corporate Vision
Manage data, metadata, data mappings and integration processes through the
system development life-cycle (SDLC) process, enabling governance, automation
transparency and lineage of the data in a single unified platform for data
integration professionals
Add-on Modules
Mapping Manager
(flagship product)
1.
2.
3.
4.
5.
Business Glossary
Requirements Manager
Reference Data Manager
Test Manager
Data Quality Assessment
Manager (DQAM)
6. Release Manager
7. Report Manager
8. Plug-Ins for metadata tools
1. CATfX Automation
2. CATfX Global Marketplace
3. Packaged Automation Bundles
Big Data
ETL, ELT
Data Vault
4. LiteSpeed Conversion
Add-on Modules
SDLC Governance
Open Automation Framework
Product Summary
Key Capabilities
8
Metadata Scanners for just about everything
Capability to build custom scanners
Govern and enrich Data Dictionary definitions
End to End Lineage view lineage across all hops across the data management architecture
Impact Analysis across tables, columns, systems, business rules, projects, mappings & ETL processes
Universal Platform for scanning, consolidating and managing Metadata across the organization. View Data Lineage and Impact Analysis
across the organization while meeting regulatory compliance with industry regulators involving data mapping and lineage.
Integration Industrys first patented Pre-ETL enterprise data mapping solution. Enables organizations to create, version and manage
source to target mappings (STM) through the change process and view end to end data lineage across the data mapping process and
information management architecture.
Scan, Drag, Drop, Build and version data mappings across the life-cycle processes. Export Mappings
and Auto-generate ETL jobs for leading ETL Tool providers and Hadoop
Enables business users IT to create, manage and collaborate on common business vocabulary across the organization Supports
regulatory compliance, data governance, and data stewardship initiatives by governing business vocabulary terms and enabling lineage
maps showing how semantic definitions are related to physical data dictionaries, data mappings, lineage of federated data in a
business friendly governance platform.
Requirements Manger
An agile and collaborative platform to standardize the functional requirements documentation process using a customizable template
driven approach. Easily, create and customize requirements templates to standardize the capture, trace, and requirements definition
process for integration projects. Rich features allow for management of functional requirements and how they link to data
mappings, test cases, test results to promote greater transparency and visibility of requirements process and downstream impacts.
Enables business and IT users to scan, manage, validate and version govern code-sets and reference data across the organization.
Perform validation, link to mappings and integrate with ETL Processes to ensure consistency across governed reference data.
.
Govern user defined reference data and code-sets in a single platform and link to requirements and
data mappings.
Integrate with ETL Processes to standardize Lookup values , code crosswalks , ref data and more
Enables Program and Project Managers to create, validate and manage releases, release calendars and release artefacts such as ETL
Jobs, Data Mappings, Database Objects, Server objects, release notes and more to standardize all release processes and
documentations standards around the release process.
Test Manager enables Test Cases and Test SQL generation to be managed in a purpose built module for testing data mappings and ETL
processes. There are over 15+ built-in automation CATS which enable immediate creation of Test Cases and TEST SQL to accelerate the
testing phase of integration projects.
Create and Manage Test Cases and Test SQL for Data Mappings and ETL Processes
Auto-Generate Test Cases & SQL from Data Mappings
Create test cases at the column level of mappings or target tables
Integrates with HP ALM (formerly HP Quality Center)
Enables organizations to standardize and execute a formal data quality assessment methodology by selecting the objects which should
be assessed, scheduling the assessments, manage the data quality scores and workflow review process. Governance features manage
data steward and stakeholder accountability for the quality reviews and sign-off. Govern valid values, invalid values, remediation rules
and generate scripts to fix/repair invalid data values.
Metadata plug-in are available for Informatica Metadata Manager, IBM Metadata Workbench/GDC, DAG metacentre and Rochade.
This enables all the metadata in Mapping Manager Unified Platform to be ported into third party metadata environments. Metadata
connectors for all ETL Tools, Java Scripts, Cobol copybooks, Cobol Programs, Sales Force.com and more.
All the metadata from Data Dictionaries, Data Mappings, Reference Data, CodeSets and Data Quality
Assessments are synchronized in metadata management environments.
Plugins exist for major third party systems
Customization and support services are available
Code automation Templates (CATs) are pre-built to automate the code-generation for the Data Vault EDW methodology for Source to
Stage, HUB, LINK, Satellites and Data Marts. The complete data vault bundle contains CATs to generate DDL, Data Mappings, ETL Jobs
and processes for all major ETL tools including Hadoop and Standard SQL as well at Testing Cats to automate the testing process and
data quality of the Data Vault.
The integration Industrys first Automation Platform for Data Integration Professionals. CATfX Defines Work Smarter. Save Big. Autogenerate ETL Jobs, Build Custom Adaptors and Connectors to anything, Scan Metadata and Generate code for anything using a 100%
metadata driven approach to automation. The automation marketplace is a global marketplace for automation developers to post
automation CATs for the global community to browse buy, sell and download to automate
manual process.
www.analytixds.com
The integration industrys first ETL Conversion platform enabling a fast and automated way of converting from customer legacy ETL
Mapping Manager
Metadata Management (AMM)
Mapping Manager
Enterprise Data Mapping (AMM)
Enterprise Business Glossary
10/18/2016
2014
2014AnalytiX
Analytix DataData
Services.Services
All Rights Reserved.
AUTOMATION TOOLS
GOVERNANCE TOOLS
ETL
ALM
IMM
IDQ
By Project
1.
2.
3.
Data Warehouse
Big Data
Application Consolidation and Migration
1. App Retirement
2. Mergers and Acquisitions
3. DBMS Conversion
4. Data Migration
5. ETL Platform conversion
6. Application Modernization & Tools Replatform
7. Cloud migration
4. Regulatory Compliance & Mapping Standards
5. Data Governance
6. Data Quality Assessment
7. Testing & Quality Assurance
8. Metadata Management
9. Master Data Management
10. Code Parsers to quickly document code
By Resource Role
1.
2.
3.
4.
5.
6.
7.
8.
Information Governance
Component Reference Model
Compliance
Regulatory Audit
(mm)
IT Security Audit
(mm)
Governance of Mapping
Specifications
(mm)
Governance of Releases
(rm)
Data Mapping
Rules
Design
Build
Test
Deploy
Maintenance
Business Analyst
Mapping Analyst /
Business Analyst
Architect / Lead
Developer
Developers
Testers
Data Stewards /
Quality Analyst
Release Managers /
Project Manager
Mapping Analyst
Developers
Testers
Data Stewards
Release Managers
Reqts Manager
Mapping Manager
(mm)
CATfX Automation
(catfx)
Test Manager
(tm)
Data Quality
(dqam)
Requirements
Business
Application
(rqm)
optional
Reference Data Manager
CATfX Automation
(catfx)
optional
test automation via CATfX
Release Manager
(rm)
Mapping Manager
CATfX Automation
Test Manager
Release Manager
DQAM
Compliance
Regulatory Audit
(mm)
IT Security Audit
(mm)
Governance of Mapping
Specifications
(mm)
Governance of Releases
(rm)
Data Mapping
Rules
Requirements
Design
Build
Test
Deploy
Maintenance
Release Managers /
Project Manager
Mapping Analyst
Developers
Testers
Data Stewards
Release Managers
Business
Application
Business Analyst
Mapping Analyst /
Business Analyst
Architect / Lead
Developer
Mapping Manager
(mm)
Mapping Manager
(mm)
CATfX Automation
(catfx)
Developers
CATfX Automation
(catfx)
optional
Reference Data Manager
Capability
Testers
Data Stewards /
Quality Analyst
Test Manager
(tm)
Data Quality
(dqam)
Mapping Manager
CATfX Automation
Test Manager
Release Manager
DQAM
Release Manager
(rm)
optional
test automation via CATfX
Associate re-usable
test cases to
mappings and target
tables
Generate test SQL
and comparative
source and target
SQL statements (19
test automation
CATs)
Create new test
cases and link to
mappings
Execute test cases
and capture test
results
Create new test
automation (CATfX)
Sync with industry
standard test tools
such as HP ALM and
IBM Doors
Mapping
Maintenance. As
new columns, tables,
data source are
added the mappings
can be versioned,.
maintained,
compared to
previous versions
Code Changes.
Regenerate Code for
New Mappings
Regression Unit
Test. Regenerate
Test Cases/Test
SQL
Release
Management.
Manage releases
and release Objects
Continuous Data
Quality Monitoring of
scores
Accelerate Timelines
Unified platform offers accelerated timelines and governance of the across the SDLC
Timeline
SDLC
Requirements - Requirements and Data
Mapping
Design - Creating & Enforcing ETL/ELT and
Big Data Job Design Standards
Build - DDL, ETL/ELT and Big Data
Integration Jobs
Manual
50% Faster
60% Faster
Manual
Manual
60% Faster
50% Faster
Manual
with DQAM
50% Faster
Manual
50% Faster
Manual
30% Faster
Manual
50% Faster
Manual
50% Faster
Manual
50% Faster
Manual
15
50% Faster
60% Faster
50% Faster
5X Better Results
Design
Standardization &
Acceleration
Development
Standardization &
Acceleration
Improved Governance
& Data Quality
Mapping Manager
Enterprise Data Mapping
Platform
CATfX Automation
Standardization using CAT Code-Gen
templates
Test Manager
Standardization using CAT codegen templates (19 test
automation templates
DQAM
Data Quality Assessment Manager
Reference Data Manager
Reference Data, CodeSets Mgmt,
Validation Rules
Big Data
Metadata X-Connects
Plug-ins for Metadata Management Tools
Mapping Manager
Governance of Mapping Designs
Data Lineage
Impact Analysis
SPARK
SCOOP
PIG
PYTHON
HSQL
MAP REDUCE
Standardization
www.analytixds.com
2014 Analytix Data Services. All Rights Reserved.
Release Manager
Improved governance and control of
managing release approvals and release
objects
Benefits
Deliver faster & better with higher quality deliverables
Reduce project risks and big data management costs
Deliver instant business value and improve Governance Across the SDLC process
Standardize and accelerate ETL processes with reusable templates
Standardize and accelerate Testing processes with reusable templates
Global visibility into enterprise projects
Improve performance by adopting and generating Hadoop Scripts
What are our referenceable customers are saying about AnalytiX DS?
What are our referenceable customers are saying about AnalytiX DS?
(Contd.)
What are our referenceable customers are saying about AnalytiX DS?
(Contd.) Featured Government Customers
21
CATfX
Automation JumpStart Program
CLOUD enabled Automation Platform designed for integration Professionals
Program Details
6 Week Program
Software + Services Bundle
Focused on-Site Automation SWAT team
Guaranteed ROI
Testing Automation
Generate DDL
Generate any type of script in any language or technology
Generate any type of file
And more
www.analytixds.com
2014 Analytix Data Services. All Rights Reserved.
File Export
From CAT generates
code in the SDK
format of target
System
Big Data:
Metadata
Manager
Mapping
Manager
Reference
Data
Manager
Data
Quality
Manager
Any Code
Any Platform
Hubs
Links
Satellites
Data Storage
Layer
PIT
Bridge
Automation Bundles
Data Vault
SPARK
Hub
Scoop
Source 2 Stage
Link
PIG
Satellite
Integration Bundles
Dynamically Create Mappings in Mapping Manager Save time of Mapping Designer (Auto-map)
Dynamically generates metadata sources and connections in Mapping Manager
Generate DDL for the target DBMS
Generate ETL Jobs to Standardize job design patterns and standards and accelerate ETL
Standardize Job Design Standards: ESB and message Queues, Stage load, SCD Dimensions Type 1, 2 & 3, Fact etc patterns
Big Data: Generate PIG, Scoop, MapReduce and Python scripts
Generate Test SQL (Test Manager)
Generate Data Profile Scripts/Reports
Generate Data Quality Scripts/Reports (DQAM)
Generate data validation Scripts/Reports
SQL parsing and Conversion
Shell Script Parsing and Conversion
Cobol Copybooks and Program conversions
More.
25
Automation
26
Data Sources
Support for any source
landing
Stage/IDL
EDW
3NF
SOA/ESB
Developers
Mapping Analyst
Hadoop
- Gen DDL
JSON
IoT
Facts
Dimensions
Data
Marts
Report Layer
Outbound
Data Files
ESB
Other
- Generate
Mappings
- Version &
Maintain
Mappings
WORFLOW ACCELERATION
Developers
- Gen ETL Jobs
- Gen Big Data
Jobs
www.analytixds.com
2014 Analytix Data Services. All Rights Reserved.
Testers
- Gen Test Cases
Data Stewards
- Manage Test
Results
Manage Codesets
----
Requirements Manager
(RQM)
CodeSet Manager
(CSM)
DATA VAULT
AUTOMATION
Manage Reference
Data
---Reference Data Manager
(RDM)
Manage Release
----
Test Manager
(TM)
Release Manager
(RM)
METADATA
LAYER
1.
2.
3.
4.
5.
Source 2 Stage
Hub Generator
Link Generator
Satellite Generator
Point in Time (PIT)
Generator
6. Bridge Generator
1.
2.
Data Sources
Process Groups:
Source 2 Landing
| Landing 2 Stage
LANDING
any
Stage to Raw DV
Raw DV 2 Business DV
STAGE
Raw
Data Vault
Business
Data Vault
Pit / Bridge
DM1
Bus DV 2 DM2
DM2
DM3
DBMS
29
Data Sources
Support for any source
Accelerate and Standardize development process for Data Vault and accelerate downstream process.
Stage
Hub
Link
Satelite
Data Vault
DataMarts
RAW
Business
SOA/ESB
Designer / Developers
Mapping Analyst
- Gen DDL
JSON
IoT
Report Layer
Outbound
Data Files
ESB
Other
- Generate
Mappings
- Version &
Maintain
Mappings
WORFLOW ACCELERATION
Developers
- Gen ETL Jobs
- Gen Big Data
Jobs
www.analytixds.com
2014 Analytix Data Services. All Rights Reserved.
Testers
- Gen Test Cases
Data Stewards
- Manage Test
Results
Discovery
Effort
Resourcing
Activity
10/18/2016
2 days
week 1
week 2
Build Plan
Requirements
Create Road-Map
Build detailed requirements for
prioritized roadmap items
Sprint
1-4
week 5
Production Rollout
Implement Roadmap
Test & Review automation CAT
outputs and measure against
success criteria.
- CAT 1
- CAT 2
- CAT 3
Examples:
- Define ETL patterns to
Standardize ETL jobs autogenerate ETL Jobs
- BIG DATA
- Define repeatable test cases and
scripts.
- Utilise CATfX to push field / table
definitions into STAGE/EDW
- Integrate with Metadata Mgmt
tools
- Utilise CATfX to
maintain/integrate reference
data
3 days
5 days
30
5-20 days
Measure
Success criteria
CAT 1: Standardize ETL Processes
CAT
SUMMARY
CAT Description: Create a reusable cat to automatically point to Source, read tables and generate SSIS jobs with CDC component and error handling configured.
Capability
Cost Savings
Evaluation Criteria
Time Savings
Scope of
Automation
ETL Jobs: The CAT is expected to automate the following ETL jobs across the following systems:
System 1: 200 tables/Jobs
System 2: 300 Tables/jobs
Total 500: Jobs to automate (phase 1)
The Automation template will be re-usable for ongoing development and other projects.
Coverage
Evaluate fit for EDW, Data Migration, Data Conversion, other Integration Projects
Standards
Naming standards.
Data types.
Load pattern.
Simplicity
Able to be incorporated into the existing EDW environment and processes without requiring
additional operational overhead.
Operating
Model
Ensure the benefits provided by the automation can be fully leveraged within the design
patterns and operating model.
Solution should be easily applied and adoptable by integration and business users
Support
Functionality
10/18/2016
CAT Objective: Automate the Source to STAGE ETL Process using CDC logic with SSIS
31
Code Editor
w/ versioning
Integrated
Debugger
Create Mappings & use the universal code-generator to Generate Code and accelerate the data integration process for complex data migrations
Code Generation
Extract
More
Generate Code
POC Team
AnalytiX DS +1
Customer SME
SME sends
examples of mappingsAnalytiX DS Automation
Assessment Engine
OUT OF
SCOPE
IN
SCOPE
Customizing CATs
Requires Paid POC
Auto-Generate ETL
34
UAT
www.analytixds.com
Data Vault
Getting Started requires a dedicated support team to ensure success of all deliverables and answering of all questions
POC Team
Customer Sponsor +1
AnalytiX DS (4)
Data Vault Sme + 1
Mapping Analyst +1
ETL Developer +1
CAT Developer +1
Agree on Scope
Architecture Review
YES
Auto-Generate Code
UAT
www.analytixds.com
NO
Enables business users IT to create, manage and collaborate on common business vocabulary across the organization Supports regulatory compliance,
data governance, and data stewardship initiatives by governing business vocabulary terms and enabling lineage maps showing how semantic definitions
are related to physical data dictionaries, data mappings, lineage of federated data in a business friendly governance platform.
KEY FEATURES
Collaborate and manage business terms, acronyms definitions and enrich
with rich media definitions such as images, videos, sound-files and more
Map semantic business definitions to physical data dictionaries and
view relationships and lineage
BENEFITS
Promotes data quality and governance participation
and collaboration in a web based business friendly
platform
Enables greater control and visibility for all major
stakeholders and the business though an integrated
workflow process
Promotes collaboration and establishes relationships
between semantic business terms and physical data
dictionaries
Requirements Manager
An agile and collaborative platform to standardize the functional requirements documentation process using a customizable template driven approach. Easily, create and
customize requirements templates to standardize the capture, trace, and requirements definition process for integration projects. Rich features allow for management of
functional requirements and how they link to data mappings, test cases, test results to promote greater transparency and visibility of requirements process and downstream
impacts.
KEY FEATURES
BENEFITS
Mapping Manager
Integration Industrys leading Pre-ETL enterprise data mapping solution. Enables organizations to create, version and manage source to target
mappings (STM) through the change process and view end to end data lineage across the data mapping process and information management
architecture.
KEY FEATURES
BENEFITS
Web user interface and roles based security to govern metadata, data
dictionaries and govern Mappings, Codesets, Code Crosswalks and
Reference Tables
KEY FEATURES
BENEFITS
Release Manager
Enables Program and Project Managers to create, validate and manage releases, release calendars and release artefacts such as ETL Jobs, Data
Mappings, Database Objects, Server objects, release notes and more to standardize all release processes and documentations standards around the
release process.
KEY FEATURES
BENEFITS
Quickly view and generate release plans and other release reports
Test Manager
Test Manager enables Test Cases and Test SQL generation to be managed in a purpose built module for testing data mappings and ETL processes. There are over 15+ built-in
automation CATS which enable immediate creation of Test Cases and TEST SQL to accelerate the testing phases of integration projects.
KEY FEATURES
BENEFITS
KEY FEATURES
BENEFITS
Reporting Manager
Enables IT teams to quickly build and configure reports and dashboards from AnalytiX DS repository to manage their teams workflow status and
cross team communication by creating and publishing reports and dashboards to streamline communications across the data management
process. The easy to use interface enables reporting 10 times faster without all the training hassles required by larger BI reporting platforms.
KEY FEATURES
BENEFITS
Flexible Reporting
Helps improve decision making and promotes crossteam collaboration across the SDLC process
KEY FEATURES
BENEFITS
KEY FEATURES
Multitude of scripting language support for the developer
community (JavaScript, JRuby, Groovy, J-Python, R & XSLT)
Create and version Re-usable code automation templates (CAT)
BENEFITS
Enterprise Code management
Drastically increases developer productivity with
reusable code automation templates(CATs)
Available Services
Services Categories
QA
Mission Statement:
We are driven by our relentless focus on the pursuit of Excellence, we will constantly strive to implement the critical initiatives required to achieve our vision. In doing this, we will deliver operational & innovation excellence in every
corner of the Company and meet or exceed our commitments to our customers, our employees and our partners. All of our long-term strategies and short-term actions will be molded by a set of core values that are shared by each and
every associate aimed at ensuring customer success and innovating the Data Integration industry and remaining a leader in enterprise data mapping, governance and automation. We strive for Excellence in everything we do!
Ask about our team enablement services and discount schedules for
(Screen Orientation)
Auto-Generate
ETL Jobs
S2T Mapping
Specifications
Build
Mappings
using
Drag n Drop
iously Versioned
Mappings
Metadata Browser
Mapping Details
(Customizable)
Business Glossaries
RDBMS Metadata
Data Models
File Data
Internet of Things (IoT)
JSON
Hadoop HDFS
HIVE
Ecosphere DBMS
More
Integration categories
Release Manager
Work Smart.
Save Big
Idea Concept
Before you think about writing code for
weeks and months on end think about
how the code can be automatically
generated. Then contact the experts at
AnalytiX DS to for review with an
automation expert.
Library Metadata
We have an extensive library of automation
templates in our library which will work for your or
can be customized to fit your exact automation
requirement.
Any Volume
The larger the coding task the better! We can
create a reusable automation template that can
save hundreds of man hours and hundreds of
thousands of dollars by addressing the manual
coding effort with automation techniques made
possible with our CATfX Automation Framework.
Governance
Automation
Contact Us
SALES
For Sales - Please call (800)-603-4790 (9am-5pm EST) or Email: sales@analytixds.com
SUPPORT
For Product Support - Please call (800)-617-9620 or Email: support@analytixds.com
Corporate HQ
info@analytixds.com
support@analytixds.com
(800) 656-9860
Http://www.analytixds.com
www.analytixds.com/community
www.youtube.com/user/AnalytiXDS
Facebook.com/analytixds
LinkedIn.com/analytixds