Beruflich Dokumente
Kultur Dokumente
www.analytixds.com
WHITEPAPER
Table of Contents
The need to provide answers quickly........................................................................................ 3
You cant measure what you dont manage .............................................................................. 3
Aligning the overall architecture with the problem ................................................................... 4
Big Data Governance Managing the difference ...................................................................... 5
So, what really changes?............................................................................................................ 6
What is really driving all this change? ........................................................................................ 7
How to build a Big Data Governance solution in an agile way? ................................................. 8
AnalytiX Mapping Manager Big Data Edition..................................................................... 8
AnalytiX Big Data Governance Framework ............................................................................. 9
Addressing Big Data needs with AnalytiX Mapping Manager Big Data Edition..................12
www.analytixds.com
WHITEPAPER
"So once you know what the question actually is, you'll know what the answer means." Deep Thought, The Hitch
Hikers Guide to the Galaxy, Douglas Adams
www.analytixds.com
WHITEPAPER
AnalytiX Mapping Manager was built from the beginning to accelerate the successful development and deployment
of a successful Business Intelligence solutions, but it can also accelerate the delivery of data (all sorts of data
structured, semi-structured as well as unstructured) into this new breed of data management platform.
The strength of AnalytiX Mapping Manager lies at the heart of its architecture highly adaptive and lean, capable of
quickly aligning the fluid needs of the business with the structure imposed by Information Technology and accelerating
successful Business Intelligence and Analytical solutions.
The Velocity of information (typically the speed at which data becomes available and can be analyzed); and
The Value of information (which can seldom be determined before the data is acquired, loaded, compiled and
thoroughly analyzed).
While these four Vs may drive organizations to deploy new technologies, techniques and methods to cope with these new
requirements, these initiatives are usually incomplete and incompatible with their existing business intelligence and
analytics infrastructures, seldom taking in consideration the requirements of information governance in Big Data.
Remember: You cant measure - what you dont manage!
Big Data forces organizations to take a different look at how you integrate this data into the existing Business
Intelligence and Analytics landscape. Big Data Governance forces these organizations to rethink how you manage all
this data.
What was the question again?
Oh, yes. Just how do you actually manage the data you need to measure?
www.analytixds.com
WHITEPAPER
Volume. With extremely large data volumes, the need for highly sophisticated tools to assess and profile data
becomes a necessity as traditional approaches of profiling and managing data primarily through observation
becomes unfeasible;
Variety. The different types of data associated with Big Data (video, voice, sensor readings, images, social network
feeds, etc.), definitely require us to look at storing all of this in something other than a traditional relational database
and govern this data according to the types of data we are needing to measure
Velocity. The different latency requirements for intake and consumption, analysis, integration and publication or
promotion of the information make it necessary for the raw data to be available for analysis in real-time, with data
quality and database load schedules pretty much having to take a back seat to pressures of getting to market quickly.
Value. Typically, with Big Data, the Value of information can only be determined once the data can has been acquired,
loaded, compiled and thoroughly analyzed. This goes directly against what we, for so long, held as one of the tenets for
(small) data governance that we would have a significant investment in time and effort, spending a considerable
amount of time designing data models and building out the data integration architecture before the first row of data is
acquired.
www.analytixds.com
WHITEPAPER
become increasingly more important to manage and govern all the siloed data stores both inside and outside of the
enterprise and, more importantly, govern them so it is understandable how new answers to business questions are
being an swerved in this rapidly changing world of Big Data.
Consider the image above which depicts a typical corporate architecture in a BIG Data Governance environment. Each of
the Data Sources (internal & external) need to be managed and the data federation processes which move data between
environments and outside partners must be managed and governed.
www.analytixds.com
WHITEPAPER
Businesses and government agencies need to be much more cooperative today than ever before in order to make the
chains of extended enterprise partnerships perform as expected. Supply and delivery chains, social media sites,
customer service and support centers, government agencies and the like all need to tap and manage this
unstructured data from these new sources. While this is a lot more difficult to organize and tag than structured data
from transactional databases, it is not an impossible task.
Recent research indicates this unstructured data to be growing at alarming rates (greater than 65% per year in most cases),
and the places this growth is coming from are not necessarily new, and while most Data Governance Methods, Architectures and Tools focus on the structured data kept in databases of business applications, reality is that up to 90% of the relevant corporate information is contained in semi-structured and unstructured data stores (pdfs, contracts, weblogs, product
manuals, instructional videos, images, spreadsheets and the backbone of the personal archive system: the mail system). And
not all of it is inside the corporate walls anymore.
As users demand even more access to data, mobile devices (notebooks, PDA's, Smartphones, tablets, etc.) now store up to
60% of the typical organizations data, creating a compliance and governance nightmare. Issues range from having a large
number of copies of a single document around stored around in primary, secondary, archive, backup and mobile environments (making it almost impossible to tell what version was the last version is time stamps are not adequate anymore)
to allowing serious privacy and security breaches to occur.
www.analytixds.com
WHITEPAPER
Fig 2 AnalytiX Mapping Manager provides an end to end Enterprise Governance solution
www.analytixds.com
WHITEPAPER
The need for customization, the Mapping Manager Framework features an open metadata repository for customized
integration and analysis of metadata and data mappings. The framework supports a set of out of the box plug-in modules as well as the ability for customers to create custom in-house application that integrate with the open repository
to further analyze, integrate data or create customized views of the repository data.
www.analytixds.com
WHITEPAPER
The highly simplified AnalytiX DIAL-M for Big Data Governance framework model above demonstrates how a team of
architects, analysts, developers and testers can bring a Business Intelligence Solution to market. In order to bring agility to
the Business Intelligence solution, AnalytiX Mapping Manager allows the alignment of business and IT needs, the quick
deployment of solutions that incorporate both traditional small and Big data, at the same time, addressing key enterprise
needs, such as;
Documentation of data, business and technical requirements and automatic generation of a logical data model from
these requirements
Documentation and regulatory compliance (such as Basel, PHI,SPI, Healthcare, SOX, Solvency II etc )of data mappings, aggregations and transformation rules that have to be highly adaptive as requirements change;
Definition, documentation and creation of a central repository of business terms, rules, data elements, KPIs and metrics
Establishment of data and information requirements that span multiple data sources (including non-traditional data
sources), mixed latency and extreme data volumes;
Creation of detailed physical data model for Business Intelligence and Business Analytics Solutions
AnalytiX Mapping Manager Big Data Edition can easily provide, by virtue of its architecture, significant improvement
over traditional methods that use spreadsheets, documents or decoupled metadata management solutions by coordinating and governing all aspects of Big Data Governance.
AnalytiX Mapping Manager Big Data Edition improves efficiency in processes, people and solution deployment not
only in the analysis, design and development phases of integration, but also in downstream work flow management and
regulatory compliance and reporting as we have seen in previous articles.
Typically, all metadata management tools provide some sort of repository and can import and export data definitions
from sources and targets. What they typically lack is a set of well defined processes to accelerate development and deployment and the ability to manage change.
AnalytiX Mapping Manager Big Data Edition bridges the gap between leveraging metadata, and making the data
definition and acquisition processes automated, disciplined and predictable to all data enterprise stakeholders via its web
enabled portal and customized business oriented views. For those customers demanding more flexibility and customization the framework allows for customers to create custom modules which interact directly with the open repository and
plug-in directly to the user interface. An ecosphere of free and third party plug-ins are available to extend the Mapping
Managers out of the box governance framework.
www.analytixds.com
WHITEPAPER
Addressing Big Data needs with AnalytiX Mapping Manager Big Data Edition
If you recall, we started this White Paper by quoting Deep Thought "So once you know what the question
actually is, you'll know what the answer means."
What was the question again?
Oh, yes. Just how do you actually manage the data you need to measure?
First you have to acquire your data, be that big data or small data and bring it into the fold, then you have to
create a governance program which addresses all needs and provides the benefits that align business and IT,
promote the right architecture (both flexible and scalable) and accelerate delivery by reducing the time to market requirements and increasing the quality of the overall solution.
There are varied benefits from using AnalytiX Mapping Manager to accelerate deployment of a Business Intelligence solution, by providing the following:
the ability to run quickly build conceptual, logical and physical data models from captured
requirements,
the ability to create, maintain and consolidate data dictionaries for all enterprise systems, the ability to
quickly map source to target maps (STM) and use these STM documents to automatically generate data
integration processes.
www.analytixds.com
WHITEPAPER
the ability to quickly analyze data lineage and evaluate impact and thus manage and communicate change
efficiently and effectively. Especially in high regulated industries such as healthcare and finance where
regulatory compliance is required surrounding data and how it is governed.
www.analytixds.com
Contact Us
For further information, please contact AnalytiX Data Services
Corporate HQ
14175 Sullyfield Circle, Suite # 400 Chantilly, VA 20151 USA
Tel: +1 (800)-656-9860
Website: www.analytixds.com
Email: info@analytixds.com
SALES
For Sales - Please call (800)-603-4790 (9am-5pm EST) or Email: sales@analytixds.com
SUPPORT
For Product Support - Please call (800)-617-9620 or Email: support@analytixds.com