Advanced Data Transformation in SAP BODS

Praveen Samala 18 posts since Sep 9, 2013

Advanced Data Transformation in SAP BODS Sep 9, 2013 3:45 PM
Hi All,

I am new to SAP BODS and would like to know the difference between Basic Data
Transform & Advanced Data Transform.

I know we have DI, DQ, Platform & text transforms but not sure which will come under
Basic / Advanced Data Transforms.

Any help will be appreciated!!

Thanks

Praveen

Tags: bods, transformations

Praveen Samala 18 posts since Sep 9, 2013

Advanced Data Transformation in SAP BODS Sep 15, 2013 2:43 AM

Data Quality transforms are the advanced transforms!!

Mayank Mehta 57 posts since Apr 16, 2013

Re: Advanced Data Transformation in SAP BODS Sep 15, 2013 2:43 AM

Generated by Jive on 2013-10-31+01:00

1
Advanced Data Transformation in SAP BODS

Hi Praveen,

Basically there are 4 kinds of transform, those are

· Platform: Transforms that are needed for general data movement operations. These transforms allow
you to generate, map and merge rows from two or more sources, create SQL query operations (expressions,
lookups, joins, and filters), and perform conditional splitting, and so on. For Example

–Case

–Query

–Row_Generation

–Merge

–SQL

–Validation

–Map_Operation

These are the basic transforms

· Data Integrator: Transforms that allow you to extract, transform, and load data. These transform
help ensure data integrity and maximize developer productivity for loading and updating data warehouse
environment.

For example

–Date_Generation

–Effective Date

–Key_Generation

–Pivot (Columns to Rows)

–Reverse Pivot (Rows to Columns)

Generated by Jive on 2013-10-31+01:00

2
Advanced Data Transformation in SAP BODS

–Table_Comparison

–History_Preserving

–Map _CDC_Operation

–Data_Transfer

–Hierarchy flattening

–         XML_Pipeline

These are advanced transforms for performing SCD implementations and for data warehousing projects.

· Data Quality: Transforms that help you improve the quality of your data. These transforms can parse,
standardize, correct, enrich, match and consolidate your customer and operational information assets.

For Example:

–         Associate

–         Country ID

–         Data Cleanse

–         DSF2 Walk Sequencer

–         Geocoder

–         Global Address Cleanse

–         Global Suggestion List

–         Match

–         USA Regulatory Address Cleanse

–         User_Defined

Generated by Jive on 2013-10-31+01:00

3
Advanced Data Transformation in SAP BODS

These are again advanced transforms for data quality.

· Text Data Processing: Transforms that help you extract specific information from your text. These
transforms can parse large volumes of text, allowing you to identify and extract entities and facts, such as
customers, products, locations, and financial information relevant to your organization.

For Example: Entity_Extraction

This is an advanced transform for text data processing.

Praveen Samala 18 posts since Sep 9, 2013

Re: Advanced Data Transformation in SAP BODS Sep 16, 2013 8:35 AM

Hi Mayank,

Thanks for the details info...you mean apart from the Platform transforms, DQ/DI transforms
are advances transforms.

Mayank Mehta 57 posts since Apr 16, 2013

Re: Advanced Data Transformation in SAP BODS Sep 16, 2013 9:35 AM

Hi Praveen ,

Basically, all the platform transforms are extensively used in our daily jobs in DS, and hence
can be classified as basic transforms.

For eg:

–Case

–Query

–Row_Generation

Generated by Jive on 2013-10-31+01:00

4
Advanced Data Transformation in SAP BODS

–Merge

–SQL

–Validation

–Map_Operation

But when we come to Integration transforms, they are basically used in a complex scenarios
like Slowly Changing Dimensions implementation for Data Warehouse, Capturing changed
data in cut off period for a data warehouse etc. And hence can be classified in Advanced
Transforms.

For eg:

–Date_Generation

–Effective Date

–Key_Generation

–Pivot (Columns to Rows)

–Reverse Pivot (Rows to Columns)

–Table_Comparison

–History_Preserving

–Map _CDC_Operation

–Data_Transfer

–Hierarchy flattening

– XML_Pipeline

Coming to Data Quality transforms, as to implement DQ in a project involves effort, while

setting the options in the transforms, and choosing the correct output field. Hence would be
categorized under advanced transform.

Generated by Jive on 2013-10-31+01:00

5
Advanced Data Transformation in SAP BODS

Similarly Text Data processing also involves effort of setting the options and installing the
correct dictionary. And can be qualified under Advance Transform.

Hope this will help.

Thanks,

Mayank Mehta

s rasool 2 posts since Sep 14, 2013

Re: Advanced Data Transformation in SAP BODS Sep 15, 2013 2:42 AM

Dear Praveen ,

SAP BODS ETL tool its too easy way learning transformation tools .

Basic you know about Data warehouse concept then you can read transformation initial kt
data warehouse concept Raw Data is there how to transform source to target load when
your using DI,DQ,Data transformation tools 1st you can open on Designer next object
library area ..transformation tools shown DI,DQ,Pt,and Datastore area you can select data
store ..create Data store name type of data base type ex database oracle or sql server or
application they are 3 type of dats stone there 1.Database Datastore 2.Application Datastore
3.Adapter Data store .

you can select any one data store like Database data store given name of your data store
name and version of server and password etc...

your selecting Database Data store created next import your file tables or views or
procedures ..etc ok your importing files left side you see tool palette there work flow and
data flow and condition flows and while loop r3 data flow etc you can select 1.work flow drag
on work space area work flow double click on work flow and next again you can Drag Data
flow on work space area same double click on work space area 2.nd step your imported
source file that one is stored in your local object library area drag the double on your data
stone tables and function there double click on tables drag the work space of your source
file and then select query transform connect the source and query select you want required
columns How many fields you want to move target schema in and schema out and sql command are there if
you want use or no as your wish of query and see left side tool palette there you should drag of the Template

Generated by Jive on 2013-10-31+01:00

6
Advanced Data Transformation in SAP BODS

give the name of the target connect to query and then you can check validate or any error debug to the project
job as like ur job is Batch or real time job execute the job .

Thanks ,

Best Regards with,

MD R

Sr.Software

Engineer

Message was edited by: s rasool

Mayank Mehta 57 posts since Apr 16, 2013

Re: Advanced Data Transformation in SAP BODS Sep 19, 2013 12:28 PM

hi Praveen,

Please update the thread , if your query is been answered.

Also let us know if you have any queries.

thanks,

Mayank

Generated by Jive on 2013-10-31+01:00

7