Concatenating multiple fields from the source table as

comma separated values into a field in the target table

The purpose of the mapping discussed below is to concatenate the employee skills data available in
the EMPLOYEE_SKILLS source table and load it into the EMPLOYEE_SKILL_SUMMARY target
table.

Below is the script for EMPLOYEE_SKILLS source table:

CREATE TABLE EMPLOYEE_SKILLS

(EMP_ID NUMBER(10),
EMP_NAME VARCHAR2(30),
EMP_SKILL1 VARCHAR2(40),
EMP_SKILL2 VARCHAR2(40),
EMP_SKILL3 VARCHAR2(40));

The data available in the EMPLOYEE_SKILLS table is shown below:

Below is the script for EMPLOYEE_SKILL_SUMMARY target table:

CREATE TABLE EMPLOYEE_SKILL_SUMMARY

(EMP_ID NUMBER(10),
EMP_NAME VARCHAR2(30),
EMP_SKILLS VARCHAR2(120));

The data from EMP_SKILL1, EMP_SKILL2 and EMP_SKILL3 columns of EMPLOYEE_SKILLS

table should be concatenated as comma separated values into the EMP_SKILLS column of the
EMPLOYEE_SKILL_SUMMARY table.

The mapping shown above is the earlier mapping which concatenated all the skill Input port values
in the EMP_SKILL_OUT Output port in the EXP_CONCAT_SKILLS Expression Transformation. The
expression used in the EMP_SKILL_OUT port is shown below.
The issue surfaced after the data was loaded in the target table. Below are the records loaded into
the EMPLOYEE_SKILL_SUMMARY table.

Now, the EMP_SKILLS field was displayed in some analytical reports and the way the data showed
up didnt look very pleasing. For instance, EMP_ID = 1199 has no skills in the EMPLOYEE_SKILLS
source table, so when the three input port values were concatenated in the expression
transformation, the data displayed in the reports was ',,'. So, a logic needed to be implemented that
took care of NULL values and didnt add a comma for the NULL values.

The new logic is discussed below.

Instead of concatenating all the EMP_SKILL1_IN, EMP_SKILL2_IN and EMP_SKILL3_IN port

values together, the new logic checked if the Input Skill values in the ports EMP_SKILL1_IN and
EMPSKILL2_IN were having NULL values. If it is a NULL value, it will pass a blank string as '', else it
would concatenate the incoming value with a comma in the variable ports EMP_SKILL1_V and
EMP_SKILL2_V.
The EMP_SKILLS_CONCAT_V variable port will concatenate values from the variable ports
EMP_SKILL1_V, EMP_SKILL2_V and the input port EMP_SKILLS3_IN.

Now, the only problem of a comma occurring at the end of the concatenated string will be in a
scenario when EMP_SKILL2_IN and EMP_SKILL3_IN values are NULL or when EMP_SKILL3_IN
values is NULL. For instance, if we observe in the source table EMPLOYEE_SKILLS, for EMP_ID =
1127, the EMP_SKILL1 and EMP_SKILL2 columns have valid data. So, for this particular record, the
EMP_SKILLS_CONCAT_V port will have the string value as SQL Server 2005,OBIEE 10.1.3.4,. At
the end of the string, the extra comma gets added as well.

To eliminate this comma, the string in the variable port EMP_SKILLS_CONCAT_V is reversed in
the variable port EMP_SKILLS_REVERSE_V. The EMP_SKILLS_REMOVE_COMMA_V variable
port will check for the occurrence of a comma at the start of the data string. If it encounters a
comma, it will pass only the substring without the comma at the start of the string, else it passes the
data as it is. This is achieved with the expression as shown below.

Now, to get back the original concatenated string without any extra comma , reverse the data again
and pass it through the EMP_SKILLS_OUT output port to the final target table column
EMP_SKILLS.

These are the records in the EMPLOYEE_SKILL_SUMMARY table after running the modified
mapping again.