Wednesday, December 26, 2012

Filter Transformation

Explain about Filter Transformation

Filter Transformation:
This is an active transformation which allows you to filter the data based on a condition
A condition is created with following elements
Port
Operator
Operand

Use the filter Transformation to perform data cleansing.(Removing Unwanted data)
The filter Transformation returns TRUE/FALSE. True indicates that an input record meets the given condition and record is delivered for further processing or loading. False indicates that an input record does not meet the given condition & record is delivered for reject. The filter Transformation does not support to capture the rejected records. 
The filter Transformation allows you to develop a single condition and allows you to pass the data to single target
The default condition in filter Transformation is TRUE



You cannot concatenate ports from more than one transformation into Filter transformation. 

It is recommended to place the Filter transformation closer to the source to increase the performance

Source Qualifier Transformation

SQ Transformation can also be used to filter the rows. SQ provides better performance when compared to filter transformation as SQ reduces the rows sent to the mapping

Difference between SQ and Filter transformation 


SQ transformation limits the row set extracted from a source while filter transformation limits the rows sent to the target

Why use Filter Transformation?

The Source Qualifier transformation only lets you filter rows from relational sources, while the Filter transformation filters rows from any type of source. Also, note that since it runs in the database, you must make sure that the filter condition in the Source Qualifier transformation only uses standard SQL. The Filter transformation can define a condition using any statement or transformation function that returns either a TRUE or FALSE value. 







No comments:

Post a Comment

Related Posts Plugin for WordPress, Blogger...