Staging Area in DataStage

 

Miscellaneous Stage

Staging area – Retains data from 7 days to 1m other.

Compress And Expand

Both are interdependent stages

Used for doing Data Backup

Compress Stage 

Compress the data using COMPESS   (or) GZIP Commands.

   

8 records are compressed to 1 record.

Expand Stage

Expand the Compressed data using UNCOMPRESS or GUNZIP.

   

Encode and Decode 

Encrypts and Compresses

Generic

It is a processing  Stage used to cell the operators on to the Data stage

The stage is an operator  prebuilt component

 

Functionality

IBM developed a tool called X – Migratory Converts Server jobs to parallel jobs  Conversion rate = 70%.

X – Migratory when it is migratory / converting Server jobs to parallel jobs it is going to substitute those stages which are not these in a parallel environment with the generic stage call the functionality of the stage with its operator.

pivot

Reverse pivot  converting columns to rows

Pivot converting rows to columns

Ex:-     input:-

11   A    HYD

22   B   SEC

33  C    DEL

Output

11		A	11		11	HYD
A		HYD	11		A	HYD
HYD		B	22		22	Sec
22		SEC	22		B	Sec
B	(or)	C	33	(or)	33	Del
Sec		Del	33		C	Del
33
C
Del

Sequential file pivot Data set     

Primary.txt                  propertiesoutput

Columns                 Derivation                        length

COL1                   E ID, E NAME, STATE           100

COL2                 STATE                                             10  

         Ok

Inclined to build a profession as Datastage Developer? Then here is the blog post on, explore Datastage Training

XML

(a)  oracle – XML format

(b)    XML – file format

• oracle enterprise XML output

Columns Description  /EMP/ EMP No   /EMP/ EMP NAME   /EMP/ JOB /EMP/ MGR

Transformation setting    single rowoptionàwrite output to a file new folder Data XML

XML OUT.XMLE :/Data XML/XML OUT.XML ok.

We can see the XML files in the folder that we created.  That is Data XML

each and every record is created in an XML format.

Sequential file àXML inputàSequential file

File pattern  Dataxml.xml load with single column rec varchar 100

Input XML Source column  xml document output columns  load  import xml Table Definition  open Data XML.

For an in-depth understanding of DataStage click on

• Introduction to DataStage
• Architecture of Data Stage
• Oracle Enterprise in Data Stage
• SCD(Slow changing Dimension) in Data Stage
• DataStage Tutorials