Staging Area in DataStage
Miscellaneous Stage
Staging area – Retains data from 7 days to 1m other.
Compress And Expand
Both are interdependent stages
Used for doing Data Backup
Compress Stage
Compress the data using COMPESS (or) GZIP Commands.
8 records are compress to 1 record.
Expand Stage
Expand the Compressed data using UNCOMPRESS or GUNZIP.
Encode and Decode
Encrypts and Compresses
Generic
It is a processing Stage used to cell the operators on to the Data stage
Stage is an operator prebuilt component
Functionality
IBM development a tool called X – Migratory Converts Server jobs to parallel jobs Conversion rate = 70%.
X – Migratory when it is migratory / converting Server jobs to parallel jobs it is going to substitute those stages which are not these in parallel environment with the generic stage call the functionality of the stage with its operator.
pivot
Reverse pivot converting columns to rows
Pivot converting rows to columns
EX :- input :-
11 A HYD
22 B SEC
33 C DEL
Output
| 11 | A | 11 | 11 | HYD | ||
| A | HYD | 11 | A | HYD | ||
| HYD | B | 22 | 22 | Sec | ||
| 22 | SEC | 22 | B | Sec | ||
| B | (or) | C | 33 | (or) | 33 | Del |
| Sec | Del | 33 | C | Del | ||
| 33 | ||||||
| C | ||||||
| Del |
Sequential file pivot Data set
Primary.txt propertiesoutput
Columns Derivation length
COL1 E ID, E NAME, STATE 100
COL2 STATE 10
Ok
Interested in mastering DataStage?Check out this blog post to learn more DataStage Tutorials.
XML
(a) oracle – XML format
(b) XML – file format
- oracle enterprise XML output
Columns Description /EMP/ EMP No /EMP/ EMP NAME /EMP/ JOB /EMP/ MGR
Transformation setting single rowoptionàwrite output to a file new folder Data XML XML OUT.XMLE :/Data XML/XML OUT.XML ok.
We can see the XML files in the folder that we created. That is Data XML
each and every record is created an XML format.
Sequential file àXML inputàSequential file
File pattern Dataxml.xml load with single column rec varchar 100
Input XML Source column xml document output columns load import xml Table Definition open Data XML.
For indepth understanding of DataStage click on