Miscellaneous Stage
Staging area – Retains data from 7 days to 1m other.
Compress And Expand
Both are interdependent stages
Used for doing Data Backup
Compress Stage
Compress the data using COMPESS (or) GZIP Commands.
8 records are compressed to 1 record.
Expand Stage
Expand the Compressed data using UNCOMPRESS or GUNZIP.
Encode and Decode
Encrypts and Compresses
Generic
It is a processing Stage used to cell the operators on to the Data stage
The stage is an operator
prebuilt component
Functionality
IBM developed a tool called X – Migratory Converts Server jobs to parallel jobs
Conversion rate = 70%.
X – Migratory when it is migratory / converting Server jobs to parallel jobs it is going to substitute those stages which are not these in a parallel environment with the generic stage call the functionality of the stage with its operator.
pivot
Reverse pivot converting columns to rows
Pivot converting rows to columns
Ex:- input:-
11 A HYD
22 B SEC
33 C DEL
Output
11 | A | 11 | 11 | HYD | ||
A | HYD | 11 | A | HYD | ||
HYD | B | 22 | 22 | Sec | ||
22 | SEC | 22 | B | Sec | ||
B | (or) | C | 33 | (or) | 33 | Del |
Sec | Del | 33 | C | Del | ||
33 | ||||||
C | ||||||
Del |
Sequential file pivot
Data set
Primary.txt propertiesoutput
Columns Derivation length
COL1 E ID, E NAME, STATE 100
COL2 STATE 10
Ok
Inclined to build a profession as Datastage Developer? Then here is the blog post on, explore Datastage Training
XML
(a) oracle – XML format
(b) XML – file format
- oracle enterprise
XML output
Columns Description
/EMP/ EMP No /EMP/ EMP NAME /EMP/ JOB /EMP/ MGR
Transformation setting single row
optionàwrite output to a file
new folder
Data XML
XML OUT.XML
E :/Data XML/XML OUT.XML
ok.
We can see the XML files in the folder that we created. That is Data XML
each and every record is created in an XML format.
Sequential file àXML inputàSequential file
File pattern
Dataxml.xml
load with single column rec varchar 100
Input XML Source column
xml document
output
columns
load
import xml Table Definition
open
Data XML.
For an in-depth understanding of DataStage click on
- Introduction to DataStage
- Architecture of Data Stage
- Oracle Enterprise in Data Stage
- SCD(Slow changing Dimension) in Data Stage
- DataStage Tutorials