Key less Technique in Data Stage

Ratings:
(4)
Views:0
Banner-Img
  • Share this blog:

Key less Technique

SAME To more previously staged partitioning to next corresponding stage with    same  key column values. ENTIRE Can only be used in  lookup stage with reference  link when it is “normal lookup” Screenshot_102   In Entire what ever the records that are processing on N1, the same set of records are processed on the rest of the node. Screenshot_103

At TekSlate, we offer resources that help you in learning various IT courses.
We avail both written material and demo video tutorials.
To gain in-depth knowledge and be on par with  practical experience, then explore DataStage Training Videos.

RANDOM - Default / Auto Round Robin Generates the next number with sequence Note :- All the Generating stages gives the best performance when they are associated with Round Robin.

Generating  Stages

column generator , Row generator, Surrogate Key stage RANGE  It is an Expensive partitioning Technique than  Mod and Hash . This technique  needs data pre processing. Note :- Stage  :- Write Range Map (Development/ Debug stage) 11 To create the range if we want to use Range partitioning Web Console log in to “IBM information Server” with Same designer ID and PasswordàAdministration 11users and groups 11users 11user 11open

  • To create New user 11 New
  • Do main Management 11 license up gradations
  • Session Management 11login time
  • Users and groups
  • Log Management 11 Access all logic from Director
  • Scheduling Management 11Scheduling vices

Reports We  can view and generate reports Web console Admin11 DS Admin11Project level Administration  (or)  Repository level

Brief on Surrogate key in DataStage

Surrogate key

  • A kind of Alternative primary key
  • Generate sequence number

Output

Sid Cid CN Add
1 11 A HYD
2 22 B SEC
3 33 C Del
4 22 B GNT
5 44 E PUN

11If we don’t take surrogate key 11it maintains a new column active flag(indicate current address) o/p:

CID CN ADD A.F
11 A Hyd Y
22 B SEC Y/N
 33 C Del Y
 22 B GNT Y
44 E PUN Y

Ex: After data;(source)

CID CN ADD
11 A HYD
22 B Cal
66 G ASm

Before Data(Target)

CID CN ADD A.F
11 A Hyd Y
22 B SEC Y
 33 C Del Y

Output Before data(Target)

CID CN ADD A.F
11 A Hyd Y
22 B SEC Y/N
 33 C Del Y
 22 B GNT Y
66 G ASM Y

After Data: (Source)

CID CN ADD
11 A GNT
22 B DEL
55 H MP

Output

CID CN Add A.F Effective start date Effective end date
11 A Hyd Y/N 3-6-06 (9999-12-31) 26-10-10
22 B SEC Y/N 3-6-06 (99-12-31) 27-9-07
33 C Del Y 3-6-06 99-12-31
22 B Cal Y/N 28-9-07 (99-12-31) 26-10-10
6 G ASm Y 28-9-07 99-12-31
11 A GNT Y 27-10-10 99-12-31
22 B DEL Y 27-10-10 99-12-31
55 H MP Y 27-10-10 99-12-31

 Active Tag :- (A.F) 11New  records will maintain flag ‘Y’ 11Old records ‘N’ 11Tables will data maintain effective start data and effective end data 11If data is not displayed, then we get a new column record version , unique id

 

Record version, unique id Screenshot_73 SCD  - Type  Table 1 Create table SRC   (SNO number (3), S name   Varchar 2 (25));11 Create the table and reject values Table 2 Create table CIM   (SNO number (2), S name   Varchar 3 Sname varchar2 (25));11 Just create the table only 5 steps for SCD – Type 1 

S1:- Select output link as Fact link

S2: Map the lookup key SNO

S3: Source type  = flat file

= Source Name     = (Empty file Name)

S4 : identifying the purpose of each field

S5: Map required fields to fact table

Load properties

S1: Set Data set properties S2: Set oracle properties Table name = dim 1 Write method = upset  (update and insert) Upset order = update then insert lab :-  SCD – 1 Oracle enterprise 0 load  dim 1 Oracle enterprise 1  Load              src Sno                    Sname 111                    shilpa 222                 repeka 333                  Archama SCD

  1. Select output link as fact
  2. Map the look up key sno
  3. Source type = flat file

Source   name  = E :/shilpa/scd1.txt     empty file Screenshot_75

  1. Map required fields to fact  table

Compile and RUN (b) Data set ----------------------àoracle enterprise à In table  (a) , save the columns is Data set 1 and also copy the path of div 1 data set Now, is this job Data set11paste the path is the file 11 columns 11load 11 (SCD) 

About Author
Authorlogo
Name
TekSlate
Author Bio

TekSlate is the best online training provider in delivering world-class IT skills to individuals and corporates from all parts of the globe. We are proven experts in accumulating every need of an IT skills upgrade aspirant and have delivered excellent services. We aim to bring you all the essentials to learn and master new technologies in the market with our articles, blogs, and videos. Build your career success with us, enhancing most in-demand skills in the market.