DataStage Architecture & Client Components

DataStage

IBM InfoSphere DataStage is a part of IBM Information Server Suit. DataStage enables us to define the extraction process of data from multiple source systems, transform it in ways that make it more valuable, and then load it to single or multiple target applications. In short it is an Extraction Transformation and Loading (ETL) tool

The below Image illustrates the Client/Server Architecture of Information Server (DataStage is an integral part of the Information Server)

The video below explains the architecture of DataStage:

(ignore if not interested in the architectural details of the Information Server)

Client Components

There are three Client Components in DataStage

• IBM InfoSphere DataStage and QualityStage Designer
• IBM InfoSphere DataStage and QualityStage Director
• IBM InfoSphere DataStage and QualityStage Administrator

IBM InfoSphere DataStage and QualityStage Designer

This is a graphical design interface tool that helps developers create DataStage programs or code ( referred to as “jobs“).

Designer has pre-built function called “Stages” which assist developers in connecting to external source systems like an Oracle Database, a Mainframe system, reading data from a CSV file and many more systems. It also has Stages that help in transforming the data into the required format and loading the cleaned data to target systems. Stages are accessible through the Designer “Palette”

Once all the required job is developed, we can save in the “Repository” and then compile them in the Designer. It also has the provision to execute the jobs ( which is called as “Running the Job”) by clicking on the “Run” button available in the designer.

Designer is also used to import and export jobs to and from the DataStage Server (Details of which will be explained during this course).

IBM InfoSphere DataStage and QualityStage Director

This is also a graphical interface tool which is used to run, schedule, validate, monitor and support DataStage Jobs.

IBM InfoSphere DataStage and QualityStage Administrator

IBM InfoSphere DataStage and QualityStage Administrator is used to perform the following activities

• Create/Delete/Modify Projects
• Create/Delete DataStage users
• Setup project specific parameters and properties
• Unlock jobs that are inaccessible
• Define setting for purging job logs