Data Specialist - Datastage
ibm
مجموع سنوات الخبرة :14 years, 8 أشهر
Senior ETL Developer /Lead, IBM CIC, Egypt
Project : \[ACA\] Administrative Control Authority(Government Industry)
The main objective of this project is to maximize the organizational capacity of the
state through the integration of different databases in a unified data warehouse to enhance
the potential of the state in the face of the budget deficit problem warehouse.
Responsibilities:
(From 0 6 2019 Till Now)
During this period my role in the project is as Data Engineer (Data Quality ETL Lead )
and my responsibilities as below :
o Participate in each data source analysis and per form business and technical analysis to understand each data source using IBM Information Analyzer .
o Monitoring and reviewing data that is entered into each zone like (Source GA,
MS SQL Landing Zone, Staging Zone (Teradata) by checking for completion and
accuracy by applying technical and business analysis
o Count validations between source and virtual ODS Views, Design a flow for
count checking between original source, ODS and target DWH.
o The current data flow includes many rejections layers for data based on the quality
requirements for the DWH . m y role is to analyze, validate and extend the rejections rules based on business inputs.
Project : IGA
This is Internal Project which has more than modules like Sales connect, LCM, FDB.. etc
Responsibilities: (From 04-2012 Till 06-2016)
During this period my role in the project is as (Junior ETL Developer ) and my responsibilities as below :
o Design and develop applications using IBM InfoSphere DataStage (Designer,
Director, and Administrator) \[v8.x\].
o Develop ETL code to load the Enterprise Data Warehouses using relational
databases (DB2 Z/OS and MS SQL Server) applying transformations and business
rules as defined in requirements.
o Write shared containers, jobs, routines, and sequences to create an end to end
DataStage ETL framework.
o Design parallel ETL jobs using various stages like Transformer, Join, Merge,
Lookup, Remove duplicates, Filter, Datasets, Complex flat file, Modify,
Aggregator, XML.
o Design server ETL jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
o Monitor ETL job runs using DataStage Director to track the job flow.
o Perform troubleshooting of code and data issues. Understand and analyze the issue
and then work the fix and data recovery using DataStage and DBMS tools as
appropriate.
o Write SQL queries to extract the data from DB2 and SQL Server using multiple
joins and analytical functions for data analysis and testing.
o Implement change data capture (CDC) and slowly changing dimensions using
DataStage to complete full load refresh or delta loads.
o Deploy code into Production and QA Environment following established
procedures.
Project :https://www.egyptsunmarine.com/
Description : This is web site for online
booking system and mailing system
for clients from any place to book for atrip.
Role : analysis and designing the web site
from scratch including Database design and
analysis, and uploading the site on the server
and manage any required updates .
Technical Environment :
C# .Net Framework 4 .
SQL Server 2005
Company : trends-ad
Project : UNIVAl
Description : This is web site for UNIVAL is
one of the leading stockiest for Valves,
Fittings, Flanges and Pipeline Materials in
Egypt. Our customers include all the major
companies and contractors.
UNIVAL is the sole agent and distributor for
many international brands such as Hattersley,
TTU, BIS, OTB, MIFAB, Flex, Viking Johnson,
NABIC, etc
UNIVAL offers stock up to 24" in the
warehouses in Cairo and Free Zone in
Alexandria,
Role : developing according to Team Manager
assign Tasks and required updates from the
client .
Technical Environment :
C# .Net Framework 3.5.
SQL Server 2005
Project : Trendslc
Description : This is web site for trends to
manage peoples to apply online to carriers
Role : developing according to Team Manager
assign Tasks and required updates from the
client .
Technical Environment :
C# .Net Framework 3.5.
SQL Server 2005
Project : IOIE
Description : This is web site for helps you to
explore the Investment Opportunities in Egypt
for more than 20 Business Sectors.
Role : developing according to Team Manager
assign Tasks and required updates from the
client .
Technical Environment :
C# .Net Framework 3.5.
SQL Server 2005
Project : EgyTurk
Description : EGYTURK Is one of the
Egyptian-Turkish Group Companies, a leading
company in many areas and the most
important industrial area which is based in
this area by providing a lot of PRODUCTS
that help in various manufacturing processes.
Role : developing according to Team Manager
assign Tasks and required updates from the
client .
Technical Environment :
C# .Net Framework 3.5.
SQL Server 2005
Company : http://www.solidtechnologies.net/portal/
Project : Sanabel
Description : is a full integrated and
specialized package to help charity associations
to automate their manual work and save time
and money. It also helps to extract all the
needed data and information in an easy and
precise way.
Technical Environment :
C# .Net Framework 3.5 .
SQL Server 2000, 2005
Crystal Report
Project : Payroll
Description : Accurate Payroll provides an easyto-
use, accurate and secure Payroll solution with
all the features needed. It is an ideal solution for
any size and type of business and ensures that the
business is kept up-to-date.
Technical Environment :
C# .Net Framework 3.5 .
SQL Server 2000, 2005
Crystal Report
Project :General Ledger
Description : Accurate General Ledger module
provides you with comprehensive financial
accounting and management information across
multiple companies/divisions, currencies, and
reporting calendars. It stores and maintains
financial, statistical, and budgetary information
for summary, comparison, calculation, inquiry,
and reporting.
Technical Environment :
C# .Net Framework 3.5 .
SQL Server 2000, 2005
Crystal Report