ETL Informatica Consultant
adecco
مجموع سنوات الخبرة :9 years, 3 أشهر
Project: Enterprise Data Platform Feb 2018 to Present
Client: Emirates NBD Bank
Description:
This projects about to load all Bank source system database (Oracle, Sql Server & files) into Hadoop Data lake through Informatica. Once they load data into Enterprise Data platform they will generate reports in Microsoft Power BI for business user's and top level management to do profitability analysis and take decision to increase monthly, quarterly and yearly revenue in terms of customer and products across all entities (UAE, EI, KSA, SINGAPORE, EGYPT, INDIA & LONDON) regions. Hadoop data lake will have different types of layers (TDV, RDV, EDS & FSDP) in order to satisfy business and secure systems with respective regions.
Role:
Performed following duties in this regard.
Played the role of a Technical ETL Lead and Senior Developer was responsible for complete designing and gathering requirements from clients.
Responsible for Business Requirement Documents BRD's or Functional Requirements converting into Technical Specifications
Participating in the Daily & Weekly Technical Integration Working Group meeting.
Worked on different OLTP data sources such as Oracle, SQL Server and Flat files for data extraction.
Create mappings employing various transformations, filters, joiners, lookup, SQL overrides etc to load data from multiple databases into Warehouses
Developed Slowly Changing Dimension Mappings for Type 1 SCD and Type 2 SCD
Creation of Sessions and Workflows to schedule these mappings.
Proficient in using Informatica workflow manager, workflow monitor, pmcmd (Informatica command line utility) to create, schedule and control workflows, tasks, and sessions.
Worked with DBA team to fix performance issues at Database.
Responsible for mentoring Developers and Code Review of Mappings developed by other developers
Responsible for best practices like naming conventions, Performance tuning, and Error Handling
Involved in sessions partitioning and mappings performance tuning.
Helping for downstream application if it is any data issue.
Perform unit testing of these Workflows from source to staging and staging to Datawarehouse
Involved in Unit testing and UAT defect fixing.
Reconciliation and evidence creation.
QA & Production deployment.
Worked with third party versioning tool GitHub for versioning
Technical Summary
Informatica Power Center 10.1, BDM -10.2, Work Flow Manager/Monitor, Hadoop, Oracle, Sql Server, Flat Files, Rhel 7.5, UNIX Shell Scripting
Project: Banking Datawarehouse Mar 2014 to Nov 2017
Client: ING Group
Description:
ING Group operations in the U.S are performed through ING. Group which provide large financial services to retail and institutional clients, which includes annuities, retirement plans, mutual funds, life insurance, direct banking etc. This project involved extraction of data from multiple sources and transform the data as per the business logic and is loaded into the data Warehouse which is finally used for reporting in Cognos.
Role:
Performed following duties in this regard.
As a Team Lead:
Played the role of a Technical ETL Lead was responsible for complete designing and gathering requirements from clients.
Responsible for Business Requirement Documents BRD's and converting Functional Requirements into Technical Specifications
Responsible in managing tasks and deadlines for the ETL teams both Onsite and Offshore.
POC for ETL team and other teams such as ETL, Reporting, Testing, QA and Project Management for updates on Project Status and issues.
Understand the Risk domain functionality, Enforcing project processes and policies
Break up the work into task list to Team members and estimate based on simple, medium and complex methodology
High level & low-level ETL flow design
Involving in conducting the review of Informatica Code, Unit Test Cases & Results with the Developers.
Organize daily technical discussions with the Onsite team also including the individual offshore work stream leads to set expectations for offshore delivery.
Participating in the weekly Technical Integration Working Group meetings
As a Developer:
Create mappings employing various transformations, filters, joiners, lookup, SQL overrides etc to load data from multiple databases into Warehouses
Extensively worked in data Extraction, Transformation and Loading from source to target system using BTEQ, Fast Load, and Multi Load & TPT.
Creation of Sessions and Workflows to schedule these mappings.
Creation of Unit Test cases and Integration test cases
Perform unit testing of these Workflows from source to staging and staging to Datawarehouse
Developed Slowly Changing Dimension Mappings for Type 1 SCD and Type 2 SCD
Responsible for mentoring Developers and Code Review of Mappings developed by other developers
Responsible for best practices like naming conventions, Performance tuning, and Error Handling
Reconciliation and evidence creation.
Analysis & fix on QA defects made by QA team.
Involved in Unit testing and UAT defect fixing.
Involved in sessions partitioning and mappings performance tuning.
Completely responsible for creating the framework models and publishes them to the Portal.
Creating various types of prompts in the prompt page.
Sorted, aggregated data in reports according to specifications.
Created Ad-hoc Reports and complex reports using Query Studio and Report Studio as per the user requirements.
Helping for downstream application if it is any data issue.
QA & Production deployment.
Worked with third party versioning tool StarTeam for versioning
Technical Summary
Informatica Power Center 9.5 Work Flow Manager/Monitor, Erwin 4.0, Teradata V13, Oracle, Sql Server, Sun Solaris 2.6, UNIX Shell Scripting, StarTeam 14.0, WINSCP, Cognos 8.4, MDM
Hexaware Technologies. May 2010 to Jun 2013
Senior Software Engineer
Project: AXA GI Japan May 2010 to Jan 2012
Client: AXA
Description: AXA group has started the direct business since 1992 in France by launching Direct Assurance Company. In addition, they have expanded into Germany, Spain, Japan and other markets. As part of Axa group in auto and pet insurance we have created new Datamart models from existing system (ICIS) to new system (API). Studied existing and new system attributes, entities and translated below some DWH Datamart models.
1. NB (New business)
2. Contract
3. Claim
4. Product
5. Partner
6. Campaign
Role:
Performed following duties in this regard.
❖ Involved in interacting with Business Analysts/Users to get requirements and translating them to functional definitions and ultimately to technical design and implementation.
❖ Performed data quality analysis, gathered information to determine data sources, data targets, datadefinations, data relationships, documented the business rules.
❖ Leading a team for building business logic in Informatica and Cognos.
❖ Data Analysis and derive the source system relationships
❖ Created DDL scripts for implementing Datamart and changes
❖ Mapping Design for the Initial Load and subsequent loads into staging area and from staging area Datamart
❖ Mapping developments done using Expression, Filter, lookup, Normalizer, Router, Union and Joiner transformations
❖ Reviewing Workflow, Session, Mapping Variable to run based on parameters without manual intervention
❖ Reviewing archival process for file once load successful with Windows Scripting
❖ Created Design Doc and Test case/data preparation, execution and verification of the test results
❖ Migrating the Mappings and sessions from Dev to Test, UAT and Production Environment and resolving the issues if any.
❖ Created Change plans for UAT and Production Environment.
❖ Created Sessions, Database connections and Batches
❖ Scheduling done in Informatica internal Schedule option.
❖ Done Performance Tuning of Informatica Mappings and Sessions.
❖ Completely responsible for creating the framework models and publishes them to the Portal.
❖ Creating various types of prompts in the prompt page.
❖ Sorted, aggregated data in reports according to specifications.
❖ Created Ad-hoc Reports and complex reports using Query Studio and Report Studio as per the user requirements.
❖ Helping for downstream application if it is any data issue.