ETL Lead
NCR
مجموع سنوات الخبرة :19 years, 3 أشهر
Data warehousing, ETL and BI
I worked on multiple roles in last 4-1/2 years from ETL developer to team lead.I am currently leading ETL side and managing 5 resources under my domain. My current responsibility also includes supporting operation, BI, and database team.Other responsibilities includes
• Interacting with the business users and the BI team over the course of the project to ensure that the reporting can be done according to the requirements
• Gather and document business user requirements and translate these into process and system architecture designs.
• Task delegation to the team for ETL scripts, model implementation and its testing as well as leading overall technical effort for ETL development.
• Providing technical support to B.I team to understand source system and semantic layer.
• Providing P1 support to operation team in case of incident/anomaly.
• Conduct performance optimization analysis of ETL and Teradata database.
• Perform health checks and conduct capacity planning analysis on database.
Milestones:
• Automated loading of call detail records with the lag of hour in DWH which enables business user to perform hourly analysis on Ufone traffic.
• Developed and deployed various SLJM ETL Batches.
• Developed and deployed mini batch approach for data loading in EDW
• Developed and deployed file CDC for mini batch approach for data loading in EDW
• Developed automated recovery mechanism for SLJM in case of failure of an SLJM batch.
• Automated various DWH extractions & FTP’s using SLJM and SHELL
• Customized SLJM Wrappers (Schedule Load Job Monitoring). • Technical team lead of successful migration of ETL processes from IN upgrade to Online charging system (OCS).
• Designed real-time automated file recon process for OCS data loading.
• Implement file metadata information of each loaded file into EDW which helps operation team to validate and reconcile files with source system
• Designed and developed revenue and subscriber count aggregates to support Microstrategy(MSTR) based reporting.
• Developed a scalable and reusable parser in C to parse delimited files for sequenced and piped fastload.
• Successfully running ETL operation and Teradata database administration initially for two years at Ufone.
In SAS, I was trained on SAS products like SAS Enterprise Guide, SAS OLAP cube studio and SAS information map which are BI tools for reporting. I was also trained on SAS DI studio, SAS management console along with installation of SAS BI platform.
I work for multiple telecom projects such as Warid and Telenor, where I was trained to look and analyze data from business point of view. Gather and implement BI reports in SAS EG and SAS base. I was also looking after SAS administration task such as user profile management, taking repository backups and incorporate other databases and servers into SAS BI platform by using SAS management console. Trained business user on SAS EG tool. I was also done multiple POC for banking sector for sales team.
Projects:
1. Warid Telecom Pakistan
Part of SAS project from its solution discovery phase to planning, implementation, structuring, and administration. I was involved in the following task in the project.
• Designed and implemented a business Intelligence platform using SAS tools.
• Designed and populated aggregate tables with complete backend ETL process through SAS base coding.
• Implemented B.I reports, data marts and cubes using SAS enterprise guide and SAS OLAP cube studio.
• Create information maps for data marts and cubes for business users.
• Trained Warid resources on using SAS business Intelligence platform.
• Successful hand-over of installation and configuration of business intelligence platform.
• Implementing and managing administration task by using SAS Management console.
Milestone
• Able to use SAS business Intelligence platform tools which includes SAS enterprise guide, SAS Information Maps, SAS cube studio.
• Able to understand SAS base code which generated by SAS tools.
• Able to create basic jobs in data integration studio for data manipulation.
• Create three reports including its ETL which were assigned to me in the project. There were total 10 reports in phase 0.
2. Telenor Telecom Pakistan
In this project I was a coordinator and bridge between client and SAS offshore team to prepare data for SAS campaign management solution. I was involved in the following task in the project.
• Daily coordination between offshore team regarding their quires on data.
• Requirement gathering and analysis of data for SAS offshore team.
• Develop test use cases on recharge data.
• Develop ETL scripts and population of data mart in Teradata.
• Assisting QA team for unit and system integration testing of the system.
• Manage local resources on the project.
In Teradata, I was trained on Teradata utilities, ETL methodologies, physical and logical data modeling, writing SMX documents. I was also trained on Teradata administration tool such as Teradata manager and Pmon.
I was assigned on Mobilink project for two years and deployed on multiple roles from ETL developer to team lead and data base administrator. I was responsible for ETL development, creating source SMX document, writing ETL scripts by using TD utilities as per SMX, managing SLJM jobs and running ETL operation. I was also responsible for Teradata administrator task such as user profile management, space management, query and system optimization, and also monitoring active TD session by using Teradata Manager.
Projetcs:
Mobilink GSM Data Warehouse Project
PMCL Mobilink has awarded a data warehouse project to NCR, which includes the business intelligence application, data mining and CRM as the main
components attached to the data warehouse. I was involved in the following tasks in the project.
• Information sourcing activity for the analyze phase of the project to discover entire sources of the organization. This activity involved.
1. Understanding of Postpaid billing systems (JUPITER, GENEVA)
2. Understanding of IN system for Prepaid CDRs.
3.Understanding of CRM system deployed for event management.
4. Understanding of Mediation for streaming of Post Paid Calls,
International-roaming calls and for other operator calls.
5. Understanding of Financial Settlements with other Telecom operators.
• Source system and cLDM information mapping.
• Developed scripts, procedures and computer programs to transform and load data into DWH.
• Conducting detailed data quality analysis to analyze the impact of data on the data warehouse and BI application
• Responsible to operate call rating engine.
• Responsible for defining and configuring call tariff in rating engine module of Teradata DWH solution and then reconcile the tariff and revenue
• Develop and maintain documentation of developed scripts for rating engine.
• Implementing User level security by using Rolls, Privileges on OS, databases and application level.
• Backup/Archive and Restore using NetVault.
• Capacity analysis for hardware upgrades.
• Load Jobs customization and optimization.
• System Administration of ETL server and running its operation as well.