Data Integration Specialist
Wolters Kluwer
Total years of experience :35 years, 7 Months
• Performed Data Conversion and Migration from Legacy ERP system to SAP system.
• Developed ETL process and Data pipeline in AWS platform using EC2, S3, Athena, Talend, Redshift and SQL Server.
• Re-designed database objects, indexes, constrains and enhanced database performance.
• Developed Talend ETL job and integrate data from different source system (Oracle DB, SQL Server DB, JSON and csv files etc) into AWS platform using S3, Athena and Redshift
• Extended support to QA and UAT team to perform necessary fixing.
• Re-designed database objects, indexes, constrains and enhanced database performance.
• Monitor and review bugs and fixed the bugs as per QA observation.
• Design, develop and model migration of ERP System from Oracle to SAP.
• Extended support to QA and UAT team to perform necessary fixing.
• Developed talend job and integrate diferent data source in diferent file.
• Developed ODI knowledge module, interfaces, packages and scenario to integrate new e-buisness data model.
• Developed mapping and updated ETL follow of Informatica.
• Re-designed database objects, indexes, constrains and enhanced database performance.
• Monitor and review bugs and fixed the bugs as per QA observation.
• Extended support to QA and UAT team to perform necessary fixing.
• Develop PySpark code to migrate SAS job to Hadoop using Python, Spark, Spark-QL and Hive QL
• Develop UDF and class(library) to optimize development for repetitive task used in SAS scripts
• Develop Python script to extract data from different source, transform data and load the data in Hive.
• Ensure proper QA and documentation (metadata, runbook and code documentation)
• Develop, Optimize and perform change management in ELT (Extract, Load and transformation) process using, PySpark, SQL, PL/SQL, Spark-QL and Hive QL
• Developed Azure Pipelines, ETL development, data pipelines, workflow orchestration and data ingestion, transformation, and movement.
• Integration of Azure platform with Salesforce Cloud to develop POC.
• Develop PySpark code to migrate SAS job to Hadoop using Python, Spark, Spark QL and Hive QL.
• Develop UDF and class(library) to optimize development for repetitive task used in SAS scripts.
• Develop Python script to extract data from diferent source, transform data and load the data in Hive.
• Ensure proper QA and documentation (metadata, runbook and code documentation)
• Develop, Optimize and perform change management in ELT (Extract, Load and transformation) process using, PySpark, SQL, PL/SQL, Spark-QL and Hive QL
• Perform sprint planning session and story complexity calculation and story assignment.
Developed Data Streaming using AWS Kinesis and Spark Streaming to capture and report user experience using porter website
•Drive discussions with business users to review or solicit reporting/analytical requirements
•Completed projects: Preference Centre, Porter Pass and PNR history.
•Developed test cases, performed unit testing, integration testing, UAT and production deployment
•Designed application for data extraction, data streaming, data processing, and integrated with ETL
• Developed ETL using SSIS, SQL/PLSQL, Python, Matillion, SQS, Lanmbda and Redshift.
• Design, develop and deploy data mart using SSAS for SSRS and tableau.
• Developed Analytics model and visualization using Python (Pandas, SciPy, matplotlib etc )
• Maintained and supported Microsoft SQL Server, Oracle and Redshift DB on AWS
• Ensured data/schema/instance backup, partitioning and tuned performance.
• Developed Python script in Matillion to process file and load the file in Redshift DB
• Co-ordinate with QC and application/web development team to explain data architecture, data model and business logic behind the model to perform qc and eficient data use.
• Performed system testing, integration testing, regression testing and acceptance testing new/existing reports deployment.
• Performed ad-hoc investigation on data and report discrepancies
•Developed model for customer usage prediction using Linear regression to ensure power supply
•Developed ETL for project management tracking dashboard using SSIS and SAPBODS
•Developed reports using SAP BO, Crystal report, Webi reports and Tableau.
•Design Complex BI solutions and reporting based on functional requirements.
•Developed Reconciliation report for Wholesale settlement using Crystal Report.
•Developed Corporate Finance Report using SAP Webi and Lumira
•Developed ETL to extract data from Oracle CC&B to develop reports for customer usage
•Developed report for OEB rating reconciliation and predict total energy usability.
(Client : Sasktel, Regina, Saskatchewan, Canada)
Capgemini, California, USA
•Profiled data, Designed, developed, deployed and configured Master and Work repositories, physical architecture, logical architecture, Standalone agent, import knowledge modules and security
•Integrated cloud application technology to Integrate Salesforce Cloud with ODI 12C
•Integrated systems (ODS, Accounts, Billing etc) with Salesforce (cloud) by reverse engineering models, developing Interfaces, procedures and packages (ODI 12C)
•Generated scenarios from Packages and scheduled using standalone agent (ODI 12C)
• Developed model for customer usage prediction using Linear regression to ensure power supply
• Developed ETL for project management tracking dashboard using SAPBODS
• Developed reports using SAP BO, IDT, Crystal report, Webi reports and Tableau.
• Design Complex BI solutions and reporting based on functional requirements.
• Developed Reconciliation report for Wholesale settlement using Crystal Report.
• Developed Corporate Finance Report using SAP Webi and Lumira
• Developed ETL to extract data from Oracle CC&B to develop reports for customer usage
• Developed report for OEB rating reconciliation and predict total energy usability.
• Profiled data, Designed, developed, deployed and configured Master and Work repositories, physical architecture, logical architecture, Standalone agent, import knowledge modules and security
• Integrated cloud application technology to Integrate Salesforce Cloud with ODI 12C
• Integrated systems (ODS, Accounts, Billing etc) with Salesforce (cloud) by reverse engineering models, developing Interfaces, procedures and packages (ODI 12C)
• Generated scenarios from Packages and scheduled using standalone agent (ODI 12C)
• Defined department target, strategy, planning and budgeting to accommodate stakeholder requirements
• Led GIS based project (Geo-marketing) to report cell/Site level Business and network KPIs
• Worked as Data Architect, System architect, business analyst and developer during OCDM (Exadata) project implementation. Later took initiatives to tune performance of the system.
• Developed statistical data models for Customer Churn prediction, Customer Segmentation, Next Best action and performance tuning
• Developed BTS re-parenting and BTS failure prediction model by analyzing traffic congestion, revenue generation and customer density
• Developed predictive traffic model and fault prediction using time series analysis (FFT)
• Identified fraudulent activities in sales commissioning bonus and developed solution to prevent
• Identified and developed KPI metrics to ensure positive customer experience.
• Developed and deployed Big Data Solution to resolve issue of loading UDC dump in JSON format.
• Predict and Managed budget ensuring proper and formal training arrangement of the team(s)
• Major projects managed -
◦ OCDM implementation (Oracle) - budget US $5 Million
◦ Revenue Assurance system implementation (SUPRA) - budget US $2.2 Million
◦ Analytics system implementation (SAS) - budget US $700, 000
◦ Corporate Management Dashboard (SSIS, SSRS, Power BI) - budget US $700, 000
◦ GIS system implementation (using ESRI arc Map and Galigeo) - budget US $400, 000
◦ Interconnect billing system (EMM, PL/SQL + ODI) - budget US $150, 000
◦ Network Model predictive analytic (Big Data) - budget US $150, 000
• Defined department target, strategy, planning and budgeting to accommodate stakeholder requirements
• Designed, developed and deployed Hadoop platform to integrate with HLR/UDC system and managed day to day operations
• Led GIS based project (Geo-marketing) to report cell/Site level Business and network KPIs
• Worked as Data Architect, System architect, business analyst and developer during OCDM (Exadata) project implementation. Later took initiatives to tune performance of the system.
• Developed statistical data models for Customer Churn prediction, Customer Segmentation, Next Best action and performance tuning
• Developed BTS re-parenting and BTS failure prediction model by analyzing trafic congestion, revenue generation and customer density
• Developed predictive trafic model and fault prediction using time series analysis (FFT)
• Identified fraudulent activities in sales commissioning bonus and developed solution to prevent
• Identified and developed KPI metrics to ensure positive customer experience.
• Developed and deployed Big Data Solution to resolve issue of loading UDC dump in JSON format.
• Predict and Managed budget ensuring proper and formal training arrangement of the team(s)
• Major projects managed -
OCDM implementation (Oracle) - budget US $5 Million
Revenue Assurance system implementation (SUPRA) - budget US $2.2 Million
Analytics system implementation (SAS) - budget US $700, 000
Corporate Management Dashboard (SSIS, SSRS, Power BI) - budget US $700, 000
GIS system implementation (using ESRI arc Map and Galigeo) - budget US $400, 000
Interconnect billing system (EMM, PL/SQL + ODI) - budget US $150, 000
Network Model predictive analytic (Big Data) - budget US $150, 000
• Deployed and managed technical operation of Analytics process (Market Share, Profitability, Churn prediction, Network performance and Forecasting)
• Saved annual OPEX of $120, 000 by taking over Operation and “ETL re-engineering”
• Identified 99% of errors in reports by establishing QC process
• Developed, deployed, tuned performance and performed daily operation of ETL Process
• Developed dashboard and new reports using OBIEE and managed users access
• Deployed analytics system for churn prediction, network performance and profitability
• Deployed Sales force BI (Business Intelligence part) using ODI 11g, was responsible for data transformation inside Sales force and returned (Load) the processed data into Reporting system
• Negotiated and worked with different third party/Vendors to implement approved projects
• Led a team of 7 team members, mentored the team, managed conflicts and expectations
• Deployed and managed technical operation of Analytics process (Market Share, Profitability, Churn prediction, Network performance and Forecasting)
• Saved annual OPEX of $120, 000 by taking over Operation and ETL re engineering
• Identified 99% of errors in reports by establishing QC process
• Developed, deployed, tuned performance and performed daily operation of ETL Process
• Developed dashboard and new reports using OBIEE and managed users access
• Deployed analytics system for churn prediction, network performance and profitability
• Deployed Sales force BI (Business Intelligence part) using ODI 11g, was responsible for data transformation inside Sales force and returned (Load) the processed data into Reporting system
• Negotiated and worked with diferent third party/Vendors to implement approved projects
• Led a team of 7 team members, mentored the team, managed conflicts and expectations
•Developed new control which saved 1.5% of annual revenue in 2007
•Performed data quality & consistency check and ensured the interim period CDR rating, barring and unbarring during Billing System migration from BSCS VI to BSCS IX - which prevented 450, 000 post-paid customers from over usages
•Automated Post-paid billing system QC which results 4 hours of manual operation (daily)
•Automated HLR reconciliation process - saved weekly 12 hours of manual work
•Developed process to reconcile Blackberry service to ensure minimum gap in subscription, payment and invoice
• Developed new control which saved 1.5% of annual revenue in 2007
• Performed data quality & consistency check and ensured the interim period CDR rating, barring and unbarring during Billing System migration from BSCS VI to BSCS IX - which prevented 450, 000 post-paid customers from over usages
• Automated Post-paid billing system QC which results 4 hours of manual operation (daily)
• Automated HLR reconciliation process - saved weekly 12 hours of manual work
• Developed process to reconcile Blackberry service to ensure minimum gap in subscription, payment and invoice
courses: Certificate in Data Analytics, Big Data, and Predictive Analytics (Continuing)