Data Analyst
5X Data
مجموع سنوات الخبرة :2 years, 8 أشهر
Developed a robust and scalable data pipeline using Snowflake and dbt to enable efficient data
analytics. The project involved extracting raw data, transforming it using dbt, and moving the
processed data from a staging environment to production.
Successfully developed and deployed an end-to-end data pipeline that improved data
processing efficiency by 30%.
• Enhanced data quality and consistency across the organization by implementing robust dbt
tests.
• Reduced data pipeline execution time by 20% through performance optimizations.
Responsibilities -
• Designed and implemented automated Python scripts to securely connect to FTP servers, retrieve data files, and ingest them into
the organization's data engineering pipeline.
• Collaborated with cross-functional teams to understand data requirements and ensure the integrity and quality of ingested data.
• Leveraged PostgreSQL to perform complex data transformations, aggregations, and calculations, facilitating the creation of
meaningful measures and KPIs.
• Developed optimized SQL queries and stored procedures to streamline data analysis processes and improve query performance.
• Implemented data validation and error handling mechanisms to identify and address data quality issues during the ingestion
process.
Achievements -
The Data Ingestion and Analysis Pipeline Optimization project showcased expertise in developing end-to-end data solutions to
support business objectives. By implementing automated data ingestion processes and leveraging PostgreSQL SQL for advanced
analysis and calculation, significant improvements were achieved in data processing efficiency, accuracy, and reliability. The
project's success contributed to enhancing data-driven decision-making capabilities and driving business growth for organization.
Responsibilities -
• Involved in Data Ingestion from various different platforms into the Treasure Data Environment.
• Creating Master Data segment after Data cleaning with proper joins between the various ingested datasets.
• Defining the conditions and rules for checking onto multiples Customer Data segments as per our use case analysisto get
the desired output from the Analysis, like Churn rate and Bad debt Analysis.
• Sending various emails and push notifications via WhatsApp and personal message to the targeted customers in orderto
convey the desired message.
• Worked with the senior management on deciding on business performance metrics and analyzing the trend to
mitigate operational issues and risk.
• Reported on effectiveness of the risk actions to the project management and effected team members to ensure
operational efficiency
• Provided updates on project logs, monthly, quarterly and annual business reviews and other operations reviews.
Achievements -
• The Targeted customers were sent with the desired notifications which led to decrease in churn rate.
• The various teams like Finance, recovery and Marketing contributed together towards defining the rules on which to
target the customers and the final output helped the team to decrease fraudulent customer cases.