Noelia Carrion

Developed Databricks lakehouse pipelines and scheduled Jobs for batch and
incremental data processing.
Designed and implemented ETL pipelines and data architectures in Python and Spark
on Azure, integrating diverse data sources and APIs to disambiguate author identities
and improve data quality.
Optimizedworkflowsandqueriesbynormalizingdata, improvingSparkjobs, and
adjustingresourcesforbetterperformance.
Maximized the contactable audience through robust data quality processes and
accurate identity resolution.
Shaped technical proposals with stakeholders, aligning initiatives with business goals
and defined OKRs.
Mentoring and support forjunior developers within the team, promoting best
development practices.

Performed data analysis and exploration using SQL creating queries, reports, and
insights to support business decisions and validate pipeline outputs.
Applied unit testing and basic monitoring to ensure pipeline reliability.
Extensively used Python for data transformations and automating operational tasks
within pipelines and notebooks.

Development of Spark processes using Python
Coordination of developments and client migrations
Processing and treatment of data in AWS and Azure
Design and implementation of ETL processes, data modeling, and SQL scripts
24/7 support for incidents and Python developments for a Spanish airline

Python scripts
Programming workshops and webinars
Supervising Data Analytics projects