Mia Wang

Achievements
¨ Reduced job execution time from 2 hours to 20 minutes
¨ Designed Pypspark framework for Data ingestion, used the framework ingested Nest JSON files
¨ Designed and developed more than five enterprise-level consolidated datasets
¨ AI Prompt to fine-tune language models and extracted valuable insights from unstructured data.
Key Responsibilities
¨ Lead the end-to-end design and implementation of pipelines in Azure Data Factory (ADF) and data warehousing solutions in Azure Synapse.
¨ Perform daily monitoring of ADF pipelines and Data Warehouse ingestion processes, proactively identifying and resolving issues as necessary.
¨ Ensure the optimal performance and reliability of the data architecture within the Azure Cloud environment.
¨ Design and develop conceptual, logical, and physical star schema and normalized data models to support data management and analytics requirements.
¨ Collaborate closely with data scientists and business stakeholders to deliver AI-driven solutions that drive business insights and decision-making.
¨ Develop and maintain comprehensive documentation for data engineering processes, systems, and solutions to ensure knowledge transfer and compliance with best practices.