Senior Machine Learning Engineer
Confiz Limited
Total years of experience :4 years, 0 Months
Led and managed a team of machine learning engineers in generating forecasts of markdowns.
•Collaborated closely with the Data Science team to analyze their work from an ML engineering perspective.
•Designed and constructed a reproducible ML pipeline, including its architecture, to track artifacts and ensure scalability.
•Implemented data profiling and data quality checks at each step of the pipeline to ensure accurate results.
•Developed and managed ETL jobs for seamless delivery of forecast data to the business team. Made substantial contributions to establishing and achieving the goals of the ML Competency.
Maintained and optimized a customized PySpark pipeline to train over a million time series models for generating forecasts.
•Designed and implemented custom model registry modules by leveraging API calls for efficient model binning and registration.
•Utilized industry best practices to orchestrate the pipeline for automated execution, while implementing continuous integration forthe ML pipeline codebase.
•Designed and developed multiple ETL jobs to seamlessly share pipeline results with the business intelligence team, resulting in a significant 95% improvement in runtime.
Wrote efficient REST APIs which are being used by more than million clients daily, with an average response time of less than 300 milliseconds.
•Designed & implemented architectures to migrate legacy systems to a micro-services framework with state-of-the-art technologies like Spring Boot, Kafka, Docker, Azure cloud, etc.
•Made services production-ready by writing integration tests, logging, and integrating dashboards; such as Splunk, for monitoring and alerting.
•Involved in planning, proposing, and delivering POC for new features.
Worked as a teacher assistant forthe course of web development.
•Helped the Professor with marking students' grades.
•Assisted and evaluated students in the course labs and term project.