محمد Kanthaliya

serverless architectures using AWS Lambda & Glue,
reducing infrastructure costs by 25%
•
◦ Built and managed Apache Airflow DAGs for orchestration,
improving pipeline reliability and automation efficiency by 40%
•
◦ Strong expertise in PL/SQL, HiveQL, Spark SQL, complex queries and reducing execution time
significantly
•
◦ Built and optimized data pipelines using Databricks (Apache
Spark) for large-scale data processing, achieving significant
improvements in performance and scalability
•
◦ Utilized Databricks notebooks, Delta Lake, and Spark SQL for transformation, and reliable engineering
workflows real-time batch ingestion pipelines
Sqoop, Flume, services