زبير شمس

Associate Data Engineer في Evamp & Saanga

• باكستان - إسلام أباد
• أشغل هذه الوظيفة منذ يونيو 2021

• Working in Spark, Tableau, MySQL
• Developed Spark Jobs using Python/Java APIs to
apply required transformations with respect to
required data models and save back the transformed
data to HDFS Warehouse Impala.
• Connect Kafka with Spark Streaming in Spark Java.
• Worked on Spark Dataframe APIs,
• Configure and Develop ELK with Filebeat for live data
Streaming,
• Used Log4j2 library to handle log files, Json files and
Audit Logs files.
• Flatten nested Json/Audit Files in Java Spark,