Associate Data Engineer
Evamp & Saanga
Total years of experience :2 years, 11 Months
• Working in Spark, Tableau, MySQL
• Developed Spark Jobs using Python/Java APIs to
apply required transformations with respect to
required data models and save back the transformed
data to HDFS Warehouse Impala.
• Connect Kafka with Spark Streaming in Spark Java.
• Worked on Spark Dataframe APIs,
• Configure and Develop ELK with Filebeat for live data
Streaming,
• Used Log4j2 library to handle log files, Json files and
Audit Logs files.
• Flatten nested Json/Audit Files in Java Spark,
FSc Pre-Engineering