Associate Data Engineer
Evamp & Saanga
Total des années d'expérience :3 years, 0 Mois
• Working in Spark, Tableau, MySQL
• Developed Spark Jobs using Python/Java APIs to
apply required transformations with respect to
required data models and save back the transformed
data to HDFS Warehouse Impala.
• Connect Kafka with Spark Streaming in Spark Java.
• Worked on Spark Dataframe APIs,
• Configure and Develop ELK with Filebeat for live data
Streaming,
• Used Log4j2 library to handle log files, Json files and
Audit Logs files.
• Flatten nested Json/Audit Files in Java Spark,
FSc Pre-Engineering