Sumit Khanna

Responsibilities:
• Real-time data pipelines to feed rule engines / kafka / hdfs persistence layers.
• Maintaining and Monitoring Elastic Search Clusters to back Search / Business Dashboards.
• A Reporting Panel to assist users with ETL, daily reporting. Learnings:
• Django, Nginx, Docker, Azkaban, JQuery, Bootstrap - full stack for a scalable Reporting Panel.
• Usual experiments with E L K Stack, nuances of Hbase / Cassandra

Responsibilities:
• Worked on E L K (ElasticSearch, Logstash, Kibana) stack to accumulate and modify various logs and index them in ElasticSeach.
• Developed a data pipeline to support ETL for many-to-many data source (e.g Kafka, API end points, Relational Databases) - sinks (e.g Kafka, HDFS / Hive, Druid).
• Occasionally composed daily chores Scripts / APIs / Services for reporting mails, alerts, Visualizations etc for Data Analytics, full stack web development on internal tools. Learnings:
• AngularJS, d3.js, HTML / CSS, Twitter Bootstrap for front-end - data pipeline.
• Hefty Scala / Spark API Programming for general ETL, mirroring and Streaming logs from sources to HDFS / Kafka topic sinks - data pipeline.
• Flask / Tornado / Backbone.js for internal tools / RESTful APIs.