Senior Data Engineer
Coda Payments
مجموع سنوات الخبرة :9 years, 7 أشهر
● Reduce Fraud Loss and Disputes by productionizing realtime Machine Leaning models for Mobile Wallets and Cards.
● Increase revenue by delivering high quality data and insights to stack-holders (Marketing, Sales, Product and experiment).
● Improve lead time and reduce cost of development tools for Data Scientists by implementing a unified development environment instead of using managed services in AWS.
● Maintaining and improving existing ETLs and enhancing the data warehouse by creating new datasets.
● Created multiple data ingestion pipelines to extract, transform and load structured and unstructured data from multiple sources.
● Working closely with Data Science team to create ML based linking workflows.
● Created monitoring platform for data pipelines for observability.
● Improved performance and resilience of latency critical ETL workflows by migrating them into Autosys from Sql Server Agent.
Contributed software engineering expertise in the development of Java based distributed, multi-tiered, modular Oil & Gas exploration solution (DSIS-Decision Space Integration System).
● Developed and extended existing database connectors for Oil & Gas exploration and production solutions, OpenWorks, Recall and Petrel.
● Developed data migration utility using TEIID to transfer geophysical data between existing products using a common model.
Participated in multiple R&D tasks in the development of distributed NoSQL database (NosDB).
● Developed SQL like Query System to query JSON based documents in database.
● Implemented distributed JOINs using MapReduce and One Bucket Theta JOIN.
● Achieved 50% performance gain of distributed joins by implementing hash-based comparison for equality and interval tree for range-based evaluation.
● Played key role in development and maintenance of distributed and clustered cache (NCache).
● Implemented SNMP and JMX based monitoring tool for clustered cache in Java.
لقد تم حذف الرابط بسبب انتهاكه لسياسة الموقع. يرجى التواصل مع قسم الدعم لمزيد من المعلومات.