Highlights:

Skills:Data, SQL, Data Warehousing, Big Data, NLP, ML, Machine Learning, Engineering, python, java, aws, programming, Analytics

Senior Data Engineer 09/2016 - current
Intuit IDC, BENGALURU, Karnatakta India
Worked on various Data Warehousing, Personalization, Risk, Fraud, Business Intelligence related engineering solutions.
Currently working on Risk Analytics Platform using Spark,Kafka and Drools(Rules Engine) for both Real-time streaming data and batch processing. Requirements gathering, design, and implementation of ETL pipelines for MINT(Personalised Financial Platform) and workforce/ recruitment analytics. Migration of multiple ETL pipelines to AWS from private servers. Real-time Analytics using AWS Kinesis and Lambda on streaming data. Generic Data Ingestion Engine: Continuously Developing an extensible framework in python which enables ingesting data from multiple sources to the data warehouse(Vertica/S3). Data Parity Checker For AWS migration: Develop tools and scripts to ensure data movement to cloud and parallel pipelines in the cloud are reliable and stable. AWS EMR MapReduce Jobs to implement data filters to query application level encrypted fields for data security reasons. Hands-Free Operations: Developed a framework for running and monitoring multiple ETL pipelines and alerting when required by continuously monitoring logs from multiple sources. Data Insights: Worked in a team to produce valuable data insights for TurboTax. Communicating with various business groups for requirement--

IIIT Hyderabad 08/2011 - 07/2014
, , India
Degree: Bachelor's Degree
Major:Computer Science
Completed B.Tech in Computer Science.

Prateek Mehta