12+ years of overall experience in the IT Industry which includes experience in Big data, Java, Python, Snowflake, and AWS technologies which are Spark, Scala, Hadoop, Hive, Pig, Sqoop, Kafka, Kinesis, Gobblin, Python and AWS core services, Microservices, docker.
After 7 years of Java web application development experience, I worked on the below bigdata projects
1. PBM Data lake: Data Ingestion using Nifi
2. RXGuide[Sencha UI + Spring Boot Microservices + Elastic Search]: In AWS Cloud, s3/Hive data transformed with spark and loaded to Elastic search.
3. Smart PCP: HIve Data transformed with spark and loaded to SQL Server for Microservices API calls.
4. SAS to Spark conversion which is in progress. Key Achievements: Worked on optimization of complex joins, spark 1.6 to spark 2.2 migration.
5. IoT wearable data lake (Spark Streaming, Kafka, and MongoDB)
6. Teradata/SQL server to Hadoop Data Ingestion using Spark
7. DataStage to Hadoop migration project.
I also completed a handful of freelance assignments and project support assignments during the last couple of years.