Hello,
I am an experienced Big Data Developer having expertise in various big data technologies (please have a look at my profile). I have designed, developed and implemented projects which include Creating Sqoop jobs to import data to HDFS, designing and maintaining Hive Managed and External tables, reading data to spark from various sources such as Hive tables, local file systems, cloud, kafka and kinesis, processing of the data using Spark SQL and DML to meet the business requirements and writing the data to various file formats, Hive, NoSQL DBs and locations using both Scala Spark and PySpark. I also have worked on Spark streaming and Spark Structures streaming projects as well.
I am excited to work on this assignment. Please drop me a message so that we can discuss further in the requirements and come up with an action pan.
Thank you.!