Need a AWS Data Engineer with skilled in Scala, ECS, MSK, EMR

Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg

▪ Experience in AWS Security: Created and Managed IAM roles, users, groups, policies, generated credential report for analysis ▪ Creation of Auto Scaling groups (ASGs) from custom or pre available AMIs, by creating launch templates for provisioning elastic applications. ▪ Knowledge in DNS management in Route53, creation of private and publichosted zones and records for public and intranet applications. ▪ Knowledge of serverless computing AWS LAMBDA and Azure functions ▪ Knowledge of DevOps practices and toolset along with CI/CD delivery model and capable of engineering and architecting client-server virtual systems with a focus on security and high availability. ▪ Delivering infrastructure services (IaaS, PaaS, SaaS), robust and reliable systems through rapid adaptation of technology capabilities, team motivation, and collaborative work with business partners(Amazon. ▪ Experienced in AWS Management tool (Cloud Formation, CloudWatch, CloudTrail, Config, OpsWorks, Service Catalog, Trusted Advisor) ▪ Lead the preparation activities ofrelease, change, incident, service request and problem management. ▪ Exposure in disaster recovery, asset, configuration and availability management, promising enhanced performance.

Hello i will like to participate in the project. I share you some of my selected experience. - Deployment in Azure using Spark (Scala) for KPIs development with Data Bricks in Synapse Analytics - Data engineering role, developing scripts in python using the elasticsearch API to perform data enrichment for identity resolution. -​ Deployment of crawlers as an API using Lambda, API Gateway and Cognito. - Data engineer role, Star modeling and Data Warehouse development, with SAP sources and manual ingests I wait your answer. Thank you

Hi, I have 8+ years of experience in bigdata including spark with scala,hive,impala . Please ping me to discuss further.