Pyspark job - 1000 gz files with 1m json objs of 6KB each to 1B files in s3

₹600-1500 INR

În desfășurare

Data postării:

peste 2 ani în urmă

₹600-1500 INR

Plata la predare

Hi, I need help to execute a pyspark job. I need to process them. I have 1000 gz files with 1m json objs of 6KB each which we need to convert to 1B json files and save in s3

PySpark

ID-ul proiectului: 32284277

Despre proiect

2 propuneri

Proiect la distanță

Activ: 2 ani în urmă

Vrei să câștigi bani?

Adresa de e-mail

Avantajele de a licita pe platforma Freelancer

Stabilește bugetul și intervalul temporal

Îți primești plata pentru serviciile prestate

Evidențiază-ți propunerea

Te înregistrezi și licitezi gratuit pentru proiecte

Acordat utilizatorului:

@ashishdudeja1994

I have done work in pyspark extensively. Alternatively we can use multithreading or multiprocessing also in python to achieve this. Let me know. I am really interested in this job. I am currently working as a Senior Data Engineer in an IT Company. I'm offering best quality and highest performance at a price we are both comfortable with. I can complete your project on time and your will experience great satisfaction with me. I'm well versed in Python,SQL,Unix Scripting, Excel VBA etc I have rich experienced in Word, PDF, Data Processing, Data Entry, Web Scraping. For more information about me, please refer to my portfolios. I'm ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details Thank you! Ashish Dudeja

₹1.300 INR în 7 zile