PySpark Jobs

I have a dataframe where I need to convert rows of the same group to columns. basically pivot these. below is my df. +------------+-------+-----+-------+ |Customer |ID |unit |order | +------------+-------+-----+-------+ |John |123 |00015|1 | |John |123 |00016|2 | |John |345 |00205|3 | |John |345 |00206|4 | |John |789 |0...

Hello everyone, I will need an expert to do an easy task for today for $10USD 1. Convert my 2.3 spark sql to 2.4.2 2. Add the context (name app ) at the start (and remove scala>) so it is not ran on interpreter but on compiler 3. add parcels insteads of other dataframes where needed 4. run the tasks and send me the logs

Hello everyone, I will need an expert with knowledge of databases and web services to complete some tasks until 6/3/[conectează-te pentru a consulta linkul URL] $70 USD I will send data and analytical details on chat, including step-by-step directions regarding the requirements and links for everything (all in one wordfile)!! Requirements: 1. Good knowledge of Spark SQL, RDD & Dataframe AP...

Hi Expert, I am learning Bigdata PySpark. I come from ETL Background. I need to implement SCD 1 & 2 Logic in Hive & PySpark. This is not project requirement but for my learning purpose. Looking forward to meet good technical people to help me in above learning.

Hi, Urgently need data engineer with Pyspark and Aws, java aws sdk( especially dynamodb),kubernetes Let me know if interested