Find Jobs
Hire Freelancers

High-Performance Data Pipeline Creation

₹12500-37500 INR

Închis
Data postării: circa 1 lună în urmă

₹12500-37500 INR

Plata la predare
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependencies, and functionality. Working closely with data engineers to develop a migration strategy for converting pipelines from the current framework to the target framework. Designing, building, and testing new data pipelines in the target framework, ensuring they meet or exceed existing performance and reliability standards. Debugging and troubleshooting issues that arise during the migration process, working collaboratively with cross-functional teams to resolve them quickly. Communicating progress, challenges, and timelines to stakeholders on a regula Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framework fluency
ID-ul proiectului: 37972883

Despre proiect

10 propuneri
Proiect la distanță
Activ: 4 zile în urmă

Vrei să câștigi bani?

Avantajele de a licita pe platforma Freelancer

Stabilește bugetul și intervalul temporal
Îți primești plata pentru serviciile prestate
Evidențiază-ți propunerea
Te înregistrezi și licitezi gratuit pentru proiecte
10 freelanceri plasează o ofertă medie de ₹25.530 INR pentru proiect
Avatarul utilizatorului
With a diversified skill set in research and technical writing, your project will benefit from my meticulous attention to detail and logical thinking. As a computer science degree holder and a certified Project Manager, I have spent over 5 years honing my skills in areas closely aligned with your requirement for this role. These include database management, software analyses and design, Python programming, and software engineering – not to mention my proficiency with the associated Big Data infrastructure. I pride myself on delivering excellent services and building good relations with clients, values that strongly align with your freelance project. By choosing me as your Data Engineer, you're choosing quality work that's time-conscious, reliable, committed, honest - just like your project deserves. It would be an honor to have the chance to contribute my expertise on this crucial migration project for your organization. Let's create better data pipelines together!
₹25.000 INR în 7 zile
4,6 (5 recenzii)
3,6
3,6
Avatarul utilizatorului
I have rich experience in building the data pipelines in PySpark in AWS Glue environment, would be suitable for this role.
₹25.000 INR în 7 zile
5,0 (5 recenzii)
2,8
2,8
Avatarul utilizatorului
Here is a Telecommunication Engr will provide you a 100% satisfactory work. I have already worked on a lot of projects relating PYTHON, PANDAS, DJANGO, PYSPARK, NUMPY, PYTORCH, TENSORFLOW, THEANO, APACHE SPARK, PYGLET, KERAS, SCIPY, MLPACK, DLIB, FASTEXT, OpenCV, ALGORITM, C Programming, SQL, JAVA SCRIPT, DATA MINING, REACT, HTML, ASP.NET, NODE.JS and MACHINE LEARNING as main skills. Feel free to contact Regards Alihussain
₹45.000 INR în 5 zile
5,0 (1 recenzie)
3,0
3,0
Avatarul utilizatorului
Hello Ats A., Glad to say that we have already done a similar project before, would you like to see it? We already have similar experience in the same domain. We are an expert team which have 4 years of experience on Python, Data Processing, Scala, PySpark, GCP AI Lets connect in chat so that We discuss further. Regards
₹28.800 INR în 7 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
EXPERT IN ((PySpark, Scala, Data Processing, GCP AI and Python)) DEAR EMPLOYER, I’ve completed the exact same projects before successfully((ProjectTitle)). Awarding me will be the fastest way to complete your task with the best rates possible. I CAN ASSURE YOU 100% THAT WE ARE FULLY CAPABLE OF EXECUTING ANY LEVEL OF TASK/PROJECT BASED ON THE SKILL REQUIRED. I am fully confident about our skills and my understanding of the project description and we are ready to go through any test or sample task you assign to acquire your trust. Let me know when are you available for an initial 15-30-minute discussion (FREE OF CHARGE) so we can discuss the requirement in detail and I can walk you through the mentioned systems to acquire your trust in my skill. REST ASSURED YOUR WORK IS IN VERY SAFE AND PROFESSIONAL HANDS. THANK YOU
₹12.500 INR în 2 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
As a seasoned Data Engineer with an established track record in migrations and proficient in Big Data frameworks, I'm confident that I possess the essential skillset your project demands. I have an extensive and proven knowledge of Scala, Python, and Spark, which will be instrumental in efficiently migrating your legacy data pipelines to the target framework. My fluency with other tools like Airflow, GCP including GCS, Dataproc would further enhance the migration strategy. I have successfully executed similar projects before and consistently strive to surpass performance and reliability standards. By understanding the intricacies of your existing pipelines and having worked with Scalding framework previously, I am well-positioned to not just migrate but improve on their performance in Spark Scala. Moreover, my sharp troubleshooting skills coupled with effective collaboration would ensure swift resolutions when any migration issues arise. Most importantly, I understand the value of effective communication throughout a project's lifecycle - from keeping stakeholders informed about progress to addressing their concerns promptly. Thus, if given this opportunity, be assured of well-encrypted high-performance data pipelines that'll scale impeccably for your business needs. I look forward to leveraging my expertise for an impactful execution of your project.
₹25.000 INR în 7 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
Hi, I hope this message finds you well. I recently came across your job postingand was immediately intrigued. With a strong background in Python development, I am enthusiastic about the opportunity to contribute to your team. I have extensive experience crafting robust solutions and deploying them across various platforms. Having successfully completed similar projects for clients in my area, I am confident in my ability to tackle your project head-on and deliver results within your specified timelines. I am eager to bring my proficiency to your team and make meaningful contributions to your projects. Thank you for considering my application. I look forward to the possibility of discussing how I can be of assistance. Best regards, Atiksh
₹30.000 INR în 30 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
DATA ENTRY I have proven experienced in data entry or similar roles. I have an excellent typing speed and accuracy, proficient in using Excel and also have an experience.
₹14.000 INR în 6 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
We are thrilled to submit our bid for the Data Engineer contractor role focused on migrating data pipelines from legacy infrastructure to modern frameworks. Our team is equipped with the expertise and experience necessary to seamlessly transition your pipelines to Spark Scala, ensuring enhanced performance and reliability.
₹25.000 INR în 15 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
I am currently working as a data engineer in syren cloud. Handling large number of data pipelines and maintaining ETL process. I am best suits for this role.
₹25.000 INR în 7 zile
0,0 (0 recenzii)
0,0
0,0

Despre client

Steagul INDIA
Nagercoil, India
0,0
0
Membru din apr. 8, 2024

Verificarea clientului

Mulțumim! Ți-am trimis prin e-mail linkul pe care trebuie să-l accesezi pentru a revendica creditul gratuit.
A apărut o eroare la trimiterea e-mailului. Încearcă din nou.
Utilizatori înregistrați Totalul proiectelor postate
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Se încarcă previzualizarea
S-a oferit permisiunea de depistare a locației.
Ți-a expirat sesiunea pentru conectare sau te-ai deconectat. Conectează-te din nou.