Find Jobs
Hire Freelancers

Need Experienced Hadoop, Kafka, Spark Consultant & Architect

min $50 USD / hour

Închis
Data postării: peste 5 ani în urmă

min $50 USD / hour

Hi, We need Hadoop, Kafka, Spark consultant that have extensive real world production experience of deploying such system in DC/OS. The job will be advising our engineer to use industry best practice development and deployment of such system. The job include: - Architecture design/consultantion - Use case scenario/best practice - Design/algorithm review - Code review - Pair programming with our Engineer We are based on GMT+7 timezone so regular meeting/coaching schedule is necessary. Our expectations is bringing 2-5 different consultant with minimum 10 hour per week.
ID-ul proiectului: 17572881

Despre proiect

21 propuneri
Proiect la distanță
Activ: 6 ani în urmă

Vrei să câștigi bani?

Avantajele de a licita pe platforma Freelancer

Stabilește bugetul și intervalul temporal
Îți primești plata pentru serviciile prestate
Evidențiază-ți propunerea
Te înregistrezi și licitezi gratuit pentru proiecte
21 freelanceri plasează o ofertă medie de $53 USD/oră pentru proiect
Avatarul utilizatorului
Hello, I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Kafka, Spark, Cassandra, Hive/HBase, ELK stack using Java, Scala and Python. Can we further talk in details? Thank you!
$55 USD în 40 zile
4,9 (49 recenzii)
5,5
5,5
Avatarul utilizatorului
Hi I am a data engineer with 4+ years of industry experience. I have been working on data analytics, big data and data warehousing solutions both on-premises and on clouds. I got expertise in following areas. 1. Spark pipelines for Data lakes solutions in AWS with EMR and datapipelines 2. Data validation, profiling, processing etc with Spark 3. Spark with Nifi and Kafka for twitter streaming applications 4. Adhoc reporting solutions using AWS EMR and Hive. 5. Hortonwork Data platform and hortonwork data flow distribution 6. Teradata Kylo with spark, Nifi, Kafka and Hive for data lakes 7. Teradata, IBM DB2 and AWS Redshift 8. Python, Java and Scala 9. Unit testing with Python(unittest), Scala(scalatic) 10. Scala build tool(SBT), Maven for dependencies management. 11. Devops, Jenkins and Dockers I can do this job for you according to your expectation. I can allocate 15 hours/week to you. Looking forward to hearing from you. Best Regards
$50 USD în 40 zile
4,9 (23 recenzii)
5,1
5,1
Avatarul utilizatorului
Hi, I have 7 years of experience and working on hadoop, spark, nosql, java, cloud... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$50 USD în 40 zile
5,0 (8 recenzii)
4,1
4,1
Avatarul utilizatorului
IT Offshore Development IT Offshore software application development company, Experts from India & United States accepting ambit of Skills accessible in our In-house staff: Dedicated:Android Developer,IOS Developer,Laravel Developer,Wordpress developer,Ruby on Rails Developer, Website Developer, ECommerce developer, PHP Developers, ASP.NET Developer, ASP Programmer, Web Designer, VB/VB.net Developer, Admin Staff and more… We always deliver solutions well within the timeline stipulated by our clients. Many businesses across the globe have already benefited a lot by taking services from us.
$55 USD în 40 zile
5,0 (1 recenzie)
1,6
1,6
Avatarul utilizatorului
Hi, I am a software professional with around 12 years experience in software development and test automation. I am specialised in below skills -Excel macro development -Development of Software Test Automation Framework and Test Script -Creation of Robotic Process Automation bot -Manual and Automation Testing Specialised in below tools -JAVA,SCALA -Kafka, GoldenGate, Jason -EXCEL Macro/VBA -HP UFT/QTP -TestComplete -Selenium, Cucumber -AutomationAnywhere, WorkFusion Domains -Healthcare -Investment Bank -Retail -Forex Specialised in below methodologies -Agile -Iterative -Waterfall I have worked with clients like NHS, United Health, BT, O2, Thales, Citigroup services in our career.
$50 USD în 40 zile
5,0 (1 recenzie)
1,6
1,6
Avatarul utilizatorului
Hood day. job responsibility is ok. what made you confident the tech stack. Have you really brainstormed enough. I doubt. i have contributed 17 years to industry and work as a digital architect for one of the top company. I take some out side assignments to meet my needs. I bellive you need to rethink what you are trying to achieve. let's connect and I can help you. Regards Neo
$55 USD în 10 zile
0,0 (1 recenzie)
0,0
0,0
Avatarul utilizatorului
Hello, I would appreciate your valuable time if we could arrange audio/video call to discuss technical aspects of the project posted here. We have extensively experienced developers to handle complex projects. I have pre-setup of a camera so you can monitor the development work. Can we start a technical discussion My Skype Id -aman1304 BR,
$55 USD în 40 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
Hello We are group of freelancers working extensively on Big Data Technologies and Hadoop ecosystem. We have more than 7 years of experience in this tech stack and worked on Apache Spark, Kafka, Hive, Hadoop, Habse, Mapreduce, Impala, Hortonworks, Cloudera, AWS services and DevOps engineering. We are new to this platform bu we have worked on projects with same tech stack: We are currently working for one of the Enterprise client where we are pulling data from different payload assets which goes from IoT Hub into Apache Spark, we process the data in Spark and after processing we dump it into Cassandra, redis, InMemory and Blob. We are also working on Data Warehousing project for Security and Law firm in London for Security Log generation and analysis. We are using Apache Kafka for data stream ingestion, we are processing this data stream with Apache spark then lookup is done using File and Hbase. We have developed dashboard for log monitoring using Kibana. We have worked on Data warehousing for Pharmaceuticals Industry where we need to collect and analyze data and come up with results like which particular area is having which particular disease most often. For this we are using Python as Scripting Language, Hive as RDS and AWS environment. So we are experts with Designing and architecting the database. Let's connect to have a technical call. Looking forward to your revert. Thank you.
$55 USD în 40 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
I have implemented large solutions for my employer with Hadoop,Spark, Kafka and also worked on multiple platforms databricks,cloudera,Amazon EMR. I have been playing as Architect and Lead role so I believe I can help your needs.
$55 USD în 40 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
I have an extensive experience of 2 years working in Big Data Analytics team at Amazon. I have worked on technologies such as - Hadoop, Spark, Scala, Pig, Hive and have independently designed & developed systems using these technologies.
$55 USD în 20 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
Experienced Hadoop Admin with HDP Certification Certified RHEL Admin Certified MongoDB Admin Devops Expert Will give free demo End to End Solution
$55 USD în 40 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
Having 2.11 years of IT experience in Application Development in Spark, Scala, Hadoop (HDFS) and its ecosystem(Hive & Sqoop). Having good knowledge on tools like Autosys - Autosys R11 ,Putty, Cloudera Manager, unravel , GIT, & ivy. Having good knowledge on HDFS, NameNode, DataNode, Resource Manager, NodeManger and there working functionality. Experience in writing Hive Queries to process data. Extensive working experience with Concepts like Scala and Spark. Experience in developing and the implementation of common MapReduce algorithms in Scala like Sorting and searching according to the client requirement. Worked on analyzing the text files, JSON files, semi structured data using Spark & Scala. Worked on Storing, Merging, Moving and Retrieving data in to HDFS using several Linux commands. Aware of configuration and working with Apache sqoop. Experience loading data to Hive partitions. Logical, Analytical and good interpersonal skills, Commitment to perform quality work. Very flexible and can work independently as well as in a team environment. Willing to update my knowledge and learn new skills according to business requirements.
$55 USD în 40 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
Hi , We are a group of technologists with experience in Big Data Technologies. We have implemented a Large-scale implementation of Hadoop projects on AWS using Horton Works for a leading healthcare provider. This included micro-services for a front end to ingest data from multiple sources and store in a Data Lake. Horton based Hadoop cluster with 20+ pipelines that will preprocess data and score machine learning models, store curated data in a DW ( Redshift) and used for analytics using DOMO. The pipelines were using Spark /scala and spring based micro services. I was the platform architect for the same. I believe we will be able to assist in providing design alternatives and their implications and also help with the implementation. Having already implemented similar projects, We will be able to guide so as to avoid the pitfalls.
$55 USD în 40 zile
0,0 (0 recenzii)
0,0
0,0
Avatarul utilizatorului
Hi, I am hadoop consultant, I have hands on experience in deploying hadoop cluster in DC and AWS. I am strong in configuring hadoop security. I worked as hadoop consultant for top banks and MNC's. Thanks.
$50 USD în 10 zile
0,0 (0 recenzii)
0,0
0,0

Despre client

Steagul INDONESIA
Indonesia
0,0
0
Membru din nov. 14, 2016

Verificarea clientului

Mulțumim! Ți-am trimis prin e-mail linkul pe care trebuie să-l accesezi pentru a revendica creditul gratuit.
A apărut o eroare la trimiterea e-mailului. Încearcă din nou.
Utilizatori înregistrați Totalul proiectelor postate
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Se încarcă previzualizarea
S-a oferit permisiunea de depistare a locației.
Ți-a expirat sesiunea pentru conectare sau te-ai deconectat. Conectează-te din nou.