Hadoop Jobs

I am looking for a Kafka Admin who can assist me with the following tasks: - Onboarding Kafka cluster - Managing Kafka topics and partitions - Its already available in the company and we need to onboard it for our project . -Should be able to Size and scope . - We will start with small data ingestion from Hadoop datalake . -Should be willing to work on remote machine . The ideal candidate should have experience in: - Setting up and configuring Kafka clusters - Managing Kafka topics and partitions - Troubleshooting Kafka performance issues The client already has all the necessary hardware and software for the Kafka cluster setup.

Over the past years, I have devoted myself to a project involving Algorithmic Trading. My system leverages only pricing and volume data at market closing. It studies technical indicators for every stock in the S&P 500 from its IPO date, testing all possible indicator 'settings', as I prefer to call them. This process uncovers microscopic signals that suggest beneficial buying at market close and selling at the next day's close. Any signal with a p-value below 0.01 is added to my portfolio. Following this, the system removes correlated signals to prevent duplication. A Bayesian ranking of signals is calculated, and correlated signals with a lower rank are eliminated. The result is a daily optimized portfolio of buy/sell signals. This system, primarily built with numpy...

Location specific - Denver (USA) Data Engineer - Job Description Overview: We need an experienced Data Engineer to join our team working on an impactful project applying Artificial Intelligence for better monitoring and root cause analysis of our Sling service delivery. You will build and maintain the critical data pipelines that feed our AI models and analytics. In this role, you will ingest data from our content workflow systems, CDNs, AWS services etc. and transform it into a reliable, analytics-ready dataset. You will need strong hands-on experience with data pipelines, ETL, and data processing frameworks. This project offers exciting opportunities to apply your data skills to have a real business impact. Our AI models rely on clean, unified data to detect anomalies and enable...

I am looking for a Hadoop developer with a strong background in data analysis. The scope of the project involves analyzing and interpreting data using Hadoop. The ideal candidate should have experience in Hadoop data analysis and be able to work on the project within a timeline of less than 1 month.

I am looking for a Hadoop developer with a strong background in data analysis. The scope of the project involves analyzing and interpreting data using Hadoop. The ideal candidate should have experience in Hadoop data analysis and be able to work on the project within a timeline of less than 1 month.

Recommended Skills: ● 5+ years building large-scale streaming data platforms on cloud. ● Expert in technologies like Kafka, Flink, Spark Streaming. ● Proficiency in SQL, Python(or Java). Experience with Scala is a plus. ● Expertise leveraging monitoring tools like New Relic, SolarWinds, Prometheus, Grafana, ● Strong hands-on experience managing AWS big data services. Responsibilities: ● Design and implement robust data pipelines to efficiently collect, transform, and integrate logs and metrics from different sources within our content ingestion workflow. ● Work in synergy with our talented ML Engineers to empower the development of advanced anomaly detection models and root cause analysis algorithms. ● Collaborate with Cloud Architects to optimize AWS infrastructure for seamless d...