Crawling/Scraping Engineer

We're looking for a scraping/crawling engineer to join full time our 3-people Crawling team for a 3-month period.

This team is responsible for extracting information from thousands of websites every day. Due to constant changes in some of these websites, a number of our extractors break every day, so we need to continuously adapt them. We also need to continuously create new extractors for new sources.

Our tech stack: scrapy + Selenium. We use JIRA for the management of tasks.


- fluency in English, both written and spoken

- scraping/crawling experience (3+ years) using scrapy + Selenium

- python programming experience

- experience with online services, such as AWS and Cloudera

Please apply only in case you're an individual (i.e. no agencies) interested in joining the team full time for the next 3 months. Links to GitHub projects that you've developed in the past and any other references will be much appreciated.

A technical interview will be conducted before awarding the job.

Aptitudini: CSS, Python, Scrapy, Web Scraping, xpath

Vezi mai multe: web scraping, job scraping tools, web crawler api, web crawler, web crawling techniques, scrapy, web crawler tutorial, web crawler python, google job online data entry, job online php developer prado, getting job online live chat agent, engineer job sweden spanish, apply for a job online, system engineer job online, apply for job online graphic design, apply for job online in dubai for graphic designer, apply job online for graphic designer, apply typing job online, engineer freelance job online, find job online for web scraping

Despre angajator:
( 0 recenzii ) Munich, Germany

ID Proiect: #19991162

25 freelanceri licitează în medie 18€/oră pentru acest proiect


Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the Mai multe

€20 EUR / oră
(109 recenzii)

Hi. We are working on a new web crawling platform which we think have some advantages over scrapy and especially Selenium, which is limited in many ways. If you are interested to find out more let me know and we can t Mai multe

€17 EUR / oră
(119 recenzii)

Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written Mai multe

€16 EUR / oră
(81 recenzii)

Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spide Mai multe

€15 EUR / oră
(28 recenzii)

Hi, Client!! @$@$@$PLEASE CONTACT ME. I CAN DO IT WONDERFULLY.$@$@$@ ##% Your idea is attracted me to your world.%## I am Python expert. i have various skills. @@PLEASE GIVE ME CHANCE TO PROVE MY SKILLS@@ :-): Mai multe

€16 EUR / oră
(58 recenzii)

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Pl Mai multe

€18 EUR / oră
(43 recenzii)

Hi There I have 10 years experience in Python and web development. 8 years developing Django sites and services. I did lots of projects in scrapy and crawler. i offer/accept lower price to get more rank. technology tha Mai multe

€23 EUR / oră
(74 recenzii)

[login to view URL] Credit is my motto. I am expert web scraping. I can avoid recaptcha. I can do your job with BS4 ,Perl script, Seleinum framework of python. I can do any project in your demand completely by my good experiences Mai multe

€15 EUR / oră
(53 recenzii)

Hi, ➲ 10+ years of full-time experience in Python / Django with 50,000+ Upwork hours billed and 50+ successful Python projects ➲ Upwork Top 10 Certification for Python and Django ➲ Guaranteed Results Policy: Pay onl Mai multe

€12 EUR / oră
(14 recenzii)

Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Scra Mai multe

€70 EUR / oră
(1 părere)

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO Mai multe

€16 EUR / oră
(78 recenzii)

Note: We are an Agency but still placing the bids because in data fetching we have developed a product "Dragon SRCH, which may help you run the daily routine job. Dragon SRCH Platform is a cloud-based research eng Mai multe

€20 EUR / oră
(3 recenzii)

Hello, I'm Android (since 2012) and web (since 2013)developer. I can speak in English freely. I tend to keep myself up to date with important changes in the Android world and web frameworks and regularly look into ne Mai multe

€16 EUR / oră
(8 recenzii)

""I can do it"" Food/Restaurant/order/Delivery/Eat: [login to view URL] [login to view URL] [login to view URL] [login to view URL] 3D Cart: https: Mai multe

€14 EUR / oră
(2 recenzii)

Hello Sir, Talent is not limited to Europe sir. 100% fluent in English. A sample can be provided once you inbox. I am scrapy specialist. 100% fluent in English. I have been working in scrapinghub for quite a while. Wo Mai multe

€18 EUR / oră
(5 recenzii)

Respected Sir/Ma'am Job seems challenging, but, I can do it. You have mentioned that the structure of the sites is changing frequently, I can handle it. Try me, you won't be disappointed, give me a site(whose struct Mai multe

€12 EUR / oră
(5 recenzii)

Hey I have 3 years of working as a web scraping freelancer, My last project included working for [login to view URL] where my job was to make and maintain crawler for different fashion brands like Diesel etc. Message m Mai multe

€12 EUR / oră
(17 recenzii)

Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I hope to work with you!

€16 EUR / oră
(4 recenzii)

First:- Chatbot --> This can be integrated by any Facebook page, Slack etc. Its main aim is to reduce the human effort. For example, if this Chatbot is integrated with company page so it can easily answer you some b Mai multe

€16 EUR / oră
(3 recenzii)

✫✫✫ Dear Hiring Manager ✫✫✫ Wish you a very good day!!! I am a senior Web/App developer who has a good knowledge of Python, Java, javascript, PHP, Codeigniter, C++, C#, Qt and etc. So interested in your project. As Mai multe

€12 EUR / oră
(2 recenzii)