create tool / script to scrape similarweb estimated visits of 1,000s of websites a month. Avoiding the API costs

Închis

Descriere

Hello

I currently use SimilarWebs chrome plugin to tell me manually how many visitors websites get each month. I need to scale and automate this process. I could use the similarweb API but they're expensive so I am looking at other options.

I need a tool or script to be able to enter 100s/1000s websites at a time and for it to fetch/find SimilarWebs data on them:

1- Estimated Visits - 100% needed

but if possible I would also like the following values from the chrome plug in

2- the past 6 months of estimated visits - this will enable me to average the data for a better estimate.

3 - The rank of the website within its county

4 - the sector its in, and the rank within its sector - something Similar Web does very well.

NOTES

Need to be careful of high volume of traffic coming from one location, but I am sure this is something that can be done. We could either have a script that visits the [url removed, login to view] website and enters each site, then finds and copies the relevant data into a excel/csv file. Or do the same process from the website direct, using the similarweb plug in. Go to site, click plug in, see and copy data. Both would in theory work.

I would likely do this for 3,000 websites a month to start.

I am interested in hearing about your experihence and how you could build me a tool to do this.

Thanks

Scott

Aptitudini: Exploatarea Datelor, Excel, PHP, Web Scraping

Vezi mai multe: bing api search engine php script, usps api shipping label generation script, api based search site script, websites twitter api, usps api php tracking code script, sample websites paypal api integration, month payment deducted automatically paypal account php script, freelance websites affiliate api, ebay api add item php script, betfair api costs, keyword tool api costs, weather api costs, google maps api costs, foreca api costs, comparison websites work api, highscore flash api costs

ID proiect: #12019220

Acordat lui:

Michael91B

Hi, I have reviewed similarweb.com website. I test it with my script and I could easily extract estimated visits, rank within its country, sector and sector rank. And I could probably figure out how to get the past Mai multe

280$ USD în 7 zile
(8 Recenzii)
3.7

8 freelanceri ofertează în medie 381$ pentru acest proiect

PigtailXL

Hello Sr. I'm Jorge from Argentina, a responsible person who have wide experience working building solutions to automate lot of processes and tasks. I've experience working with WinAutomation since last 2/3 years. L Mai multe

380$ USD în 5 zile
(134 Recenzii)
6.7
SBITServices

Hello Scott, I have read your description and can complete in 4 days and agree that I can complete tasks with high quality and consistency.We are the best team(8 people) within your budget to complete this project quic Mai multe

250$ USD în 4 zile
(110 Recenzii)
6.4
dpune

Hi, I have more than 14 years of Excel/VBA exp and I can build similar tool in excel which can scrpe data from the website as required. I have completed more than 290 projects. Please look at the feedback le Mai multe

500$ USD în 10 zile
(136 Recenzii)
6.3
mwarrenschultz

Hello! I am a professional programmer with many years of experience using Python. I have read your project description, and I can create the SimilarWeb Automation program you require. To do so, I will use the libraries Mai multe

333$ USD în 10 zile
(41 Recenzii)
6.2
RubyOnRail

Hi,I have gone through your project description. I could be confident if we can proceed towards more discussion. I am an individual developer and you will be working directly with me if we proceed work on this project Mai multe

777$ USD în 15 zile
(5 Recenzii)
5.5
narsim3128

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 6 years of experience. I have successfully completed few projects for US clients which involved web sc Mai multe

250$ USD în 7 zile
(16 Recenzii)
3.6
277$ USD în 10 zile
(2 Recenzii)
2.4