create tool / script to scrape similarweb estimated visits of 1,000s of websites a month.

Closed Posted 3 years ago Paid on delivery
Closed Paid on delivery

Hello

I currently use SimilarWeb's chrome plugin to manually tell me how many visitors websites get each month. I need to scale and automate this process. I could use the similarweb API but they're expensive so I am looking for alternatives

I need a tool or script to be able to enter 100s/1000s websites at a time and for it to fetch/find SimilarWebs data on them:

1- Estimated Visits - 100% needed

but if possible I would also like the following values from the chrome plug in

2- the past 6 months of estimated visits - this will enable me to average the data for a better estimate.

3 - The rank of the website globally

NOTES

Need to be careful of high volume of traffic coming from one location, but I am sure this is something that can be done. We could either have a script that visits the [login to view URL] website and enters each site, then finds and copies the relevant data into a excel/csv file. Or do the same process from the website direct, using the similarweb plug in. Go to site, click plug in, see and copy data. Both would in theory work.

I would likely do this for 3,000 websites a month to start.

I am interested in hearing about your experihence and how you could build me a tool to do this.

Web Scraping PHP JavaScript Python Google Chrome

Project ID: #29445558

About the project

11 proposals Remote project Active 2 years ago

11 freelancers are bidding on average $540 for this job

kanika6665

Hi, I find myself eligible for this job since I am having 9 years of extensive experience. I am Good at Web Scraping, PHP, Google Chrome, JavaScript and Python. Please Send a message so that we can discuss more about More

$530 USD in 22 days
(73 Reviews)
7.0
metlickijv

Hi Ameyer. I am a top talent python scraping expert with extensive experience. I have complete many similar projects using frameworks and libraries such as scrapy, selenium, requests, beautifulsoup, lxml and etc, As an More

$500 USD in 3 days
(15 Reviews)
6.2
vladislavrashev3

Hello. I just read your job description carefully and I am very interested in it. I am a senior web/mobile developer who has 8+ years of development experience. You can confirm my skills on my profile. I am sure that More

$500 USD in 7 days
(6 Reviews)
5.2
rapsterito

Hi As a web scraping expert, I have read your project description and feel confident that I can finish your project at a high level. I have heavy experiences with web scrapping using python. I am very familar with som More

$500 USD in 7 days
(6 Reviews)
4.0
CNERD694

Hi I am a python developer with 3 years of coding experience, to create this project I'll use the python httpx module to perform asynchronous http requests to similarweb on the given websites then, I'll use the python More

$456 USD in 5 days
(0 Reviews)
2.5