I need experienced and reliable Python / PHP programmer/
Web-based software with 2 parts. App and spider. Spider scrapes the URLs, gathers data for them and displays them to the user. App is Laravel, spider is Python.
Spider not only scrapes URL one time. It also re-checks the URLs in the system every 24 hours.
Fix the current spider (stopped working)
Upgrade the spider to be able to handle 1 million URL every 24 hours (now it can handle like 50k)
I personally consider it a simple task but your fee is upon agreement.
Also, can you please respond with the result of this?
4 + 5 = ?
21 freelancers are bidding on average $203 for this job
Hello I am available right now, how are you? I have developed 100+ websites in many programming languages for clients all over the world. proloa could you please inbox me more detail about this project?
9 Dear I am an expert in web scraping. In before, I developed many spiders using scrapy. For example, I did scrape sites of products for CEOs(ebay, welivv and so on). Thanks.
4 + 5 = 8 + 1 Parallel programmer with experience in scraping in C,C++, Python, PHP and some others. I can look at your current spider code and make it parallel, or use other techniques to speed it up.