Spider with a double randomize feature
$30-250 USD
Paid on delivery
I need a spider written. This spider will go on a windows server for a site written in .NET. You will need to schedule it to run multiple times daily. It will crawl 3 sites about 2-3 times a day. It will put the results of the crawl into a temporary table. Then, there will be a randomizer that will publish a random number of entries (randomizer 1) from the temporary table into the live site. The idea is that my site should be updating 24/7 and every 10-15 minutes and to simulate manual updating, so there should be a function that will count how many entries are in the temporary table and publish to live site as many as needed at random intervals from 10 to 15 minutes (randomizer 2). I already have this spider in PHP for another similar site and can provide this code to you. This spider should have a safety feature where it won't crawl any links or add any HTML text other than line breaks, so all other HTML should be parsed out.
Please note: you will be responsible for putting all the scheduled tasks and creating all the necessary things on the actual server, to which I will give you access.
Ask me and I can PM you my site name and the sites which you will need to crawl.
Project ID: #874434