Spider with a double randomize feature

In Progress Posted Dec 5, 2010 Paid on delivery
In Progress Paid on delivery

I need a spider written. This spider will go on a windows server for a site written in .NET. You will need to schedule it to run multiple times daily. It will crawl 3 sites about 2-3 times a day. It will put the results of the crawl into a temporary table. Then, there will be a randomizer that will publish a random number of entries (randomizer 1) from the temporary table into the live site. The idea is that my site should be updating 24/7 and every 10-15 minutes and to simulate manual updating, so there should be a function that will count how many entries are in the temporary table and publish to live site as many as needed at random intervals from 10 to 15 minutes (randomizer 2). I already have this spider in PHP for another similar site and can provide this code to you. This spider should have a safety feature where it won't crawl any links or add any HTML text other than line breaks, so all other HTML should be parsed out.

Please note: you will be responsible for putting all the scheduled tasks and creating all the necessary things on the actual server, to which I will give you access.

Ask me and I can PM you my site name and the sites which you will need to crawl.

.NET ASP Data Mining Web Scraping Windows Server

Project ID: #874434

About the project

1 proposal Remote project Active Dec 5, 2010

Awarded to:

gangabass

I can do this job for you. See PM for details.

$50 USD in 2 days
(401 Reviews)
7.6