I need a web crawler which will
take an input field provided and crawl up specific sites, every hour and grab the latest news links and video links posted on those sites for the input fields.
This site will keep growing, ie. the inputs will keep increasing.
The crawler needs to be robust enough to keep taking in additional inputs and searching the specific sites for those given inputs.
The bidder who can demonstrate experience in this type of design will be given the highest priority.
Please check the site www.tveveryday.com....in this site there are 4 crawler which crawiling the latest added video from youtube dailymotion metacafe collegehumore every hour...please check the site or add a video from add video section then you can see the working flow....
Thanks
Hello,
We have read the requirements posted in the project brief and conceptualized the requirements based on our understanding and assumptions. Client is requested to go through our analysis and respond with modifications/additions to the features mentioned in the private message/proposal.
Regards,
Ravichandu
Business Lead