Closed

Scrape reader's comments from news sites

This project received 42 bids from talented freelancers with an average bid price of $434 USD.

Get free quotes for a project like this
Employer working
Project Budget
$250 - $750 USD
Total Bids
42
Project Description

I am a social scientist and would like to get scraped all readers' comments posted to news articles that were related to politics and some additional social issues (e.g. race, immigration) from 4 US news sites within the last 12 months: Washington Post, Breitbart News, New York Times, and Wall Street Journal. We would agree about the appropriate keywords to be used to select the articles for which we want to have comments scraped. The files can be delivered in any suitable format (e.g. json, csv,..). AWS can be used if needed. The comments should be accompanied by all available metadata (commentator's id, link to the article, timestamp, 'likes', etc.). I need the scraping to start as soon as possible. I have a very limited budget, but am willing to pay what's fair. If the project is successful, it might receive more funding and be continued. Just ask for more details if needed.

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online