I need somebody to collect a bunch of data from the website [url removed, login to view] for subsequent analysis.
Ideastorm is a crowdsourcing website that collects ideas from users. Those ideas are stored on the ideastorm website. Here's an example: [url removed, login to view]
I have the links of about 10.000 of such ideas. Now I need data from all of them in a spreadsheet.
What I need for each of them is:
-Title of Idea
-Description (full text)
-Number of votes
-Number of comments
-And all the comments with:
All of this should be in an Excel file for further analysis. You will need a webscraping tool like [url removed, login to view] or the like.
Please also write a brief report about how you got the data.