Find Jobs
Hire Freelancers

Create a Python script to analyze posting data stored in JSON format

$30-250 USD

Closed
Posted over 9 years ago

$30-250 USD

Paid on delivery
I need help in analyzing data from around 90 online forums as part of a research project - I want to identify factors that predict the success of online forums. Access to an Amazon AWS instance will be supplied as the files are over 30Gb. Work will need to be done via the Amazon AWS instance. Ideally we will be able to use the Python code in an iPython notebook. I am flexible on this however. The data comes nicely packaged in a set of JSON files: [1] [login to view URL] Contains badge data associated with user accounts - i.e. the user ID it was assigned to, the name of the badge, and the date/time it was assigned. [2] [login to view URL] Contains comments data - e.g. timestamp, user ID of the user writing the comment, score (upvotes/downvotes). [3] [login to view URL] Contains posting history data - e.g. posting revision type, details of the changes made, user ID associated with the user who made the change [4] [login to view URL] Contains posting data - e.g. the actual questions and answer text posted by users, tags associated with the questions/answers [5] [login to view URL] Contains user data - e.g. user ID, user account creation date, last access date, reputation score, etc. [6] [login to view URL] Contains voting data - e.g. vote type ID, timestamp of the voting action, user ID of the person making the vote A data dictionary with more details is attached as is a sample copy of the JSON files (only containing 3 forums worth of data to make it easy to download - the real version has around 100 forums). In brief - [1] we will need to classify each of the forums into two groups: success and failure. I will tell you which ones failed and which ones succeeded. [2] We then focus on the first 14 days of data for each forum. [3] We then calculate metrics for each one - e.g. average number of posts per day, average number of answers per day, concentration of people doing all the work [4] Make conclusions based on the results using a linear regression or other model
Project ID: 6834516

About the project

18 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
18 freelancers are bidding on average $325 USD for this job
User Avatar
A proposal has not yet been provided
$250 USD in 7 days
4.9 (36 reviews)
5.3
5.3
User Avatar
I suppose you have lots of options to select among core programmers, but I am a statistician as well. Also, I have assistants to help me speed up the projects.
$200 USD in 2 days
5.0 (19 reviews)
5.0
5.0
User Avatar
Hello, I'm using Python daily for most of my programming needs. I have experience with databases (PostgreSQL, MongoDB, MySQL) and relevant modules like json, multiprocessing, datetime. I have analyzed large files (over 10 GB in size) and managed databases of over 1 TB. Regarding AWS I have used it for about 2 years before migrating to DigitalOcean; I have been using Linux on both servers and personal notebook for over 6 years. I have not used iPython notebook. Thank you for your time! Best wishes, Ionut
$240 USD in 3 days
4.9 (5 reviews)
4.6
4.6
User Avatar
I am good at python/json process, and also interested in your project. Please contact me to discuss more details for your project, Thanks!
$222 USD in 5 days
5.0 (10 reviews)
3.9
3.9
User Avatar
La propuesta todavía no ha sido proveída
$250 USD in 7 days
5.0 (11 reviews)
3.6
3.6
User Avatar
Hi Good Day I have great experience both with JSON and Python. Also have experience with working on AWS instances. Willing to work on this project. Looking forward to hear from you. Thanks Rinsad
$263 USD in 5 days
4.7 (3 reviews)
3.6
3.6
User Avatar
A proposal has not yet been provided
$100 USD in 3 days
5.0 (8 reviews)
3.3
3.3
User Avatar
Hi, I am a python developer and have quite some experience. I am willing to complete the work in the required time. Please let me know if you are interested
$55 USD in 3 days
5.0 (6 reviews)
3.3
3.3
User Avatar
A proposal has not yet been provided
$133 USD in 7 days
5.0 (5 reviews)
3.1
3.1
User Avatar
Hi, I can help you with this, lots of experience with python and analyzing data (including using Ipython notebook) Thanks, Craig
$300 USD in 5 days
5.0 (1 review)
2.4
2.4
User Avatar
I have 4+ years of working experience in machine learning domain and have master degree in computer science. Worked on many projects mainly in Predictive analytics, Natural language language, text mining, web mining etc. Expertise in R, Python, Hadoop, MapReduce, Hbase,Hive,Pig etc.
$666 USD in 21 days
5.0 (1 review)
2.1
2.1
User Avatar
Hi, your project looks interesting. I think it falls into two parts: 1. simple data manipulation, choosing part of data by certain criteria. 2. statistics, using linear regression or other models to analyze the data, deriving conclusions. I'm capable of solving your issue. Please feel free to contact me if you still have concerns.
$155 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Very interesting project, with emphasis on understanding the data. My knowledge of mathematics and experience in data design and manipulation makes ma a good choice. Please, contact me on if you want to know more about me.
$250 USD in 6 days
0.0 (0 reviews)
0.0
0.0
User Avatar
As I understand the project, it will just involve some interpretation of the data in a relational manner. I did study some statistics and relational techniques in school, and I know how to do it in Python. However, I'm not sure I know how to do the JSON parsing and extracting the data in as pretty a way as you want it, so I'm budgeting a week on refreshers for myself.
$222 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of AUSTRALIA
Brantford, Australia
5.0
5
Payment method verified
Member since Sep 29, 2014

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.