Find Jobs
Hire Freelancers

Write mapreduce programs in python that would run in Hadoop setup in cloud

$30-250 USD

Closed
Posted over 6 years ago

$30-250 USD

Paid on delivery
I am working with input, output, python and Mapreduce framework in Linux cloud. My project is to write multiple mappers and reducers using python to solve and submit solutions to 3 different problem scenarios , all of the solutions tested in Hadoop set up in Linux cloud. (strictly restricted to writing programs that would work on the cloud- I am using AWS Cloud). For each problem, along with the mapper and reducer, you will be supposed to create a final program (or script) to combine the partial output files into one file. The combining program is supposed to only be combining the part files and sorting them, not affecting the stateless-ness of the mapper and reducer in any way. This project is due on the 13th of October(12th preferable). Will appreciate if you could quote a reasonable charge for completing this task on time. The output files expected are- [login to view URL], [login to view URL] (For Problem 1), [login to view URL], [login to view URL] (For problem 2a OR 2b), [login to view URL] and [login to view URL] for Problem 3. The output can be just python codes written with proper formatting and comments in notepad++. But MOST important pointers are- 1. Mappers and reducers cannot be trivial. They have to be STATELESS. 2. The code has to be tested on a local Hadoop setup first. (only write programs that you know will run in the cloud) 3. For each problem, along with your mapper and reducer, create a final program (or script) to combine the partial output files into one file. Your combining program should only be combining the part files and sorting them. If you are doing any extra work in the combining program, then you likely did something incorrect in the mapper or reducer. Please read through the instructions carefully and let me know if you have any further questions. I can send the exact project requirements, relevant attachments and any other info you might need asap, once you confirm if this is something you could do. Thanks!
Project ID: 15338440

About the project

9 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
9 freelancers are bidding on average $150 USD for this job
User Avatar
Hi, i can provide you solutions for all the three scenarios which you have mentioned. i have great skills with Hadoop and cloud . thanks Relevant Skills and Experience hadoop Proposed Milestones $250 USD - all
$250 USD in 5 days
4.9 (331 reviews)
7.3
7.3
User Avatar
I am an IITK graduate and I have 9 years of experience in software development. I have 100% completion rate and I have finished all the projects with the highest level of customer satisfaction. Relevant Skills and Experience I usually finish projects with ease on which other freelancers have already given up. I learn and understand new stuff very fast and finish the job with top quality and reliability. Proposed Milestones $155 USD - test
$155 USD in 3 days
4.0 (24 reviews)
5.6
5.6
User Avatar
Hi, I have more than 3+ years of experience on hadoop and mapreduce programming I can complete your project Contact me for more details Relevant Skills and Experience Please review my profile Proposed Milestones $155 USD - Project fee
$155 USD in 3 days
4.7 (6 reviews)
4.0
4.0
User Avatar
I got your requirements. I can do this with ease, i have experience of python and hadoop. lets catch up for more details on chat Relevant Skills and Experience python, hadoop, pydoop Proposed Milestones $111 USD - completion
$111 USD in 3 days
5.0 (1 review)
0.8
0.8

About the client

Flag of UNITED STATES
United States
0.0
0
Member since Oct 6, 2017

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.