Find Jobs
Hire Freelancers

Analyze slow Hive performance on Amazon EMR

min €36 EUR / hour

Completed
Posted almost 9 years ago

min €36 EUR / hour

I've about 1.4TB of ngram data in S3 and run a simple Hive job on it. I need guidance with why it's so slow (with 5 machines, it would take several days to complete). Apply only if you have significant Hadoop and Hive experience.
Project ID: 7895762

About the project

6 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
A proposal has not yet been provided
€40 EUR in 10 days
5.0 (11 reviews)
3.7
3.7
User Avatar
Hello I have more than 2 years of experience of developing hadoop applications. I got the same problem in my Bizalyticks ([login to view URL]) project and I resolved that now its working faster. Please ping me and give me a chance to look at your server configuration so that I will resolve your problem. I am open to meet your timeline and budget.
€40 EUR in 3 days
5.0 (2 reviews)
2.7
2.7
6 freelancers are bidding on average €40 EUR/hour for this job
User Avatar
A proposal has not yet been provided
€40 EUR in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi.. I have explored hadoop and done poc's on it. I have enough knowledge on HDFS, PIG, HIVE, MAP REDUCE , FLUME and Apache Spark. Please let me know your problem in detail, let me help you in whichever way i can.
€40 EUR in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello 1.4TB does not seem like a huge amount of data , so i would like to look at the query you are using and the amount of data you are getting as an output . Edit : would like to add that my experience is with the cloudera platform . Thank you Amr
€40 EUR in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
€40 EUR in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of GERMANY
Potsdam, Germany
5.0
13
Payment method verified
Member since Apr 19, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.