Optimization ( Spark , AWS )

$8-15 USD / hour

Closed

Posted

over 3 years ago

$8-15 USD / hour

1) Processing high volume of data and tuning [login to view URL] assigning cluster nodes ,fine tuning pyspark jobs, various optimizations used at source table 2) Demonstration of handling data skewing , data spilling , data compression & data serialization and other best practices 3) various cost optimizations designs implemented in AWS from data standpoint ( Glue , S3, EMR, DMS , Athena, Redshift or any other services that you have worked/come arcoss) If you are comfortable with anyone of the above points do reach out.

Project ID: 28401294

About the project

9 proposals

Remote project

Active 3 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

9 freelancers are bidding on average $20 USD/hour for this job

@tangramua

Hello techunidev039, We have 20 years of strong experience in Python, Amazon Web Services, Hadoop, Ubuntu, PySpark, as a result, we can successfully complete this project. Please, review our profile here: https://www.freelancer.com/u/tangramua Here detailed information about our company, our portfolio, and the client's recent reviews. Also, we wanted to personally discuss questions about your project, which helps us to give you the right estimation. Best regards, Tangram Canada Inc.

$15 USD in 5 days

4.9

(39 reviews)

6.7

@umg536

Hi there, I'm bidding on your project "Optimization ( Spark , AWS )" Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .

$50 USD in 750 days

5.0

(11 reviews)

6.1

@ahaseeb7838

Hi, hope you are fine. I have gone through your job description. You want to optimized Spark Jobs hosted on AWS. I'm AWS Certified Technical Professional with more than 3 years of experience in writing optimized spark jobs on AWS EMR, Glue. I have experience in Athena, S3, Lambda, DynamoDB. Let's connect to discuss. Thanks

$14 USD in 25 days

5.0

(52 reviews)

6.1

@sharmaalana1

HI I am experienced in Amazon Web Services Hadoop Ubuntu etc I can start right now but i have few doubts and questions lets have a quick chat and get it started waiting for your reply

$12 USD in 40 days

5.0

(2 reviews)

2.9

@mohanakrishnanba

Hi, I have experience optimizing Spark Cluster to process huge volume of data wrt data distribution across data nodes, optimizing spark sql queries and efficient utilization of the cluster resources. Can guide you with good Design approach and implementation Please reach me. Thanks, Mohanakrishnan

$20 USD in 10 days

5.0

(2 reviews)

3.0

@coolartindia

I carefully checked your job description and i am strongly confident to make your application on your requirements. Already I have developed so many project on python development, so I have great experiences on that. If you give me a chance to work on your project, I will provide best solutions.

$12 USD in 40 days

0.0

(0 reviews)

0.0

@adityagtiwari92

Hello , I am professional AWS cloud and PYTHON BigData Developer with an experience of 7 plus years. I have so far worked on multiple AWS services and have a good hands-on as well as architectural design knowledge on AWS based services and data pipeline. I will be really very happy to collaborate with you on this engagement and you can trust me with the task.

$17 USD in 40 days

0.0

(0 reviews)

0.0

@jainrakesh1701

Hi, I have 6 years of experience in Bigdata, Python and Spark. I have worked on many projects using Python, Spark, Bigdata. I am comfortable with task 1. Will be able to help you in completing the project within time and budget.

$12 USD in 40 days