Closed

Data processing with Apache Spark and Python

I have access to around 400 GB of tabular data stored in the Google Cloud, but only around 50 GB are used actively in the data processing. I am a programmer and have been working on this project, but due to time limits, I am thinking of hiring you to help me out. I can help you with my current code and guidelines if needed.

The task is to process some table data and obtain samples with a given format. Format and data scheme will be given. Only your time to work and experience with Python and Apache Spark is necessary. There are three target formats that I want to obtain. But the number of formats is negotiable.

Skills: Python, Software Architecture, Linux, Data Mining, Data Processing

See more: data processing skills, data processing spreadsheet, data processing forum, pyspark tutorial, apache spark download, spark can store its data in cassandra, apache spark vs hadoop, spark python, big data processing with apache spark pdf, apache spark tutorial, apache spark github, data processing health care, excel data processing home, apache mysql python ubuntu, data processing projects needed, needed data processing, python workflow data processing, registration fee needed apply data processing job, python data processing, python csv data processing

About the Employer:
( 37 reviews ) faridabad, India

Project ID: #22740302

10 freelancers are bidding on average $98 for this job

Seeniea

Hello Dear I have read your detailed post. Understand all. I'm a pro python developer. and I know Scraper and PHP as well as you can see my portfolio I can do this and wont make you dissapointed. Let's chat Thanks

$300 AUD in 2 days
(6 Reviews)
5.5
pradeepred

Have 12 years of IT experience with more than 5 years of experience in hadoop technologies like hive,pig,spark,sqoop,map reduce and [login to view URL] have very good experiemcence in Java,scala,Python and shell scripting. Wo More

$83 AUD in 1 day
(8 Reviews)
3.8
hsh564cf84accd96

Hi my Professional Aim is: (Services then Solutions then Satisfactions) I hope you are [login to view URL] an experience in this field from last 5 years i am sure i can do it perfectly with in a time and budget Able to deliver y More

$75 AUD in 7 days
(9 Reviews)
3.5
toshazed

I am Ring. I am about 18+ years experienced in GNU/Linux based system, server installation and customization, develop, deploy, security and support. I may help you in this regard.

$140 AUD in 1 day
(13 Reviews)
3.8
Mohsinjamal4

Hi there , I have read your job description carefully . I have full experience in data entry , data extracting , data processing , web scraping as well as in excel / google spreadsheet . Thave done lots of similar type More

$13 AUD in 5 days
(0 Reviews)
0.0
TBSCHEMISTRY

I have more than 2 year ex Relevant Skills and Experience data entry and android app maker

$30 AUD in 1 day
(0 Reviews)
0.0
karthikml2019

I'm a business professional with 3+yrs of Apache spark and 6+yrs of Python experience. As a data scientist, my day job is to process trillions of rows of data (load -> clean -> transform -> impute etc) and provide pre More

$100 AUD in 7 days
(0 Reviews)
0.0
SYAFIDAIZZATI

Hi, I have read all of your requirement. I can do this job and deliver it punctually. I am professional virtual assistant. I have a lot of experienced working as personal assistant for a few companies. I have exp More

$75 AUD in 7 days
(0 Reviews)
0.0
$83 AUD in 10 days
(0 Reviews)
0.0
ranchal99

Familiar with spark and dealing with TB of data.

$83 AUD in 10 days
(0 Reviews)
0.0