Find Jobs
Hire Freelancers

Build Big Data Execution Environment (Spark and zeppelin).

$250-750 USD

Completed
Posted over 7 years ago

$250-750 USD

Paid on delivery
TItle : Build Big Data Execution Environment (Spark and zeppelin). Requirements I need to physical setup of bigdata platform for my data analysis work. - spark(SparkSQL and MLlib,R) and Zeppelin. I'm looking for expert(s) to configure a spark and Zeppelin on my Linux Server. I'm not a actual jave programmer and don't have a experience of bigdata area. So You need to provide followings. - install and configure a bigdata platform - Spark standalone mode. - hadoop / spark(sparkSQl and ML ,SparkR) and Zeppelin - Use a latest version of related SW. - You need to install related programs or packages also on my Server . - and I need to use Zeppelin Web U for exploring a data on SPARK. - The goal for this project is to perform data analysis on SPARK over Zeppelin. You need to give me followings : - for sample program , use a scala program. - All sample programs need to be running on Zeppelin UI or scala cli. - pre-load a few sample data(for exampe , [login to view URL] ) - sample programs for data loading into spark. - Basically data loading from text file. - sample program for Spark query and ML. - Very basic scala program for "Collaborative filtering" method. - a few SparkSQLs - sample R program for utilizing of SparkR. - and simple documentation. I will let you know a linux server information if contracted. this is a initial project and if this is completed well , I'd like to extend a project to make a real business application.
Project ID: 12014263

About the project

13 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
I am a data scientist and have experience working with big data technologies like spark, hadoop, etc. I understand how to install spark and other engines at the backend of zeppelin. I would like to do this project.
$250 USD in 3 days
4.9 (33 reviews)
5.7
5.7
13 freelancers are bidding on average $534 USD for this job
User Avatar
Your project is a perfect match for my skills. Looking forward to support you with this project. best regards, Joerg.
$499 USD in 15 days
4.7 (5 reviews)
3.6
3.6
User Avatar
My core competency lies in development and implementation of financial models based on academic literature. Programming Skills: Python, R, SQL Packages: numpy, scipy, statsmodels, sklearn, tensorflow, theano, keras, nltk, lxml, requests, openpyxl, pandas statistics - data mining / machine learning, pattern recognition, neural network, random forest, ridge regression, lasso, nearest neighbor, cluster analysis, logistic regression, logit / probit transformation, spline, kernel smoother, nonparametric statistics, support vector machines, cross-validation, model selection, principal component analysis ( PCA ), Monte Carlo, variance reduction, antithetic / importance sampling, Markov Chain Monte Carlo, EM algorithm, Gibbs sampler, KALMAN filter, Bayesian Statistics, conjugate prior, posterior distribution, conditional expectation, multivariate distribution
$500 USD in 10 days
5.0 (4 reviews)
3.1
3.1
User Avatar
I have been working on hadoop for the past 2 years. I have very good experience deploying hadoop clusters. I helped one of our clients build 10 node haodop cluster and am still giving support maintaining it. I have a good working experience on spark. I worked on multiple spark projects, one of which is clickstream analysis, which process the clickstream data of a website in realtime and generate adhoc reports. I also trained a group of 8 people in our organisation for an upcoming project in Spark. Let me know if you are interested.
$333 USD in 20 days
5.0 (1 review)
1.3
1.3
User Avatar
I am expert on bigdata / spark/ambari , I can do this within a week and able to give KT to you or your team.
$555 USD in 10 days
5.0 (1 review)
0.6
0.6
User Avatar
Can you also provide more details about your environment it is a Linux Fedora or ubuntu box, ram details etc . Also do you need a single node cluster or multi node . Spark and hadoop versions required
$555 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
hadoop certified developer having 7 years of exp . good exposure on hadoop and eco systems like spark Java scala
$555 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Interested to work for this project Total experience: 16+ yrs in java, j2ee VISA: USA valid till 2024 Resume Summary: Having 16+yrs experience in IT industry, handling 180+ resources team, 4+ geographic location, 4-6 project parallel, Strong hands on, able to lead technical architect team, strong relation with customer. Expertise : Project Management, Project Plan, Estimation (WPS or FP), time-cost-risk mgmt, SRS, UseCase, HLD, LLD, Architectural design, UI Speciation, Business rule catalog, Test plan. Technical Skill : Project Architect Designing, Java, JavaScript, J2EE, Struts, EJB, Servlet, JSP, App Server (Web sphere, JBoss), Hibernate, Spring, JMS, WebService, JAX-RPC, JAX-WS, Liferay CMS, XML, Cluster Enjoinment, Amazon Cloud computing, Angular JS, Scala DataBase : Oracle, MySQL, MSSQL Server : Web Logic, Web Sphere, Apache Tomcat , AWS Skill : UML, Agile- Scrum methodologies, Good Management with Hands on Tech Knowledge, Function point analysis, WBS. : Architecture, Application designing, Clustering & Deployment configuration, Build & Release management. Thank you Megharaj Dadhich +91-9967868209
$555 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of KOREA, REPUBLIC OF
SEOUL, Korea, Republic of
5.0
91
Member since Apr 16, 2014

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.