Find Jobs
Hire Freelancers

Write some Software

£20-250 GBP

In Progress
Posted about 7 years ago

£20-250 GBP

Paid on delivery
Write a AWS cloudformation script to create a working Hadoop / Spark environment with yarn Zeplin and Sqoop Basically take 1 2, or 3 i2.4xlarge and setup so it distributes data and work across the machines. I do not want an EMR solution or a solution that has licensing costs. I just want to pay for the EC2 and S3 costs. Also only use Community AMI's NB an 2.4xlarge has 4*800G SSD On each machine use N-1 SSDs (3 in this case) and split each disk roughly between HDFS and Spark. You can use the the final disk for OS and installed software cloudformation Inputs would be number of machines : 1 2 or 3 cloudformation output section will have 4 URLs / port number for: yarn zepplin, ganglia and spark master You can assume I am using my root account, it is a clean environment and I have foxyproxy like tool running on my desktop. You can hard code region and AMI. I will own the copyright of the script. You cannot share it or blog about it or utube it … The requirement is single yaml or json such that I load it to S3 and I simply run cloudformation. Payment if meets all the stated requirements
Project ID: 13141301

About the project

8 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned R programming, Hadoop and its components Hive, Pig, Sqoop, Flume, HDFS and MapReduce by self and have a very good understanding in all these Concepts. I had attempted Hortonworks Data Platform certified developer - Hadoop certification (HDPCD) on 4th Nov 2016. I also have a good knowledge of Java, Linux, MySql, Python and Android. I believe my capabilities would be perfect for your project. I can complete this job within the necessary period.I will be offering you with all my effort and capabilities. We can have our communication on any of your preferred communication medium. My skype ID is akshay_naidu.9 and I can provide my email ID on chat. We can discuss there in details, if you are interested. I wish you'd give me this chance. Hoping for a long term association. Thank you for taking the time to consider this application and I look forward to hearing from you. Yours sincerely Akshay Naidu
£100 GBP in 8 days
4.8 (5 reviews)
3.1
3.1
8 freelancers are bidding on average £261 GBP for this job
User Avatar
Hi There I understand you need a Cloudformation Script(YAML/JSON) to orchestrate the mentioned resource with an Open Source EMR Solution. I'm pretty sure I can do it coz I've been regularly using CFN to orchestrate LAMBDA & API GATEWAY. So I'm familiar with it's workflow and all the constructs the CFN provides. BTW I'm a super expert in AWS. I've been dealing with all aspects of AWS for the past 4 years. You can have a look at my profile to view my past AWS experience. https://www.freelancer.com/u/joystick220.html Thanks Joy
£333 GBP in 3 days
4.9 (63 reviews)
6.6
6.6
User Avatar
Amazon Web Services: Lambda, API Gateway, EC2, Load Balancers, RDS, Elastic Beanstalk, Elastic File System, IAM, VPC, Security Groups, Cloud Formation,, S3, CLoudFront, Redshift, Route 53, Cloud Watch, Kinesis, SNS, SQS and etc. Advertising Technologies: Facebook Graph API's, FB Website Custom Audience, FB Dynamic Product Ads, Real Time Bidding, Retargeting Ads. Programming Languages: C, C++, Java, Go Big Data Technologies: Kafka, Flume, Pig, Memsql, Aerospike, Redis, MemCache and etc. Miscellaneous: Algorithms, Data Structures, Distributed Systems, Operating Systems Databases: Oracle, MySQL, Operating Systems: Windows, Linux, Ubuntu and etc. Web Technologies: HTML, PHP Code Deployments: Puppet, Docker Monitoring: Nagios, Ganglia
£399 GBP in 0 day
5.0 (33 reviews)
5.7
5.7
User Avatar
Hello, I want to show you all relevant Demo and Designs which is similar to your project completed previously. To make sure about the requirement set and customizations, I want to discuss this project with you further on personal chat. Let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, I use to be online 24x7 on Freelancer so probably you will get a quick response from my end. Following are my Expertise Area: 1)PHP with CodeIgniter and Laravel Framework. 2)Node JS 3)Angular JS 4)Mobile App Development Thank
£515 GBP in 10 days
5.0 (1 review)
4.4
4.4
User Avatar
I am a data science engineer with 3+ years experience in designing, developing and implementing machine learning solutions to complex data problems. My expertise includes apache-spark, apache Hadoop, AWS, Cloudera, Scala, R, Python and JAVA, data mining. Big Data Experience I have worked in Big Data industry for a couple of years and implemented solutions to real world problems. I can implement data mining CRISP Model starting from business understanding, data exploring, data cleansing, data understanding, data analyzing, building a machine learning model, evaluating a model and then deployment of the model. I can provide you, the best analytical solutions to your data mining problems in R, Python, and scala for small and large data set. If your data does not fit into one machine, means it is big data then I can build a solution for you using big data technologies like apache Hadoop, Apache Spark and related tools and technologies. Let's work together and conquer the world of data. The Tools and technologies that I use most include Apache Spark, PySpark, SparkML, SparkR, RStudio, PyDev, Scala, Python, R and Java. Cloud Experience I have worked on different cloud provider platforms including AWS, digital-ocean and on-premise. I can deploy and monitor a Hadoop and spark cluster on any of the cloud provider mentioned above. VISIT PROFILE FOR SATISFACTION THANKS
£166 GBP in 3 days
5.0 (8 reviews)
3.7
3.7
User Avatar
Hello, We have accomplished 90% of the project which is similar of your requirement. All we need 10% customization as per your requirement set and specifications. I want to discuss in personal chat in order to explore your needs, which will yield a clear picture of implementation phase. Prior undertaking project, I want to show demo of the work done previously. Apart from demo, I will be sharing following documentation which will turn your project into Quality and Successful delivery: - Technical Project Proposal - Designs - Flow chart for this Project - Execution plan
£257 GBP in 10 days
4.0 (1 review)
4.1
4.1
User Avatar
· Setup/Managing Linux Servers on Amazon ( EC2, EBS, ELB, SSL, Security Groups, RDS and IAM). · Setup/Managing VPC, Subnets; make connection between different zones; Blocking suspicious ip/subnet via ACL. · Setup/Managing CDN on Amazon CloudFront ( Origin Path: Server / S3) to improve site performance. · Create/Managing buckets on S3 (CLI) and store db and logs backup, upload images for CDN serve. · Setup/Managing Databases on Amazon RDS. Monitoring servers thorough Amazon CloudWatch, SNS. · Creating/Managing DNS records on Amazon Route 53 and go-daddy panel. · Creating/Managing AMI/Snapshots/Volumes, Upgrade/downgrade AWS resources (CPU, Memory, EBS) · Creating AWS Instances and Resources Bills.
£150 GBP in 3 days
5.0 (1 review)
2.0
2.0
User Avatar
Hello I have 7+ years experience in Linux and a very good expertise in AWS and docker containers. I can be able to do this project with great expertise. Regards Subin
£166 GBP in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
United Kingdom
5.0
3
Payment method verified
Member since Aug 31, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.