PySpark application to create Huge Number of Features and Merge them
Budget $30-250 USD
- Freelancer
- Jobs
- PySpark
- PySpark application to create Huge Number of Features and Merge them
PySpark application to create Huge Number of Features and Merge them, from by re-coding from a copy of script written in Panda=> Must follow its "Thinking Process" Exactly.
Must be able to operationalize it in AWS, and stream the results to websites "Live".
Use PySpark for running the operations faster than Panda, and use Hadoop for parallel distributed processing, in AWS for more Instantaneous response expected.
Another Term/Condition: Milestones will not be released until project is completed and delivered to our side.
1 freelancer is bidding on average $244 for this job
Hi, I am a Pyspark developer with 1.5+ years of experience and I have knowledge and we'll understanding of Spark, Hive, Sqoop technologies. Let me know if you are interested to discuss about the project requirements. More