Modifications on a Postgresql database using Scala and Spark

The project is about making modifications on a table on a postgresql database using Scala and Spark. The following functions are required:

1- Connect to a Postgresql database.

2- Update a column based on the existence of certain words on another column and write the new table on the database.

3- Filter non-relevant tweets: define the filtering criteria (removing retweets, remove spams :

tweets containing squads, removing tweets containing only urls or mentions, etc.

4- call a function that compute a score for each tweet : score = number of suicide, depression terms.

5- integrate these steps as a generic function, try to use something scalable, so that we can modify the criteria easily without touching the whole pipeline.

Skills: PostgreSQL, Scala, Spark

See more: spark dataframe to postgresql, spark streaming postgresql, spark write to postgres, spark dataframe write jdbc, spark database connectors, spark postgres driver, connect spark with postgres, spark postgres, We have other coder who is currently doing some modifications, so when the project start the pages might not look same that they, introduction to the art of programming using scala, java project database using servlet, project database using, modifications improvements database project, aspnet project search database using switch statement, project database using access gui using source code, java swing add record database using netbeans, creating patient database using php, save drag drop images database using php, basic database using php, search database using ajax

About the Employer:
( 1 review ) Sana'a, Yemen

Project ID: #16936018

Awarded to:


Have 10 years of IT experience with more than 4.5 years of experience in hadoop technologies like hive,pig,spark,sqoop,map reduce and [login to view URL] have very good experience in Java,scala,Python and shell scripting. Work More

$50 USD in 1 day
(0 Reviews)

5 freelancers are bidding on average $61 for this job


Hello Sir, I am a computer science tutor, I teach (among others) Scala, Spark and Advanced Algorithms. I have done many projects like this, and I'm one of the top Scala developers, and you can check by clicking on my More

$100 USD in 1 day
(8 Reviews)

Hi I am interested in this job. I believe that the skills and experiences I have gained at this position make me an ideal candidate for this position. I have extensive experience in implementing Spark-core, Spark-s More

$55 USD in 2 days
(1 Review)

A proposal has not yet been provided

$30 USD in 2 days
(0 Reviews)

Hello sir/mam I am interested in your project and would like to work with you on this project. Right now i don't have a strong portfolio, but I have a 4 years experience in this industry. Now I'm started working as a f More

$30 USD in 2 days
(0 Reviews)