Python scraping expert needed (python + selenium + Google Cloud)

$50-100 USD

In Progress

Posted

almost 4 years ago

$50-100 USD

Paid on delivery

I am looking for a python + selenium scraping expert, with good knowledge of SQL, Docker, and ideally some GCP. I have a scraping script (python + selenium + flask) which needs to be deployed to Google Cloud Platform. I need somebody to: 1. Modify slightly the code (link with GCP Cloud Tasks, Cloud Storage, and Postgres SQL) 2. Make sure it works properly inside Docker 3. Polish the script as required In the future I will need help with expanding it further (scraping additional websites), but that will be a separate discussion. The task is fairly simple. I am a developer (albeit not python) and GCP Professional, so I am happy to guide you if needed. Most importantly - I am looking for somebody smart, experienced, who writes clean python code and who is happy to self-learn new things, if needed. Any questions - let me know.

Python

Web Scraping

Google Cloud Platform

Selenium

PostgreSQL

Project ID: 26786140

About the project

9 proposals

Remote project

Active 4 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

9 freelancers are bidding on average $88 USD for this job

@kkc264043kkc

Can deploy python code to gcp. want to know more about it. These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping. Can scrape data from various websites . have done scraping of millions of products from Amazon eBay Walmart. have done scraping of social media websites like Facebook Instagram LinkedIn

$111 USD in 2 days

4.9

(61 reviews)

6.2

@priyanshujha98

I've 3+ years of experience of development in python. I've developed many webscrappers in python using selenium web driver and beautiful soup, to add that I also have experience with python's flask framework, I've also worked with cloud services like digital ocean, I also have experience with databases both SQL and NoSQL and that's why I believe I'll be the perfect candidate for this job

$100 USD in 2 days

4.9

(22 reviews)

4.7

@ppan279

Hi, I have been doing Python webscraping since last few years. About a year back I had made a scraping script Docker compliant. Flask too was involved in it. I can finish this task with a little help and guidance from your side. Please let me know if you need more details from me. Thanks Prashant.

$90 USD in 7 days

5.0

(3 reviews)

4.7

@osamaloup2

hi I am familiar with scrapy and selenium libraries I have make a lot of projects I can merge both selenium and scrapy for some situations since scrapy do not handle javascript, during my master made crawler to get comment posts from Facebook and Twitter to make sentiment analysis on it. I have deploy apps using flask on Amazon Web services also I used other services provided by Amazon like sageMaker on Wich I used Docker to deploy machine learning model. I hope my profile match your requirements. thanks

$100 USD in 5 days

5.0

(1 review)

1.9

@ProflexDesign1

Hi, how are you doing? I hope you're doing well! I am a professional Web scraper for the last 10 years. I am confident to complete your project. Regards! Sergei.

$60 USD in 2 days

0.0

(0 reviews)

0.0

@jayeshmahajan099

google cloud certified, python expert Relevant Skills and Experience GCP,Python

$83 USD in 10 days

0.0

(0 reviews)

0.0

@ayoussefacv

"Hello, I am Youssef from Yoletech , an IT Enginner and DevOps/System Expert , +7 years experience with cloud and devops domains : - Optimised and secure installaions. - Building Height Availibility Clustres. - Cloud Deployment (Azure,AWS,GCP ...) - Optimising Database Design and Performance. ""Dev/Devops/Cloud Consulting : - Dev (Angular + Nodejs + MongoDB + Mysql + Redis....): 5 years expreience. - Cloud (Azure, AWS,GCP ...). - System (Linux), Hebergment (OVH). - Deployment, Automation / DevOps (Ansible / Docker / Jenkins): Experience 5 years. - Team Leader on AI projects: Experience: 2 years."" It will be happy to help you and make you project more successful. If you any Question , please feel free to contact me. Regards, Youssef@YoleTech"""

$100 USD in 7 days