Find Jobs
Hire Freelancers

Improve script to scrape a website's search page - Python/Selenium WebDriver

£10-20 GBP

Completed
Posted almost 5 years ago

£10-20 GBP

Paid on delivery
I already have written code which extracts data points from various URLs contained in a list and using a for loop it iterates over each URL, navigating to that URL and extracting data points from the URL and outputs them to a csv. However, I need to extract data points from a websites internal search engine which returns 10 results per page. For each of the 10 results I need to be extract all the data points for each individual result. It will also require moving to the next page and repeating the process until there are no more new results. The output for each result must be writing to a csv file.
Project ID: 19135353

About the project

7 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Good Day, I am willing to take responsibility for your project too! Please let me know, if you want my services. Thanks Emamul H.
£18 GBP in 1 day
4.9 (24 reviews)
4.8
4.8
7 freelancers are bidding on average £23 GBP for this job
User Avatar
Hi it feels good to talk to you, i have done scrapping almost on Half of Worldwide web including eCommerce giants (Amazon, eBay, craigslist) News Feed, Social media websites, API's. I develop my own tools based on client requirements with Multi-threading, a Bot with human behavior and Scrapping Applications with documents parsing. I Can do PDF Parsing and Capctha ByPass code as well. Contact me for further details. I have developed over 100+ Bots and Tools for my clients and made sure they got their data. I normally work with Python or C# Not convinced yet let me have your questions. Thanks Why choose me Experience: Have been very diverse in technology, learning new things and always ready for challenges. Attitude: Always looking at bright side, focus on getting things done and target towards goal. Passion: Never afraid to take risks and do everything with my 100% Ownership. Communication: I possess good English speaking as well as writing skills and honest in work.
£16 GBP in 7 days
5.0 (40 reviews)
6.7
6.7
User Avatar
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,,
£20 GBP in 3 days
4.9 (106 reviews)
5.9
5.9
User Avatar
I am pleased to inform you that our offering of Crawling Solutions will be the right solution to comply to your requirement. The functionalities of Scraping / Crawling Solutions is as mentioned below, - Fetch the details targeted websites in quick time - More than 98% accuracy in scraping the information - Provision of IP-Management and de-captcha resolution - More than 10 years of experience in industry domain - User defined output to be delivered i.e. excel / csv, JSON, HTML etc. - Output delivery via Email, FTP, API etc. Do let me know if you require further details from our side. We have experience in fetching the pricing and other information on a regular basis from more than 250 websites on a regular basis. The partial list of the websites are as mentioned below, - LinkedIn - Facebook - Twitter - Yellowpages - Super pages - Amazon - Ebay - Rakuten - Wallmart - Insight - Kikatek - CDiscount - Sephore - Bechtel - Farfetch - Zoho - Mouser - bestbuy - officedepot Do let me know if you require further details from our side.
£20 GBP in 1 day
5.0 (1 review)
3.2
3.2
User Avatar
I will use the best python code for scraping. You can provide more details so that i can give you better idea.
£55 GBP in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Please in box me for python ..............................................................................................................................................
£10 GBP in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
San Francisco, United States
5.0
8
Payment method verified
Member since Aug 14, 2016

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.