Find Jobs
Hire Freelancers

Scraping Tool - Looking for a long time partner -- 2

€30-250 EUR

In Progress
Posted over 2 years ago

€30-250 EUR

Paid on delivery
First Version Requirements: The Script has to run on an MacBook Pro (processor: 2,5 GHz Quad-Core Intel Core i7 | RAM: 16 GB 1600 MHz DDR3) 1. daily scrape: go through all listings once a day. 2. update database If any changes are detected, the corresponding advertisement must be updated in the database. The price history must not be lost. If an already scraped advertisement is no longer available, the entry: 'sold' is added to the database entry. 3. blocking safe The website blocks after 20 requests. So it must be taken into account that the site quickly punishes with restrictions. 4. CSV export A clean export is expected or store it in MongoDB The required information i need from the page can be found in the HTML appendix. If we are happy with the Version we will discuss any further details of the project.
Project ID: 32727420

About the project

10 proposals
Remote project
Active 2 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi Hiring manager I am Web Scraping (Crawling) Expert I am an experienced freelance software developer with over 14 years experience providing web scraping and data extraction services using Python. I write custom code to crawl and extract different types of data from numerous sources including real-time data, websites requiring authentication, business listings, real-estate, etc. My expertise lies in automated web scraping of extremely difficult to obtain data, websites with bare bones structures and complex to parse, large scale websites, websites using obfuscated protocols and authentication, including those using 'scraping protection' services and sites that simply put - no-one else can scrape. I use a variety of methods for getting the data and aim to obtain the data as quickly, accurately and efficiently as possible. My technical skills: -️ Building scrapers for your needs as Wordpres plugin, Chrome extension, Console application or Desktop application -️ Selenium Webdriver -️ Python, PHP, C# -️ Auto Login -️ Imitating user events (button clicking, form filling, page navigating, page scrolling etc.) -️ Proxy (Making web scrapers to use proxy to reduce risk of being detected & blocked) -️ Scraping Ajax / Javascript Content Generated Websites (If you can see the data in your browser, I can scrape it) -️ Network listening - I can find hidden API endpoints of websites and use them to gather data easily. Thanks
€250 EUR in 2 days
4.4 (47 reviews)
6.5
6.5
10 freelancers are bidding on average €172 EUR for this job
User Avatar
! I am professional Python software engineer. I am familiar with Python and I have a lot of work experiences in Software Architecture, JavaScript, Python, PHP and Web Scraping. I can start right away. I want to discuss for this project in detail. Please send a message to discuss more regarding this project. Thanks for giving opportunity
€150 EUR in 5 days
5.0 (34 reviews)
6.1
6.1
User Avatar
Hello there. I am very interested in your project. Please feel free to contact me so we can start right now. Regards. Stevan.
€140 EUR in 7 days
5.0 (10 reviews)
4.8
4.8
User Avatar
Hi, here I am scraping exporter and you can my scraping result in my profile I have much experience with 8 years Thanks for your fascinating proposal that is suitable for my skills. I am sure that I am the right developer for your project. Please don't waste your golden time finding another freelancer. If you hire me, you will get to know that I have all the necessary skills and advantages for your project. Would you like to tell me more about your project, please? I hope to make another perfect result with an excellent client. Thanks again.
€200 EUR in 1 day
4.9 (10 reviews)
4.2
4.2
User Avatar
* * * * * * * * * * * * * * * * * * * * * * Hello Maximilian , I hope you are doing good!! I am having 5+ years of experience with relevant skills. Let's finalize in chat and move further. Looking forward to hear from you. Thanks Nandita Patel Please note that this is a placeholder proposal, we can be more specific once we get all the requirements and information required to execute the project .
€140 EUR in 7 days
5.0 (1 review)
3.8
3.8
User Avatar
Hi, Sir As a python expert, I am familiar with web scrapping. I have experienced in making several bots using selenium and beautifulsoup. To make a bot, csv knowledge is mandatory. As for mongodb, there is no problem to me. I am sure I can handle your requirement without doubtness. Let us have a chat to discuss timeline and budget. Thanks.
€250 EUR in 5 days
5.0 (6 reviews)
3.7
3.7
User Avatar
Hi there. I have checked your requirements carefully. I'm very glad to bid on your project. As a Python Web Scraping developer, I exactly understood what you want. I have skillful knowledge of BS4, Selenium web automation, captcha resolver. I would like to discuss more details via chat. Best Regards.
€140 EUR in 7 days
5.0 (2 reviews)
2.8
2.8
User Avatar
Hello, Hope you are doing well! I have checked your requirement. We have already work on similar requirements in past. We have right skills to work on this assignment. We will complete the work as per the requirements. We have expertise in Python, Django, Flask, ORM, Jinja 2, WordPress, PHP, HTML,CSS. We will start the work immediately once we set a milestone. Waiting for your message
€140 EUR in 4 days
5.0 (4 reviews)
1.7
1.7

About the client

Flag of GERMANY
Dessau-Roßlau, Germany
5.0
2
Payment method verified
Member since Apr 26, 2021

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.