Website Crawler / Scraper

In Progress Posted 5 years ago Paid on delivery
In Progress

I need a website crawler to crawl the following websites for "For Sale By Owner" and "Make Me Move" in the location "Staten Island, NY" / Brooklyn, NY" and "Manhattan, NY”

- Zillow

- [login to view URL]

- For sale by owner . com

- Trulia

The output must be in Excel. The excel must have the following columns:

address Owner Phone On Do Not Call List?

(Yes, No, No area code) URL

And the URL must be the Zillow url or any other websites that has information.

I need the crawler to run automatically every morning and to email the results to an email address.

The crawler must cross reference the phone numbers from the crawler with phone numbers on an “XML” list that I will be able to post into the program on a daily basis to refresh the list.

If there is no match with the do not call phone numbers, then mark "No" to do not call list - if the first 3 digits of the owner's phone number is not one of the 5 phone area codes that are provided, it must state "No list for area code".

The crawler must be sorted by “On Do Not Call List” with “NO” on the top

Additionally, the crawler must be able to send emails automatically to all of the listings on the websites that are “For Sale By Owner”

And the crawler must be able to pass Captcha tests – I can manually watch it as it runs and pass the captcha tests for it

Java PHP Software Architecture Web Scraping XML

Project ID: #18091013

About the project

21 proposals Remote project Active 5 years ago

Awarded to:

devi222

Hi Sir, I can create a Python script with all the features you asked, I have already created script for Trulia and Zillow. I’m a Python Programmer. I have created many Bots to scrape the websites like Amazon(UK, USA More

$20 USD / hour
(152 Reviews)
7.0

21 freelancers are bidding on average $20/hour for this job

zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$20 USD / hour
(176 Reviews)
7.9
nataliaomelchenk

Hi there. Nice to meet you. I'm a Web scrapting expert and FULL Time Developer. I have checked your requirements carefully. I have rich experience in web scraping, Python, PHP, Micro, MySQL, etc . I can start wor More

$22 USD / hour
(64 Reviews)
7.6
schoudhary1553

Hello, Hope you are doing well. I can help with you in your project Website Crawler / Scraper. I can assure you the quality job. I have good experience in Java, PHP, Software Architecture, Web Scraping, XML. W More

$20 USD / hour
(140 Reviews)
7.4
ferozstk

Hello, After reading your project details I believe I'm suitable for this project. As I'm expert on this kind of project with more than 5 years experience. Please feel free to contact me. I am looking forward More

$25 USD / hour
(151 Reviews)
6.8
sunmoon25

Hello I understood the task. I will show you sample before start the work. I ensure I will give you all accurate data as stated. I have done many difficult web scraping projects successfully. Please contact with me f More

$20 USD / hour
(76 Reviews)
6.4
fleedsteed

Hi client I just check the functions and specs for this project I have done many projects with scrapy and other python libraries I can do this project with nodejs or python, c# I can also able to manage the crawl o More

$22 USD / hour
(32 Reviews)
6.2
retroshell

hello, I've read your project details, Creating Scrappers is my Skill. I've checked the websites and saw it's easy to fetch data, Demo projects: Scrapper for Google shop https://www.freelancer.com/projects/p More

$18 USD / hour
(22 Reviews)
5.0
Xeeshanah

Hi there, Read the description you have provided and I can provide you a Web crawler in c# and java based upon your preference if any. I am a professional developer and I have been working on similar projects for the l More

$20 USD / hour
(27 Reviews)
4.5
DataHome

Hello there An expert scrapper at your service May be I can able to help you out with scrapping all your required details from listed site with given criteria Let us discuss further Kind regards Amaan

$16 USD / hour
(12 Reviews)
3.8
bernardopoliv

Hello" How are you? I would love to join this project with you. I am a economist/developer for VBA and Python scripts. Web scraping is one of my strongest points in programming and as I can see in your project, see More

$20 USD / hour
(5 Reviews)
2.9
arashbahrami1

Hi I’ll do it for you with JMeter Tools which is the most powerful testing and crawling tools to extract information with any format you need.

$16 USD / hour
(3 Reviews)
2.4
ddev2152

Hi , I am expert i Java and scrapping job. Connect to me , so we can have a discussion on your project. Thanks

$33 USD / hour
(1 Review)
1.4
dedycatedinc

I have successfully delivered many projects in many different company and clients. I have a strong Programming and Management skills and always updates myself with Research and Development of new technologies to streng More

$16 USD / hour
(1 Review)
0.0
mmedmaalej

Hello, I'm a fullstack Java developer. I have extensive knowledge in working with Application Servers and server-side apps as well as front-end apps. I've always strong skills in DS and algorithms and have interv More

$22 USD / hour
(0 Reviews)
0.0