Aggregate / import multiple XML files & site scraping script for additional fields

In Progress Posted Oct 19, 2014 Paid on delivery
In Progress Paid on delivery

- Read data from multiple feeds with different xml / csv structures

- Import Data into new SQL DB adding a new unique id number

- Save one image on own server to improve speed

- Fix City: Map City (UK) where only a postcode is available

- Scrape facilities where needed

- Scrape with multiple ip’s ( with [url removed, login to view] or other solutions )

- Check changed items and sync all new data

Description:

We are looking for a php / javascript developer or a development company which can aggregate 5 xml/csv feeds into one (sql) database. This custom developed script should have the option to manually reimport the daily updated / uploaded data. All feeds together contain about 7000 holiday homes in the uk. The following fields need to be imported : Title, Description, Url, 1 Image, Region, City, Postcode, Latitude, Longitude , Bedrooms, Sleeps, Pet friendly, Seaview

Please do keep in mind that every feed has a different structure!

Below is a brief explanation about the structure.

Feed 1:

Available in feed: Title, Description, Url, 1 Image, Region, City, Postcode, Latitude, Longitude , Bedrooms, Sleeps, Pet friendly,

Feed 2:

Available in feed: Title, Description, Url, 1 Image, Region, City, Postcode, Latitude, Longitude , Bedrooms, Sleeps, Pet friendl

Feed 3:

Available in feed: 2 separate feeds

1) Title, Description, Url,

2) 1 Image, Region, City, Postcode, Latitude, Longitude , Bedrooms, Sleeps, Pet friendly,

Feed 4:

Available in feed: Title, Description, Url, 1 Image, Postcode, Sleeps,

Not available in feed: Region, City ( Recalculated based on postcode )

Scraping: Bedrooms and Pet friendly visible on top of page, Latitude and Longitude available in html code from google maps

Feed 5:

Available in feed: 2 separate feeds

1) Title, Description, Url, 1 Image,

2) Region, City, Postcode, Latitude, Longitude , Bedrooms, Sleeps, Pet friendly

* The largest XML feed is 14 MB

All homes need to be searchable with just one search box that retrieves all holiday homes.

From there on we will integrate the script in our website.

JavaScript PHP Web Scraping XML

Project ID: #6613208

About the project

21 proposals Remote project Active Oct 29, 2014

Awarded to:

yeremyss

I am a programmer with over 12 years experience. A couple of months ago did a similiar work for a real estate where different feeds were imported from different sources and were processed according to the template defi More

$750 USD in 30 days
(2 Reviews)
4.1

21 freelancers are bidding on average $587 for this job

meet2amitvw

Let's discuss over freelancer Personal Message Box for the proper estimation of cost and time. I am myself doing programming so you will directly work with one person and that's me. No mediators. No managers. No sub More

$773 USD in 10 days
(100 Reviews)
8.4
zainy01

Hi I've expertise in DBMS(Oracle, MS SQL, mysQL), magento,wp ,joomla, ASP.Net MVC,WCF and asmx services , PHP, Client side(JQuery Prototype). i've seen the requirements and I'm interested in it, I've tons of experie More

$684 USD in 10 days
(102 Reviews)
7.4
zeke

I have lots of experience with similar web scraping projects. Very interested to work on this project. Available to start immediately and finish as soon as possible. Please contact in PMB to discuss details if you are More

$555 USD in 20 days
(183 Reviews)
7.2
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$593 USD in 6 days
(222 Reviews)
7.1
AndrwProjects

Hi farkas. I did imports/aggregation from complicated xml\'s. Also i deal with homes data feeds/csv\'s, I think i able to work on such project, and this possible case that i complete it just perfectly. -Andrew.

$600 USD in 21 days
(205 Reviews)
6.6
uumairkhalid

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. More

$555 USD in 10 days
(109 Reviews)
6.5
CodingExpertz

Hi, I looked your posting and I am very much interested to work with you ...I am an India based software professional providing a range of IT services and solutions that address the technology needs of your company in More

$789 USD in 7 days
(118 Reviews)
6.4
uumarkhalid31

hi, i am expert in web scraping and interested in this project, let me do this work with perfection, accuracy and according to your requirements, plz contact with me so we can discuss further about the project and plz More

$555 USD in 10 days
(84 Reviews)
6.1
raiakanksha49

Dear, I am new in freelencer but I have 6 years experience.,If you hire me i will give excellent work and quality services for you and your requirements. if u give me this job ican do this job with 100% accuracy and i More

$736 USD in 20 days
(23 Reviews)
5.4
gutibs

Hello, i can do what you need, but have some questions: You do have access to all those xml files or you need to scrape them? Can you give me the url to the site you need to scrape? (feed 4) And then, the search box More

$722 USD in 5 days
(47 Reviews)
5.3
quickapp100

we did similar kind app Hi we are a software development company from india in past 8 years me & my Team developed approx 950 projects for global market , we try to satisfy clients needs . we developed lots of p More

$555 USD in 4 days
(6 Reviews)
4.4
nikvasi

Hello sir, we are very experienced in web scraping company. We did lots of scraping projects. Best regards, Nikolay Gromov

$385 USD in 5 days
(14 Reviews)
4.4
gafmxq

I am an Java expert and can do it for you in Java language. I did several similar projects before, so I can do it easily for you.

$500 USD in 10 days
(4 Reviews)
4.0
takman

Hi, 10+ years experience in web projects with PHP, ASP, .NET, SQL Server, MySQL ... and great skills in data scraping/parsing from the internet. I can handle the project and worked on many similar projects. Ready More

$388 USD in 5 days
(7 Reviews)
3.1
applnetcode1221

Hello. Thank you for your detailed post. I am a Java/Web expert have many experiences of 10 years. Web scraping is my hobby and i have professional experiences of these fields. Please call me. I can help you. wai More

$250 USD in 10 days
(2 Reviews)
0.9
betauli

Yes, absolutely. I can help you to aggregate from multiple feeds. I have coded PHP script similar like this several times. Normally, I can done this in 3 days. I can start the job immediately after you make a milest More

$555 USD in 10 days
(0 Reviews)
0.0