Fix PHP code for website product scraping -- 2

Closed Posted 3 years ago Paid on delivery
Closed Paid on delivery

I have a custom code that is used to scrape data from a different website and save images and data in MySQL database. It uses simplehtmldom and Nokogiri to scrape and parse data, angrycurl for proxy connection, etc.. MVC framework is used through the code.

PS: please write 'nokogiri' in your response to make sure you have read the description.

There are bugs and issues that need to be fixed with the code and I need to developer who understand scraping to look into it.

Issues are:

1. fix all the scrapers for the different website to ensure there is no errors and the correct data is being scraped with the correct logic applied before saving into database.

2. There is a refresh mechanism so if the information of a product is changed, products are listed in the refreshed products page. There is a bug prevent this from working.

3. The script also greater XML and csv with product information. Some changes are required to the data and layout of these files.

4. There are currently 2 x [login to view URL] files, so configuration information is saved in two files. Need to merge them info one fire and ensure its secure/safe.

5. Optimize code/script for security and speed of scraping.

Please refer to the attached screenshots.

PHP Web Scraping MySQL MVC Scrapy

Project ID: #26561702

About the project

7 proposals Remote project Active 3 years ago

7 freelancers are bidding on average $46 for this job

raminde

Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered resul More

$56 AUD in 1 day
(14 Reviews)
6.3
vovapod

Hello! Can you provide full documentation for API? What exact functions of API do you want to use? Thank you for your time.

$20 AUD in 7 days
(42 Reviews)
5.7
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

$30 AUD in 2 days
(110 Reviews)
6.0
swapnaja2292

HI, We're a Website design and development company with a focus on user-centered design while helping our clients achieve the desired result. We reviewed the job post and we're qualified to deliver the solution that y More

$20 AUD in 7 days
(0 Reviews)
0.0
fillips8

Hello! I can provide you full support for this project. I have high experience with web technologies and I am pretty sure I can help you. So, let's start!

$75 AUD in 7 days
(0 Reviews)
0.0