Cancelled

Script for Scrape data and safe. Fix it

I have a custom code that is used to scrape data from a different website and save images and data in MySQL database. It uses simplehtmldom and Nokogiri to scrape and parse data, angrycurl for proxy connection, etc.. MVC framework is used through the code.

There are bugs and issues that need to be fixed with the code and I need to developer who understand scraping to look into it.

Issues are:

1. fix all the scrapers for the different website to ensure there is no errors and the correct data is being scraped with the correct logic applied before saving into database.

2. There is a refresh mechanism so if the information of a product is changed, products are listed in the refreshed products page. There is a bug prevent this from working.

3. The script also greater XML and csv with product information. Some changes are required to the data and layout of these files.

4. There are currently 2 x [login to view URL] files, so configuration information is saved in two files. Need to merge them info one fire and ensure its secure/safe.

5. Optimize code/script for security and speed of scraping.

Please refer to the attached screnshots.

Skills: MySQL, PHP, Data Scraping, Scrapy, Web Scraping

See more: script pull data internet explorer, script add data mysql, scrape data google map, web scraping python beautifulsoup, scrapy, scraping websites for data, python script to download data from website, data scraping, parsehub, python web scraping library, script to pull data from website, web scraping using python code, web scraping python projects, perl script retrieve data excel, script update data, wallpapers script without data base, access script import data, php script form data csv, simple script import data php, script scrape web page

About the Employer:
( 3 reviews ) Gomel, Belarus

Project ID: #26559271

6 freelancers are bidding on average $50 for this job

benliao

Hello How are you ☆☆☆ My skill Python, web scraping, Selenium ☆☆☆ I think my experience can help you enough. It's always ready, so you can discuss more via chat. If you believe in me please send me a message. Than More

$100 USD in 2 days
(21 Reviews)
5.6
tushortz

I can get it fixed for you with speed .

$70 USD in 7 days
(20 Reviews)
4.5
MukhammedAli

Hi Employer I've read your job post and I can do your website as per your requirement. I believe I could swiftly surpass your expectations for this role. Now I can work full time on your timezone and will keep real tim More

$20 USD in 3 days
(0 Reviews)
0.0
mohandas6205

I am professional data entry expert. I can complete the work with in set target time frame. I am very honest person.

$80 USD in 14 days
(0 Reviews)
0.0
SONAMMASSEY917

Hi, Greetings of the ! As you can see that i am a fresher on this website but let me tell you one thing that i have very good hands on experience on thsese kind of projects. So i can i assure you the quality of the wo More

$20 USD in 7 days
(0 Reviews)
0.0
sushant2911

Hi . My self sushant sharma . I am a Data Entry Professional and designer . I have been working since 7 to 8 year as a Data Entry operator and designer . I have good knowledge in MS excel ,MS design making I take my wo More

$10 USD in 1 day
(0 Reviews)
0.0