Find Jobs
Hire Freelancers

only php-curl and regex., script for parse data, using cookie file edit via script with get correct page

$30-250 USD

Cancelled
Posted about 5 years ago

$30-250 USD

Paid on delivery
hello, need to make modification on existing script, only php-curl and regex., script for parse data, using cookie file edit via script(there will be changed data for saved city) or another way for get correct page depnding on selected city, need to know how to use http traffic analyzators like httpanalyzer or wireshark or similar for make a fast research and find the best solution for the current task, see attached script which need to use for modifications. also please keep in mind we can make similar thing and already made many of them very easy just for some hours, so, it like a challange for you and test before bigger projects with us, please show how good you are with these tools and how fast your brain can make analyze of all variables for this task. In short the script must to get list of all items from DB or file or another source(csv, etc..) it is not important, important part is when it go to an item page and parse data and detect if item is prime and if it available and most important thing if it can be delivered inside the country no more than 3 days. Also use generated file with proxies(also need to add conditions for avoid wrong data from bad proxies). so at the end must be a fully working prototype with including all possible conditions for any case which can stop the script and avoid it(for example if bad proxy after three attempts just change the proxy and delete it from later using and so on), write your price, and keep in mind abou your price will be paid only when the script will work with list of proxies and never stop, we will send more lists of proxies for your tests, we use our own proxy generators for get only elite proxies, so it one of the conditions for check answer via proxies, also you will need to check different web browser agents($usrAgent="Opera/9.80 (X11; Linux i686; U; ru) Presto/2.9.168 Version/11.52") for analyze answers(also detect gzipped pages and make condition for correctly process it). Use these categories for tests: You can use attached demo file [login to view URL] or create your own. Antiquarian, Rare & Collectable(3rd page) [login to view URL] Arts & Photography(2nd page): [login to view URL] Biography(4th page, when press NEXT): [login to view URL] Business, Finance & Law(1st page returned after second) [login to view URL] Calendars, Diaries & Annuals(url copied from menu on main page with books) https://www.amazon.co.uk/s/ref=lp_266239_nr_n_4?fst=as%3Aoff&rh=n%3A266239%2Cn%3A%211025612%2Cn%3A507848&bbn=1025612&ie=UTF8&qid=1554433092&rnid=1025612
Project ID: 19148102

About the project

4 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
4 freelancers are bidding on average $312 USD for this job
User Avatar
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta
$277 USD in 6 days
4.9 (63 reviews)
7.1
7.1
User Avatar
Hello, Thank you for inviting me to you project. I'm experienced bot developer and I can do this. I'm using cookie file because it is very bad approach if some modifications are needed, but instead I'm gonna handle all cookies in memory (by parsing response headers). I can rotate your proxies and if request fails after e.g. 10 attempts, throw an exception. I will create fully object oriented project and you will never see the ugly code like the one you sent me (sorry if it's yours XD, but it is just very bad script because you are hard coupling everything) It will be very fast! It will handle errors (logging) I can write shell scripts (systemd daemon) which will create a new process, so it is very good for multiprocessing. Lets have a chat. Cheers, Borna
$500 USD in 7 days
5.0 (14 reviews)
6.0
6.0

About the client

Flag of RUSSIAN FEDERATION
Zhigulevsk, Russian Federation
4.1
41
Payment method verified
Member since Dec 22, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.