Find Jobs
Hire Freelancers

Write a PHP/JS script to scrape data from CloudFlare protected website

$10-30 USD

Closed
Posted about 7 years ago

$10-30 USD

Paid on delivery
I'm looking for a skilled programmer who can help me with the following scraping task. I need to scrape several thousands of pages from a website that is behind CloudFlare protection. Can't do it with PHP/cURL. I need to use some kind of helper library, i.e. CloudFlare-PHP-Bypass ([login to view URL]) and JavaScript ([login to view URL]) - but i couldn't get it to work and i need help. An example of an URL is [login to view URL] - please look at the target URL after the redirection, you will see a number at the end of it. This is the only thing that will change, i need to scrape the HTML for thousands of consecutive pages into local files. PHP is highly preferred, but if you can provide an alternative solution i will consider it. If you do well, i need help with jobs like this on a regular basis.
Project ID: 13339343

About the project

9 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
9 freelancers are bidding on average $68 USD for this job
User Avatar
expert scraper to deliver the project
$111 USD in 5 days
4.8 (174 reviews)
7.6
7.6
User Avatar
What about simply manually copy cookies from the browser and use them in the script? How many pages do you want to process? Thanks. Roman
$45 USD in 1 day
4.9 (296 reviews)
6.8
6.8
User Avatar
Hello My name is shahid from Kashmir Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years rich experience in the field.I have successfully completed more than 1000 projects in this field you will be glad to know that I am best fit for your project my key skills are. Python Email developer, software architecture and Scrapping expert with 5 years of experience. Linkedin API developer. Using Python, Wordpress , C Programming ,  C++Programming, Linux,PHP,MYSQL ,Java ,Javascript,  ,Website Design ,Graphic Design,CSS,Research,MATLAB and Mathematica ,Leads ,Web Search ,Machine Learning ,HTML5 ,LinkedIn ,Landing Pages ,Web Services ,Internet Research ,Angular.js ,,Data mining,,Web scrapping,Find contacts, Data Processing, Data Entry, Excel, Leads, Web Search, Data Mining, Linked in, Microsoft Office, Email handling. I am a highly skilled web researcher,data entry provider seeking an opportunity to leverage my expertise and demonstrate my high level of technical an administrative skills. I have successfully completed more than 100 projects ranging from, WordPress , C Programming ,  C++ Programming, Linux,PHP,MySQL ,Java ,JavaScript  ,Website Design ,Graphic Design,CSS,Research,WordPress ,Magneto ,Leads ,Web Search ,Machine Learning ,HTML5 ,LinkedIn ,Landing Pages ,Web Services web research, data entry, Internet Research, LinkedIn , Lead Generation, Google docs & Excel Spreadsheet creation/editing. You can test the quality of my work and also i provide work at best price in the market. Regards:
$10 USD in 5 days
4.9 (10 reviews)
4.9
4.9
User Avatar
I have read your project. I'm sure i can help you to do it. I am expert in web scraping. I have created many scraping tools. I have 7 years of experience in Web Development, System & Network Administrator and Security Researcher. Choose me then you will work with a Professional Devops, you won't be disappointed. Thanks.
$88 USD in 1 day
5.0 (27 reviews)
4.9
4.9
User Avatar
Hi Lonek, I am competitive to this kind of task, can take good care of this project. In fact, I already done related to this job before. Let me know the best of your time so we can discuss further based on your requirements and we can move forward to the next step. Thanks, Joseph C Ocero
$29 USD in 1 day
5.0 (9 reviews)
3.2
3.2
User Avatar
We are team of excellent developers and writers. We have 2 year experience related to your project field. We can do your project and solve your all problems according to your requirements. We have read your description for projects and we understand what you want so we are confident that we can do it easily in mention time. We assure you that you will be completely satisfy with our work. And after delivering your project if you feel some issue in understanding the projects then we will teach you free until you understand. If you have any question then feel free to ask. We are here for you. Thank you
$25 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I've looked at the libraries that you mentioned and they might work, but for good reliability(so you don't post this exact same job when cloudflare breaks them and you're left to dry until they get updated) I'd use a mshtml2 solution(basically encapsulating the windows IE engine into a windows app). I know it's not PHP, but the extra cost(if any) incurred by getting a WIndows VPS is minimal. I run my crawlers on 10 dollar/month VPSs with no issues The page structure seems pretty easy to process, I've written a quick demo to fetch pages and get parts of the content and I can see nothing that would stop me from finishing the project in a day. Thanks, V
$35 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of POLAND
Szczecin, Poland
5.0
20
Payment method verified
Member since Sep 6, 2004

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.