Completed

Mass URL Scraper / Gatherer / Checker

I need experienced and reliable Python / PHP programmer/

ABOUT:

Web-based software with 2 parts. App and spider. Spider scrapes the URLs, gathers data for them and displays them to the user. App is Laravel, spider is Python.

Spider not only scrapes URL one time. It also re-checks the URLs in the system every 24 hours.

TASK:

Fix the current spider (stopped working)

Upgrade the spider to be able to handle 1 million URL every 24 hours (now it can handle like 50k)

SKILLS:

Python

Laravel

PHP

Web Scraping

Terminal access

I personally consider it a simple task but your fee is upon agreement.

Also, can you please respond with the result of this?

4 + 5 = ?

Skills: Laravel, PHP, Python, Web Scraping

See more: BIDS/ENTRIES STARTED PRICE (INR) Odoo Accounting data migration I need an experienced Odoo implementer to help me migrate my , I need an experienced freelancer to fix some bugs on existing websites and an app, i need url, mysql, data processing, software architecture, python, linux, web scraping, scrapy, what i need after html and php to make website, i need a nigerian experienced writer for my book, i need someone highly experienced about undesrtand a site code in order to alterate some behavior to do some not natural actions, i need help with wordpress php, i need an experienced retired global health expert to volunteer in dallas, i need an experienced ebay seller, mass url checker keyword, help need experienced web programmer php xoops mysql, php google blogsearch url scraper, php google url scraper

About the Employer:
( 5 reviews ) Orchard Towers, Slovakia

Project ID: #17036840

Awarded to:

sisodiakaran

The answer is 9. Greetings of the day! Thank you for posting the job. Have gone through your requirements and would like to work on this. I would like to update you that I have been working on the similar requ More

$250 USD in 15 days
(19 Reviews)
4.5

21 freelancers are bidding on average $203 for this job

sapotacorp

Dear proloa! I am highly proficient at building and customizing themes & plugins and also have an in depth understanding of PHP and its major CMS and frameworks. Our latest Slovakia's projects: [login to view URL] More

$198 USD in 5 days
(685 Reviews)
8.4
schoudhary1553

9 Hello, I can help with you in your project Mass URL Scraper / Gatherer / Checker. I have more than 5 years of experience in Laravel, PHP, Python, Web Scraping. We have worked on several similar projects before! More

$250 USD in 3 days
(47 Reviews)
6.2
radimosve

Hello I am available right now, how are you? I have developed 100+ websites in many programming languages for clients all over the world. proloa could you please inbox me more detail about this project?

$155 USD in 8 days
(38 Reviews)
5.2
maximwang8661

hello. nice to meet you. I am a good scraping expert. I have a lot of experience in scraping by means of python(selenium, scrapy) and php(Laravel). I want to discuss about your project with you. If you hire me, I More

$155 USD in 3 days
(13 Reviews)
4.7
Infourier

Hello, We are a hard-working web-development company We can develop cross-browser, W3C compliant good quality professional websites. We have gone through your requirement and have done this kind of work in th More

$155 USD in 3 days
(5 Reviews)
3.9
yingli1987

Also, can you please respond with the result of this? 4 + 5 = 9 Hello, I read your job posting carefully and I'm interesting in your job. My major language for scraping is python/node/php with some packages(s More

$222 USD in 3 days
(33 Reviews)
3.5
$222 USD in 3 days
(2 Reviews)
3.7
celestialUK

Hello, i can fix your web interface and spider. I am an experienced Laravel - PHP developer. Also your answer for bots is 9 . Thanks.

$30 USD in 2 days
(9 Reviews)
3.6
sudhirchhag

Hi, I had a good look at your requirement, I have done similar kind of task in past on Laravel. I have high-level expertise in LARAVEL and keen to discuss your requirement in more detail. Sample Work Infocell More

$277 USD in 3 days
(1 Review)
3.3
dwivedisunny31

4 + 5 = 9 Dear Client , Greeting from Prashant. I'm a expert web programmer, web designer, working mainly with Php,mysql,Laravel,Wordpress,UI/UX design,html5,css3,html,css,bootstrap,psd to html.i have 6+ year work More

$155 USD in 7 days
(3 Reviews)
3.0
mohdhathi

9 I have 6+ years of experience in Python and web-scraping using scrapy, spider.

$500 USD in 3 days
(1 Review)
0.8
Atkum

I have 6 year experience Freelancer,up work,Fiverr & 99design market place I have seen your project that i can to do easily because I have many experience to Graphic Design,Webdesign,Web Develop & programming .So I cou More

$277 USD in 3 days
(0 Reviews)
0.0
alihaider5152

we read your requirements about Mass URL Scraper / Gatherer / Checker cryptocurrency exchange like [login to view URL] here is our previous cryptocoin project please visit [login to view URL] [login to view URL] More

$35 USD in 1 day
(18 Reviews)
0.0
developer21af

I am experienced in python scrapy and php laravel. I can do your project with best quality. I will use scrapy framework for spider and latest version of laravel for web application considering all security and standar More

$199 USD in 10 days
(0 Reviews)
0.0
mayankinnovative

Dear Client, We are expertise in php, core php, CMS, HTML5, CSS3, bootstrap, WordPress, OpenCart, Magento, PSD to HTML, Angular JS, Node JS photoshop, OPencart, Codeignitor, Laravel and many other technologies. We have More

$138 USD in 3 days
(59 Reviews)
0.0
etuannv

4 + 5 = ? Hi there, I have 3+ years experience at Web scraping with Scrapy. I have done some similar projects which scrape data from [login to view URL], [login to view URL], [login to view URL],... I think It is not easy to g More

$500 USD in 3 days
(36 Reviews)
0.0
yongjin818

9 Dear I am an expert in web scraping. In before, I developed many spiders using scrapy. For example, I did scrape sites of products for CEOs(ebay, welivv and so on). Thanks.

$155 USD in 3 days
(44 Reviews)
0.0
mohsinalizafar

4 + 5 =9 Hi sir i can do this project easily please message me so that we can have discussion i am waiting for response Thanks

$155 USD in 3 days
(8 Reviews)
0.0
$90 USD in 3 days
(0 Reviews)
0.0
kaloyan13

4 + 5 = 8 + 1 Parallel programmer with experience in scraping in C,C++, Python, PHP and some others. I can look at your current spider code and make it parallel, or use other techniques to speed it up.

$150 USD in 4 days
(47 Reviews)
0.0