Closed

Programmer to Build Crawler and Word Counter

Looking for a talented programmer to build a website crawler that will periodically (every hour) scrape the entire site and count how many times specific words or strings of words are found on said site.

I essentially want to be able to answer this question:

What is the change in count of the word "Detroit" on Reddit in the:

- Past Month: +0.2%

- Past week: +1.2%

- Past 3 days: +2.2%

- Past 2 days: +7.1%

- Past 24 hours: +9.3%

- Past 12 hours: +15.4%

- Past 6 hours: +23.1%

- Past 3 hours: +78.9%

- Past 2 hours: +381.3%

- Past 1 hour: +1,352.6%

The deduction would be that something may have happened in the city of Detroit in the last 3-6 hours that has sparked online discussion.

I understand that data would need to be recorded to go further back in time. IE, I would not be able to get change in the last 2 hours without first running the program for at least 2 hours. This information will not appear instantly.

I need to be able to search/count up to 10 words at in tandem. And be able to key in the words so that I can change them at any time. Prefer reports to be viewed in excel.

Skills: PHP, Web Scraping, Python, HTML, Software Architecture

See more: looking iphone programmer, looking hire programmer specializes adobe flex programming, looking pic programmer, looking cart programmer, looking web programmer, looking joomla programmer, looking net programmer, looking xcode programmer, looking jamroom programmer, looking freelance programmer, looking cakephp programmer, looking mfc programmer, looking plc programmer, find talented programmer, looking php programmer philippines, looking flash programmer, looking php programmer, looking php programmer freelance, looking typo3 programmer, looking for programmer to build mobile game

About the Employer:
( 0 reviews ) Chicago, United States

Project ID: #29904950

18 freelancers are bidding on average $22/hour for this job

techplusintl

Hi there, ★★★ Scrapping / Python / Selenium Expert ★★★ 10+ Years of Experience ★★★ I've read requirements and ready to build a website crawler . Some major works we do: ✔️ Product Websites Scraping: eCommerce (Shopif More

$25 USD / hour
(240 Reviews)
7.7
(169 Reviews)
7.5
chirgeo

Hi, my name is George. I read the project description and we are happy to help you. Sure, let me know the website you are looking into and we can create smth for this. At [login to view URL] we are developing a ne More

$30 USD / hour
(146 Reviews)
7.7
mmadi

Dear Client. I have read your requirements carefully and I am very interested in your project. I have a lot of experience in this field in cluding your requested skills of HTML, PHP, Python, Software Architecture, We More

$20 USD / hour
(51 Reviews)
7.2
ZhangDa

Nice to meet you on freelancer. My name is Da Zhang. I ever did a similar project, let me explain the project I did. * It's hundreds scrapers for hundreds city websites. * Each scraper will run every day. * Each scrap More

$20 USD / hour
(56 Reviews)
6.8
TeamDPS

hi sir am interested in your project. myself 6 years experienced web and desktop developer. I found myself eligible with my experience for your task. for assurity of work and quality you can go through my profile and r More

$22 USD / hour
(152 Reviews)
6.1
alexeydanilovfr5

Hello web scrapping/crawling with python selenium, request, and PHP Curl is what I have already specialized in Please contact me and let me know your project in detail such as the site url I can start immediately and w More

$20 USD / hour
(14 Reviews)
6.0
RaulBlanko

Hello, I am a Python developer. I can write this Reddit crawler for you. I can provide excel output of the report you need. Best regards, Pavlo

$20 USD / hour
(33 Reviews)
5.5
nemanjadevelope2

Hi. Hope you are doing well. I have read your project details and I am sure to do this project. I have rich experience with python over 6 years and strong experience with Web Scraping. I think you want desktop app whic More

$20 USD / hour
(11 Reviews)
5.2
sergadamd

Hi, I understood your project. This is what I undertood. You need a web crawler that runs every hour or minutes that scrape the whole webite to find specific words or specific string of word throughout the website. The More

$25 USD / hour
(23 Reviews)
5.1
hntcoder

Hi! I’ve rich experience in Scraping, Building Crawler, Automation. I suggest you use Javascript libraries like Puppeteer, Playwright which can scrape data dynamically. These are the best libraries with powerful functi More

$25 USD / hour
(21 Reviews)
5.3
celestialUK

Hello, I can make you a scraper using PHP and simple_xml_dom. I will provide you an admin panel where you can download your reports, change your keywords etc.. Feel free to contact me on chat for more details. Thanks.

$25 USD / hour
(19 Reviews)
5.3
nitishghimire

hi, I am a Computer Engineer with 5 years of experience in PHP(Laravel), React Native and Python. I have worked on several similar projects E-commerce Websites, Python Scraping and ERP Applications, and can deliver qu More

$20 USD / hour
(5 Reviews)
3.7
aqsa38282

ECOMGRID provides of eCommerce solution comprise of 41+ employees working with clients to provide business solutions. Our company works using agile methodology to provide research and prototype to the solution using t More

$20 USD / hour
(0 Reviews)
0.0
rishabhsarkar46

I have acquired good analytical and coding skills in. While being a college student I have done many computer lab which are mainly base on algorithmic problem which has helped me to develop my analytical and coding sk More

$20 USD / hour
(0 Reviews)
0.0
baahkusi

I have experience building similar software for US companies. If you like I could even make it a desktop application you can run locally with no need for server cost. There is a way to get your preferred data without e More

$15 USD / hour
(0 Reviews)
0.0
Solace2

Hi, WE CAN START JUST NOW We are here for your business Hello. client. could you share your project with me? We are well versed PHP, Python, Web Scraping, Software Architecture, HTML We are also have creative More

$20 USD / hour
(0 Reviews)
0.0
(0 Reviews)
0.0