Web scraper for newspaper website

Completed Posted 4 years ago Paid on delivery
Completed Paid on delivery

Need a website scraper to capture only the headline, subhead, and body of article from a newspaper website. Requirements:

1. Output must save each article to a separate .txt file.

2. I have hundreds of URLs that need scraping. The scraper must be automated so that it scrapes each page automatically, without having to manually enter a new URL for each run.

3. Scraper may need capability to log into website to get past paywall.

4. Must be operable on a Mac.

5. It would be ideal if the program could, separately, create a comma-delimited file that lists all of stories by headline and the number of words in each file.

Web Scraping PHP Python Software Architecture Data Mining

Project ID: #22333560

About the project

13 proposals Remote project Active 4 years ago

Awarded to:

elbruninh

Hi, i'm interested, could you give me more details please? can you send me the URL's list? i can make php scrapers i have 18+ years of experience with PHP and scraping let me know if you are interested i am available More

$150 USD in 1 day
(111 Reviews)
6.5

13 freelancers are bidding on average $138 for this job

YuriyStepanovich

Hi. I’m senior software engineer and I can do your project perfectly. Please visit my profile so you would be noticed about my talent and trustworthy. My talent and trustworthy will make your project meet success. I ho More

$140 USD in 7 days
(12 Reviews)
7.2
StormLion227

Hello. My name is Marko and I am an Engineering Graduate with an MBA degree. I am a full time freelancer and I will work hard on this till completion. A Web Scrapping Expert on freelancer.com and I do not bid on p More

$155 USD in 3 days
(96 Reviews)
6.8
luiswilliam

Hi, andjonc! I read the description of your project thoroughly. I understand your requirements initially and I have experiences of the field. I am a specialist of: * React.js, Angular for Front-end, * .NET Core API More

$140 USD in 2 days
(77 Reviews)
6.9
cyberloh

hello, i'm an experienced web automation developer and building scrappers for 10+ years here on freelancer - you can check my profile to see a lot of copleted scraping scripts. so i can automate your task easily. let m More

$200 USD in 3 days
(26 Reviews)
6.7
rubnawazquraishi

Hi, I can do within few hours (2 to 3) I have experience with web scraping as well as complex pagination data. Can we discuss over chat? Best Regards Rubnawaz

$50 USD in 1 day
(22 Reviews)
6.0
writingapp

Hi. I am ready to write your project Write apps on your demand in many languages (Visual Basic, VBA, VBS, .NET, C#, JS, Python, Java, PowerShell) Write database apps including many db formats: MS Access, MS SQL, SQL More

$95 USD in 2 days
(52 Reviews)
5.5
arjun366333

Ready to start the work to create the scrapper for the newspaper website, please check my recent similar work, we can discuss more over chat, thanks regards kanta singh. Scrapping projects link : [login to view URL] More

$100 USD in 7 days
(30 Reviews)
5.5
ChaoTian0109

Hello, How are you? I'm very interested in your job post.I believe my skills would be ideal for your project. I am Python Expert and I can help you perfectly. And then I am a good english speaker. So anytime,anywhere y More

$250 USD in 3 days
(8 Reviews)
3.8
saniahayat

♚♚➤➤Ready to start your work right now. I will impress you with my work and will do good job for you. 10 Year experienced in Excel, word, typing, data scraping, Web scraping.

$75 USD in 1 day
(9 Reviews)
3.8