Find Jobs
Hire Freelancers

Build link checker website crawler

$30-5000 USD

Completed
Posted over 14 years ago

$30-5000 USD

Paid on delivery
We are looking for an experienced coder to create a web site link checker and crawler. This program should be able to do the following: 1. Crawl all pages on a site 2. Collect the title tag and meta description on each page 3. Keep track of how many outgoing links each page has, and how many incoming links each page has 4. Keep record of all internal anchor text links (text and where that text links to). For example "home builder san diego" links to [[login to view URL]][1]. This should be a separte report that shows ONLY anchor text links (not image or other links) This program should be able to export this data to an excel spreadsheet. It should have multiple threads to make it fast. For a good comparison program you can look at the website below (remove the C's). It does everything we want except for displaying the meta description, and anchor text links. It does a lot of things that we don't need as well. We only need pages, not images or anything else. example software [login to view URL]**lCiCnCkC**.html
Project ID: 2956412

About the project

1 proposal
Remote project
Active 14 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
See private message.
$637.50 USD in 16 days
5.0 (55 reviews)
6.9
6.9

About the client

Flag of UNITED STATES
United States
5.0
123
Payment method verified
Member since Jan 31, 2007

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.