In Progress

Web Scraping of Static HTML Website

Hi,

I'd like to scrape the course contents from 2 university websites.

The website URLs are RESTful and the sites are static (no JS, interaction etc). A master page contains links to all the course content that needs to be scraped, and all course content are presented in the same format.

This should be a very easy task for someone with web scraping experience.

I have attached a walkthrough that outlines what items on the website should be mapped to what fields in the database/csv file. Please look through the walkthrough before responding.

The code should ideally be done in Python or Ruby. Java and other open source languages are ok.

The code should follow good software engineering principles and design patterns and should be easily extendable to other sites with similar formats (I will be reviewing the code after and developing it further).

Thanks,

Henry

Budget: $50-$150 Thanks

Skills: Data Mining, Python, Ruby on Rails, Web Scraping

See more: python html web scraping, scrape static website, web scraping course, python ruby web scraping, web scraping python, html python, what to look for in a ruby, what are the principles of design, web source format, web sites of web developing, website formats, website developing sites, web scraping c#, web page developing languages, web page design languages, web of ruby, web interaction design, web engineering, web design patterns, web design master

About the Employer:
( 0 reviews ) Canada

Project ID: #1542618

Awarded to:

moeberne

I can do this with scrapy or BeautifulSoup. Should be able to get it done quickly.

$30 USD in 5 days
(0 Reviews)
0.0

24 freelancers are bidding on average $148 for this job

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$250 USD in 7 days
(37 Reviews)
6.5
srinichal

I am an expert in scrapping and can deliver the project

$250 USD in 5 days
(39 Reviews)
6.3
mantislin

Hi sir, please check PM.

$250 USD in 3 days
(70 Reviews)
6.2
zhu1230

I can take up your project. thanks

$150 USD in 5 days
(50 Reviews)
6.2
phpXpertbd

I specialize in similar projects. Please check PM for more details.

$235 USD in 5 days
(18 Reviews)
5.9
rupeshx

Hi, I like to work on this project.

$250 USD in 5 days
(7 Reviews)
4.3
rhkchathuranga

I have lot of experience in Web scraping. Please check your P.M.B. sir.

$150 USD in 3 days
(6 Reviews)
4.1
tomydeveloper

Hello,We are scraping expert [login to view URL] check pmb for more detail..Thanks

$150 USD in 5 days
(3 Reviews)
3.7
EvanKos

Hi, i can help you with that, please check pm.

$120 USD in 3 days
(4 Reviews)
3.7
Vigneshvar

Hi, I have experience web scrapping. Do let me know if you are interested

$200 USD in 7 days
(1 Review)
1.6
rrr76

Hi, I'll do that with python.

$140 USD in 5 days
(1 Review)
1.0
deba360

Hi, I have experience in developing website scrapper PHP. Please check PMB for details.

$100 USD in 3 days
(0 Reviews)
0.0
cantonic

Web Scraping is my favorite Job. I did every kind of automated scraping: static html, dynamic websites and even websites with Flash or Java on it.

$140 USD in 2 days
(0 Reviews)
0.0
jcm28

i can write python selenium firefox webdriver

$100 USD in 5 days
(0 Reviews)
0.0
websoft2009

Hi, I am an experienced PHP developer. I would like to work for you.

$100 USD in 1 day
(0 Reviews)
4.0
mailmeakhila

Hi I am very much interested in the [login to view URL] my bid.

$50 USD in 4 days
(0 Reviews)
0.0
dbgoogleplusfbf

Please check PMB

$30 USD in 1 day
(0 Reviews)
0.0
asapworks

We have previous experience in scrapping and doing SMS projects.

$95 USD in 2 days
(0 Reviews)
0.0
jr593

Expert web scraper, ready to start, high quality results

$120 USD in 1 day
(0 Reviews)
0.0
krishmetra

Hello Henry.. Please check your PMB for my proposal. Thanks Krish

$150 USD in 1 day
(0 Reviews)
0.0