We wish to gather a large amount information, approximately 3000 records from a public directory.
We require some parsing from another website. It will always be the same site, and thus will have a consistent html format.
To save time, we prefer it to be done with an automatic software that we will own, with the following features:
1. this will be a desktop software - likely in Java
2. We enter a sub-url (category level)
3. We will parse the categories into a file called [login to view URL]
4. We will then parse the categories, creating the final set of records
5. Important: We can pause the software and restart it at any time.
## Deliverables
I just want to be able to point the software to certain? urls? (cities, towns) on this site to be able to parse the business directory data.