Custom Private Simplified Search Engine : MYSQL PHP

Completed Posted Oct 8, 2010 Paid on delivery
Completed Paid on delivery

Here's the work flow.

**The Submission API**

1) A domain name is submitted privately to a script via ?url=[[url removed, login to view]][1].

2) After recieving the notice, the domain name is saved in a table and spider script crawls and documents all pages associate with the url and stores them in a table.

3) The same spider, as it crawls link, uses CURL to grab a the source code of the links, and then uses the php strip_tags() function to clean it of extra code information so just non-html content remains. This content is stored and associated with the domain and it's parent link respectively using foreign keys.

4) This spider runs and documents only items associated with the submitted domain, ignoring external links.

**The Access API**

1) This database can be searched by indicating the domain to search, and a keyword to search.

2) Keywords can be dressed in "quotations" to indicate an exact match.

3) Keywords are matched against the text gathered via CURL and mentioned in step 3 above.

4) Results are returned in XML format.

5) Results contain the link only. eg: <result>link</result><result>link</result>

6) Results are returned via ID field in descending order.

**The Automation**

1) I'd like a complimentary cronjob fueled spider that looks for new added items to all sources. (This seems like this most complicated part of the project).

That's about it in a nutshell. The database potentially could experience a high volume of calls; so performance would be something to consider. I'd hope your expertise could also fill in any dark spots too. Thank you and Good Luck!

Engineering MySQL PHP Project Management Software Architecture Software Testing Web Hosting Website Management Website Testing

Project ID: #3779486

About the project

3 proposals Remote project Active Oct 21, 2010

Awarded to:

kaifucomputing

See private message.

$212.5 USD in 14 days
(15 Reviews)
4.8

3 freelancers are bidding on average $524 for this job

isolud

See private message.

$1105 USD in 14 days
(53 Reviews)
5.8
toinnisfreesl

See private message.

$255 USD in 14 days
(37 Reviews)
5.3