Custom Private Simplified Search Engine : MYSQL PHP

Completado Publicado Oct 8, 2010 Pagado a la entrega
Completado Pagado a la entrega

Here's the work flow.

**The Submission API**

1) A domain name is submitted privately to a script via ?url=[[url removed, login to view]][1].

2) After recieving the notice, the domain name is saved in a table and spider script crawls and documents all pages associate with the url and stores them in a table.

3) The same spider, as it crawls link, uses CURL to grab a the source code of the links, and then uses the php strip_tags() function to clean it of extra code information so just non-html content remains. This content is stored and associated with the domain and it's parent link respectively using foreign keys.

4) This spider runs and documents only items associated with the submitted domain, ignoring external links.

**The Access API**

1) This database can be searched by indicating the domain to search, and a keyword to search.

2) Keywords can be dressed in "quotations" to indicate an exact match.

3) Keywords are matched against the text gathered via CURL and mentioned in step 3 above.

4) Results are returned in XML format.

5) Results contain the link only. eg: <result>link</result><result>link</result>

6) Results are returned via ID field in descending order.

**The Automation**

1) I'd like a complimentary cronjob fueled spider that looks for new added items to all sources. (This seems like this most complicated part of the project).

That's about it in a nutshell. The database potentially could experience a high volume of calls; so performance would be something to consider. I'd hope your expertise could also fill in any dark spots too. Thank you and Good Luck!

Ingeniería MySQL PHP Gestión de proyectos Arquitectura de software Verificación de software Web Hosting Gestión de páginas web Verificación de páginas web

Nº del proyecto: #3779486

Sobre el proyecto

3 propuestas Proyecto remoto Activo Oct 21, 2010

Adjudicado a:

kaifucomputing

See private message.

$212.5 USD en 14 días
(15 comentarios)
4.8

3 freelancers están ofertando un promedio de $524 por este trabajo

isolud

See private message.

$1105 USD en 14 días
(53 comentarios)
5.8
toinnisfreesl

See private message.

$255 USD en 14 días
(37 comentarios)
5.3