Who can supply some sites about web spider?

webbone

I want to devlop a application of web spider,Who can give some idea to me!
Thank you...

Grimboy

I don't know any sites but I think it would be easiest (although by no means most effeciant) to prototype in python as that comes with a http libary and a html parsing thing. All you have to do is harvest your information, shove it into a database and follow links.

webbone

Thank you,I want to try it! Laughing

jawker

look for the book "art of java" by holmes. at chapter six it gives an idea and how to make a web crawler. you can get a lot of ideas from that book very powerful. i tried searching for an e-book about that on the net but i can't find any. try searching the web if you find some don't forget to pm. i hope this helped. God bless