Making a google like bot

[Xenilbohl]

It would be cool if you made a tutorial on how to make like a bot which crawls pages looking for links and other information and then adding this into a database. This would be very helpful for me especially

Thanks,
Xenilbohl

[jacek]

I could do it as a example but it would not really be practical to use for an actual search engine

[Xenilbohl]

It would be great if you could do it, i really need it lol, i want the pages crawled and look for specific links and information and then added to the database to update the database. It would be a much quicker method than to manually go through sites inputting links and other info.