Page 1 of 1

Making a google like bot

Posted: Mon Jan 02, 2012 11:10 am
by Xenilbohl
It would be cool if you made a tutorial on how to make like a bot which crawls pages looking for links and other information and then adding this into a database. This would be very helpful for me especially ;)

Thanks,
Xenilbohl

Re: Making a google like bot

Posted: Mon Jan 02, 2012 1:14 pm
by jacek
I could do it as a example but it would not really be practical to use for an actual search engine :?

Re: Making a google like bot

Posted: Mon Jan 02, 2012 1:22 pm
by Xenilbohl
It would be great if you could do it, i really need it lol, i want the pages crawled and look for specific links and information and then added to the database to update the database. ;) It would be a much quicker method than to manually go through sites inputting links and other info.