What are these?

Evangelion · February 18, 2006, 12:04pm

I was viewing the online list and there’s a whole bunch of “spiders”. I see FindLinks Spider, Yahoo! Slurp Spider, and MSNBot Spider. Are these spam related? I am curious. What do they do?

Cless_Alvein · February 18, 2006, 1:00pm

They put our wonderful forum in the search engines of these websites

Xelopheris · February 18, 2006, 5:09pm

Recently, VB started identifying IPs of spiderbots. That is, bots that read a page, and all sublinks of the page, and put them in a database. The google crawler, MSNSpiderBot, etc., use these for their search engines. Also used for things like archive.org and various shite.

Evangelion · February 18, 2006, 7:46pm

Ohh so they’re not bad then? Good! I was worried.

system · February 19, 2006, 2:22pm

Hey eve, i love that show sry random post!

system · February 19, 2006, 2:29pm

Hey eve, i love that show sry random post!

Rhaka · February 19, 2006, 2:35pm

Shut up

Cless_Alvein · February 20, 2006, 12:06am

no u

Merlin · February 20, 2006, 5:37pm