Web spiders

Below, on the left sidebar, where it says "members online:," one of the things I noticed on there was "web spiders." What is a web spider? Details please, (i.e. what are they used for, why make them, etc.), but you really don't need to get intricate with the tech/code stuff that I wouldn't understand anyway.

Thanks,

t0xik

Try reading here:

http://tinyurl.com/4uovz4h

web spider is basically a type of bot that is used by search engines to look for the latest up-to-date information on any given topic.

Usually it will index the pages it visits to speed up searches in the future.

You can read more at http://en.wikipedia.org/wiki/Web_spider

yours31f wrote: Try reading here:

http://tinyurl.com/4uovz4h

mighty fine advice from someone who once needed to be spoon-fed ;)

no offence.

fuser wrote: mighty fine advice from someone who once needed to be spoon-fed ;)

no offence. Mighty well written criticism from someone who once was unable to write ;)

No offense.

Spiders can sometimes have more access to some sites than a browsers user-agent.

Spiders are also used to automate pay-per-click sites.

Thanks, and by the way, the "let me google that for you" thing is really an awesome form of sarcastic duhing! I love it.