Does anyone know of a good resource on the web regarding web robots, spiders and other crawlers? I am looking for general information on META tags and their usage, as well as other general page design considerations.<BR><BR>Specifically, I am looking for the answer to this question:<BR><BR>Do web crawlers, robots and spiders consider links within a page prefaced with "" as a redirection and therefore do not follow them even though the robots META tag is set to "FOLLOW"?<BR><BR>Thanks<BR>Tim Smith<BR>Senior Application/Solution Developer<BR>Tetley USA Inc<BR>Shelton CT