Re: Spiders
This WebDNA talk-list message is from 2000
It keeps the original formatting.
numero = 28970
interpreted = N
texte = on 03/13/00 7:59 PM, Rob Marquardt at rob@toastdesign.com wrote:> Using ALL would tell the (well behaved) robot to index that page and> follow links to index their contents as well. If you wanted to index that> page and *not* follow subsequent links, you would use NOFOLLOW.> > Blocking everything is done with NONE.Yep. You're right. I copied that from an existing page and forgot to changethe ALL to NONE before hitting Send.In any event, do spiders cause any problems to WC sites that can beprevented with some (correct) HTML code?Glenn-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list
.To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Associated Messages, from the most recent to the oldest:
on 03/13/00 7:59 PM, Rob Marquardt at rob@toastdesign.com wrote:> Using ALL would tell the (well behaved) robot to index that page and> follow links to index their contents as well. If you wanted to index that> page and *not* follow subsequent links, you would use NOFOLLOW.> > Blocking everything is done with NONE.Yep. You're right. I copied that from an existing page and forgot to changethe ALL to NONE before hitting Send.In any event, do spiders cause any problems to WC sites that can beprevented with some (correct) HTML code?Glenn-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Glenn Busbin
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Protecting webdelivery (1997)
Version f1 status (1997)
Can you help a newbie out? (2000)
bug ? causes NT event log to fill (1997)
WebCat2: multiple currency support (1997)
math on date? (1997)
WebCat2b13MacPlugIn - [showif][search][/showif] (1997)
WC Database Format (1997)
HomePage Caution (1997)
[WebDNA] WebDNA Crashing or Not **YES** (2008)
Error:Too many nested [xxx] contexts (1997)
Date Sorting (1997)
[format xs] freeze (1997)
no emailfolder errors? (2000)
WebCat2b13MacPlugIn - [include] (1997)
Strange intermittent WebDNA problems Workaround (2008)
WebDNA maxing out processor / Strange intermittent WebDNA (2008)
Press Release hit the NewsWire!!! (1997)
ShowNext truncating passed variable?? (1997)
Problem displaying search result (1997)