Re: Spiders
This WebDNA talk-list message is from 2000
It keeps the original formatting.
numero = 28969
interpreted = N
texte = On 3/13/00 6:33 pm, Glenn Busbin so noted...>on 03/13/00 6:49 PM, Brad Eisenberg at brad@thewwwstore.com wrote:>>> Could be a spider hitting your thankyou.tpl page.>>Do spiders cause many problems to WC sites?>>Will using
help prevent them from>accessing the thankyou.tpl page?Using ALL would tell the (well behaved) robot to index that page and follow links to index their contents as well. If you wanted to index that page and *not* follow subsequent links, you would use NOFOLLOW.Blocking everything is done with NONE.Rob MarquardtDesigner/Resident WireheadToast Design800 Washington Avenue NorthMinneapolis MN 55401612.330.9863 v612.321.9424 fwww.toastdesign.com-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list
.To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Associated Messages, from the most recent to the oldest:
On 3/13/00 6:33 pm, Glenn Busbin so noted...>on 03/13/00 6:49 PM, Brad Eisenberg at brad@thewwwstore.com wrote:>>> Could be a spider hitting your thankyou.tpl page.>>Do spiders cause many problems to WC sites?>>Will using help prevent them from>accessing the thankyou.tpl page?Using ALL would tell the (well behaved) robot to index that page and follow links to index their contents as well. If you wanted to index that page and *not* follow subsequent links, you would use NOFOLLOW.Blocking everything is done with NONE.Rob MarquardtDesigner/Resident WireheadToast Design800 Washington Avenue NorthMinneapolis MN 55401612.330.9863 v612.321.9424 fwww.toastdesign.com-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Rob Marquardt
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
[writefile] (1997)
WebCat editing, SiteGuard & SiteEdit (1997)
Area codes? (2001)
Where is f2? (1997)
Credit card types (1997)
Search Engine bots (2002)
I try hard to think positively (1998)
Up and running ... at last !! (1997)
Search Title Question (1998)
View Source from cache (1997)
Update: Pay by Mail (CC, Check, Money Order) (2001)
[WebDNA] Integrating with WP and PHP (2011)
[WebDNA] WebDNA7 and mod_fcgi (2013)
Help me choose an upgrade path to 5.0 (2003)
Formulas.db (1997)
Outlook Rule (2002)
[WebDNA] What am I doing wrong with authenticate (2012)
Files not moved to EmailCompleted (2002)
Variables (1999)
shipcost (1997)