Re: Spiders

This WebDNA talk-list message is from

2000


It keeps the original formatting.
numero = 28969
interpreted = N
texte = On 3/13/00 6:33 pm, Glenn Busbin so noted...>on 03/13/00 6:49 PM, Brad Eisenberg at brad@thewwwstore.com wrote: > >> Could be a spider hitting your thankyou.tpl page. > >Do spiders cause many problems to WC sites? > >Will using help prevent them from >accessing the thankyou.tpl page?Using ALL would tell the (well behaved) robot to index that page and follow links to index their contents as well. If you wanted to index that page and *not* follow subsequent links, you would use NOFOLLOW.Blocking everything is done with NONE.Rob Marquardt Designer/Resident Wirehead Toast Design800 Washington Avenue North Minneapolis MN 55401 612.330.9863 v 612.321.9424 f www.toastdesign.com ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Associated Messages, from the most recent to the oldest:

    
  1. Re: Search Spiders (Glenn Busbin 2002)
  2. Re: Search Spiders (Glenn Busbin 2002)
  3. Re: Search Spiders (Glenn Busbin 2002)
  4. Search Spiders (Alain Russell 2002)
  5. Re: Spiders and Bots (Paul Uttermohlen 2000)
  6. Re: OT - Re: Spiders and Bots (Glenn Busbin 2000)
  7. OT - Re: Spiders and Bots (John Butler 2000)
  8. Re: Spiders and Bots (John Butler 2000)
  9. Re: Spiders and Bots (Glenn Busbin 2000)
  10. Re: Spiders and Bots (Glenn Busbin 2000)
  11. Re: Spiders and Bots (John Butler 2000)
  12. Re: Spiders and Bots (Jesse Proudman 2000)
  13. Re: Spiders and Bots (Bob Sneidar 2000)
  14. Re: Spiders and Bots (John Butler 2000)
  15. Re: Spiders and Bots (Aaron Lynch 2000)
  16. Re: Spiders and Bots (Glenn Busbin 2000)
  17. Re: Spiders and Bots (John Butler 2000)
  18. Spiders and Bots (Glenn Busbin 2000)
  19. Re: Spiders (Glenn Busbin 2000)
  20. Re: Spiders (Rob Marquardt 2000)
  21. Spiders (Glenn Busbin 2000)
  22. Re: Spiders, robots, whatever you want to call them (Christer Olsson 1998)
  23. Spiders, robots, whatever you want to call them (Sue Ann Sanders 1998)
  24. Re: Spiders (Wendell B. Kozak 1998)
  25. Re: Spiders (Bob Minor 1998)
  26. Re: Spiders (Kevin Mueller 1998)
  27. Spiders (Kevin Mueller 1998)
On 3/13/00 6:33 pm, Glenn Busbin so noted...>on 03/13/00 6:49 PM, Brad Eisenberg at brad@thewwwstore.com wrote: > >> Could be a spider hitting your thankyou.tpl page. > >Do spiders cause many problems to WC sites? > >Will using help prevent them from >accessing the thankyou.tpl page?Using ALL would tell the (well behaved) robot to index that page and follow links to index their contents as well. If you wanted to index that page and *not* follow subsequent links, you would use NOFOLLOW.Blocking everything is done with NONE.Rob Marquardt Designer/Resident Wirehead Toast Design800 Washington Avenue North Minneapolis MN 55401 612.330.9863 v 612.321.9424 f www.toastdesign.com ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Rob Marquardt

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

[writefile] (1997) WebCat editing, SiteGuard & SiteEdit (1997) Area codes? (2001) Where is f2? (1997) Credit card types (1997) Search Engine bots (2002) I try hard to think positively (1998) Up and running ... at last !! (1997) Search Title Question (1998) View Source from cache (1997) Update: Pay by Mail (CC, Check, Money Order) (2001) [WebDNA] Integrating with WP and PHP (2011) [WebDNA] WebDNA7 and mod_fcgi (2013) Help me choose an upgrade path to 5.0 (2003) Formulas.db (1997) Outlook Rule (2002) [WebDNA] What am I doing wrong with authenticate (2012) Files not moved to EmailCompleted (2002) Variables (1999) shipcost (1997)