Re: Spiders and Bots

This WebDNA talk-list message is from

2000


It keeps the original formatting.
numero = 33022
interpreted = N
texte = if you know the IP address of who you want to allow or deny you can base access on that. (that would require knowing the IP of the bots you had in mind) -JohnBob Sneidar wrote:> Okay, I can see by these posts that there is a great deal of complexity in > developing a store that can be indexed by bots and yet maintain some control > over how the bots scan the store. > > Is there an easy way to block bots completely? And then allow only specific > search engine bots to scan the site? > > -- > Sincerely, > Bob Sneidar > Systems Manager > The Word For Today > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > Web Archive of this list is at: http://search.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: Spiders and Bots (Paul Uttermohlen 2000)
  2. Re: OT - Re: Spiders and Bots (Glenn Busbin 2000)
  3. OT - Re: Spiders and Bots (John Butler 2000)
  4. Re: Spiders and Bots (John Butler 2000)
  5. Re: Spiders and Bots (Glenn Busbin 2000)
  6. Re: Spiders and Bots (Glenn Busbin 2000)
  7. Re: Spiders and Bots (John Butler 2000)
  8. Re: Spiders and Bots (Jesse Proudman 2000)
  9. Re: Spiders and Bots (Bob Sneidar 2000)
  10. Re: Spiders and Bots (John Butler 2000)
  11. Re: Spiders and Bots (Aaron Lynch 2000)
  12. Re: Spiders and Bots (Glenn Busbin 2000)
  13. Re: Spiders and Bots (John Butler 2000)
  14. Spiders and Bots (Glenn Busbin 2000)
if you know the IP address of who you want to allow or deny you can base access on that. (that would require knowing the IP of the bots you had in mind) -JohnBob Sneidar wrote:> Okay, I can see by these posts that there is a great deal of complexity in > developing a store that can be indexed by bots and yet maintain some control > over how the bots scan the store. > > Is there an easy way to block bots completely? And then allow only specific > search engine bots to scan the site? > > -- > Sincerely, > Bob Sneidar > Systems Manager > The Word For Today > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > Web Archive of this list is at: http://search.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ John Butler

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Searching help needed (1998) Running WebCat from a CD-ROM (1997) PCS Frames (1997) Latest Version of WebDNA store (2002) Template not found error messages (1997) Email notification to one of multiple vendors ? (1997) Email Formatting and Encryption (1998) Problem (1997) [WebDNA] Language References (2011) Download capabilities (1997) How To question on setting up downloads (1997) Nested tags count question (1997) WebCat editing, SiteGuard & SiteEdit (1997) Re1000001: Setting up shop (1997) Ads.db (1997) Multiple Newcarts (1996) [searchString] (1997) Secure Server (1997) [WebDNA] sagepayments TLS? requests now failing (2018) [OT] Democratic Code (2002)