Re: Spiders and Bots
This WebDNA talk-list message is from 2000
It keeps the original formatting.
numero = 33022
interpreted = N
texte = if you know the IP address of who you want to allow or deny you can base access onthat.(that would require knowing the IP of the bots you had in mind)-JohnBob Sneidar wrote:> Okay, I can see by these posts that there is a great deal of complexity in> developing a store that can be indexed by bots and yet maintain some control> over how the bots scan the store.>> Is there an easy way to block bots completely? And then allow only specific> search engine bots to scan the site?>> --> Sincerely,> Bob Sneidar> Systems Manager> The Word For Today>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list
.> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > Web Archive of this list is at: http://search.smithmicro.com/-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Associated Messages, from the most recent to the oldest:
if you know the IP address of who you want to allow or deny you can base access onthat.(that would require knowing the IP of the bots you had in mind)-JohnBob Sneidar wrote:> Okay, I can see by these posts that there is a great deal of complexity in> developing a store that can be indexed by bots and yet maintain some control> over how the bots scan the store.>> Is there an easy way to block bots completely? And then allow only specific> search engine bots to scan the site?>> --> Sincerely,> Bob Sneidar> Systems Manager> The Word For Today>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > Web Archive of this list is at: http://search.smithmicro.com/-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
John Butler
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Searching help needed (1998)
Running WebCat from a CD-ROM (1997)
PCS Frames (1997)
Latest Version of WebDNA store (2002)
Template not found error messages (1997)
Email notification to one of multiple vendors ? (1997)
Email Formatting and Encryption (1998)
Problem (1997)
[WebDNA] Language References (2011)
Download capabilities (1997)
How To question on setting up downloads (1997)
Nested tags count question (1997)
WebCat editing, SiteGuard & SiteEdit (1997)
Re1000001: Setting up shop (1997)
Ads.db (1997)
Multiple Newcarts (1996)
[searchString] (1997)
Secure Server (1997)
[WebDNA] sagepayments TLS? requests now failing (2018)
[OT] Democratic Code (2002)