Re: Spiders and Bots

This WebDNA talk-list message is from

2000


It keeps the original formatting.
numero = 33073
interpreted = N
texte = > > > > > > What if the redirect was placed at the bottom of the page? >Wouldn't the bots > > see all the good stuff, catalog it, then hit the redirect? > > > >if it's a webcat redirect then no. Remember that all the webdna >gets parsed BEFORE any >HTML is returned to the browser (or bot) >-JohnDoh,If you want to hide a page from a bot.......have a database of the bot addresses (one was posted here recently).lookup the ip address in the database.If it is found, show an alternate or blank page.If the ip address is not in the robots database, it is not a robot.... show the normal page.So you are just hiding and showing include tags or page content based on the ip address of the person or bot that is visiting the page.....Paul > >------------------------------------------------------------- >This message is sent to you because you are subscribed to > the mailing list . >To unsubscribe, E-mail to: >To switch to the DIGEST mode, E-mail to > >Web Archive of this list is at: http://search.smithmicro.com/ _/_/_/_/_/_/_/_/_/_/_/_/|\_\_\_\_\_\_\_\_\_\_\_\_ _/_/_/Paul Uttermohlen, Interactive Ink, Inc._\_\_ \_\_\_\_ _/_/_/ mailto:paul@ims1.com - Website Development \_\_\_\_ _/_/_/ Business - _\_\_\_\_\_\_ _/_/_/ Real Estate - _\_\_\_\_ _/_/_/_/_/_/_/_/_/_/_/_/_/_/ | \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: Spiders and Bots (Paul Uttermohlen 2000)
  2. Re: OT - Re: Spiders and Bots (Glenn Busbin 2000)
  3. OT - Re: Spiders and Bots (John Butler 2000)
  4. Re: Spiders and Bots (John Butler 2000)
  5. Re: Spiders and Bots (Glenn Busbin 2000)
  6. Re: Spiders and Bots (Glenn Busbin 2000)
  7. Re: Spiders and Bots (John Butler 2000)
  8. Re: Spiders and Bots (Jesse Proudman 2000)
  9. Re: Spiders and Bots (Bob Sneidar 2000)
  10. Re: Spiders and Bots (John Butler 2000)
  11. Re: Spiders and Bots (Aaron Lynch 2000)
  12. Re: Spiders and Bots (Glenn Busbin 2000)
  13. Re: Spiders and Bots (John Butler 2000)
  14. Spiders and Bots (Glenn Busbin 2000)
> > > > > > What if the redirect was placed at the bottom of the page? >Wouldn't the bots > > see all the good stuff, catalog it, then hit the redirect? > > > >if it's a webcat redirect then no. Remember that all the webdna >gets parsed BEFORE any >HTML is returned to the browser (or bot) >-JohnDoh,If you want to hide a page from a bot.......have a database of the bot addresses (one was posted here recently).lookup the ip address in the database.If it is found, show an alternate or blank page.If the ip address is not in the robots database, it is not a robot.... show the normal page.So you are just hiding and showing include tags or page content based on the ip address of the person or bot that is visiting the page.....Paul > >------------------------------------------------------------- >This message is sent to you because you are subscribed to > the mailing list . >To unsubscribe, E-mail to: >To switch to the DIGEST mode, E-mail to > >Web Archive of this list is at: http://search.smithmicro.com/ _/_/_/_/_/_/_/_/_/_/_/_/|\_\_\_\_\_\_\_\_\_\_\_\_ _/_/_/Paul Uttermohlen, Interactive Ink, Inc._\_\_ \_\_\_\_ _/_/_/ mailto:paul@ims1.com - Website Development \_\_\_\_ _/_/_/ Business - _\_\_\_\_\_\_ _/_/_/ Real Estate - _\_\_\_\_ _/_/_/_/_/_/_/_/_/_/_/_/_/_/ | \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Paul Uttermohlen

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Database Updates (1997) Can [writefile] files be served thru webcat? (2000) Users.db corrupted (2002) how to know the [LineIndex] number webcat generated during a [AddLineItem]? (2000) Grep help (2004) Scratch & Win (1999) [WebDNA] [regex] (2015) Unix line endings (2003) Sort Order on a page search (1997) HELP - NONE STOP DIGESTS. Digest for 4/24/97) (1997) Not really WebCat (1997) Formulas.db + Users.db (1997) dates and hex formatting (1997) [OT] Mozilla | Was: R.I.P. Netscape (2003) Bug with periods in [math] variable names (2001) WebCatalog NT beta 18 now available (1997) Weird problems with [SHOWIF]s (1997) PIXO support (1997) Authenticating users without dialog box (1997) WCS Newbie question (1997)