Re: Search Engines

This WebDNA talk-list message is from

2000


It keeps the original formatting.
numero = 29963
interpreted = N
texte = on 04/03/00 9:54 PM, John Butler at john@feeling-goods.com wrote:> Maybe you could > work out a deal to get just the list of IP addresses from that script?John, Are you thinking of the robots.txt file?I found a partial list of bots at http://info.webcrawler.com/mak/projects/robots/active.htmlI also found a list of their IP addresses at http://www.searchengineworld.com/spiders/spider_ips.htmGlenn ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] o search engines index .db files? (Stuart Tremain 2009)
  2. Re: [WebDNA] o search engines index .db files? (sbraun 2009)
  3. Re: [WebDNA] o search engines index .db files? ("Dan Strong" 2009)
  4. Re: [WebDNA] o search engines index .db files? (Terry Wilson 2009)
  5. Re: [WebDNA] o search engines index .db files? (Donovan Brooke 2009)
  6. Re: [WebDNA] o search engines index .db files? (Stuart Tremain 2009)
  7. [WebDNA] o search engines index .db files? (sbraun 2009)
  8. Re: Do search engines index .tpl pages? ( Jim Ziegler 2006)
  9. Re: Do search engines index .tpl pages? ( Peter Shefler 2006)
  10. Re: Do search engines index .tpl pages? ( "Bess Ho" 2006)
  11. Re: Do search engines index .tpl pages? ( Bob Minor 2006)
  12. Re: Do search engines index .tpl pages? ( Stuart Tremain 2006)
  13. Do search engines index .tpl pages? ( Peter Shefler 2006)
  14. Re: Search Engines (Auto Krafters 2002)
  15. Re: Search Engines (Alan White 2002)
  16. Re: Search Engines (Alan White 2002)
  17. Re: Search Engines (Daniel Schutzsmith 2002)
  18. Re: Search Engines (Dan Strong 2002)
  19. Re: Search Engines (Andrew Simpson 2002)
  20. Re: Search Engines (Andrew Simpson 2002)
  21. Re: Search Engines (Alex McCombie 2002)
  22. Re: Search Engines (Dan Strong 2002)
  23. Re: Search Engines (Robert Wade 2002)
  24. Re: Search Engines (Dan Strong 2002)
  25. Search Engines (Alan White 2002)
  26. Re: search engines (Jim Lanford 2001)
  27. Re: search engines (Glenn Busbin 2001)
  28. Re: search engines (Andrew Simpson 2001)
  29. Re: search engines (Jim Lanford 2001)
  30. Re: search engines (Glenn Busbin 2001)
  31. Re: search engines (Will Starck 2001)
  32. search engines (Kelly Wiseman 2001)
  33. WebCatalog in the search engines (Brian B. Burton 2001)
  34. Re: Search Engines (Glenn Busbin 2000)
  35. Re: Search Engines (John Butler 2000)
  36. Re: Re[2]: Search Engines (Glenn Busbin 2000)
  37. Re[2]: Search Engines (jpeacock@univpress.com 2000)
  38. Re: Search Engines (Glenn Busbin 2000)
  39. Re: Search Engines (Brian Boegershausen 2000)
  40. Search Engines (Glenn Busbin 2000)
  41. Re: WebCat and search engines (Kenneth Grome 1998)
  42. WebCat and search engines (Sam Lewis 1998)
on 04/03/00 9:54 PM, John Butler at john@feeling-goods.com wrote:> Maybe you could > work out a deal to get just the list of IP addresses from that script?John, Are you thinking of the robots.txt file?I found a partial list of bots at http://info.webcrawler.com/mak/projects/robots/active.htmlI also found a list of their IP addresses at http://www.searchengineworld.com/spiders/spider_ips.htmGlenn ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Glenn Busbin

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Assign New Cart (2003) WebCatalog 3.0 (1998) Moment of Thanks (1997) WebCat hosting providers? - one more option (1997) taxrate - off by 1 cent (1997) Can this be done? (2003) Browser frames and URLs in the Location field (2004) WebCatalog NT beta 18 now available (1997) Problems with ^ could be solved with [REPLACE CHARACTERS] (1997) Stopping bad HTML propagation ? (1997) WebCat b13 CGI -shownext- (1997) Re:Has this happened to you? (was:Emailer Chokes on bad address) (1997) WebCatalog and WebTen (1997) Re:Running 2 two WebCatalog.acgi's (1996) Unexpected error (1997) cart info (1998) Confirming a bug/oddity (2003) Errata: WCS Newbie question (1997) Up and running ... at last !! (1997) New public beta available (1997)