Re: Spiders and Bots
This WebDNA talk-list message is from 2000
It keeps the original formatting.
numero = 33024
interpreted = N
texte = It is written that on 06/10/00 11:24 AM John Butler of john@feeling-goods.com sayeth these words to us:>> >> >> Making one page per item in a large store could make the files pretty darned >> big, but if we gotta do that to get the bots to find our stuff, then we >> gotta. > > I assume that SM threw this in there just so your storebuilder-made store has > all the more chance of being found by 'bots and therefore by the humans who access data accumulated by those bots, but this is hopefully NOT the main way you are investing in your future sales!Nope. I just wanted to figure out what SM was up to with this thing.>> That could be a lotta pages and a lotta work for some sites with a >> lotta products and a webmaster who does all this by hand. Does carpel >> tunnel sound familiar? > > why do it by hand if you can use simple code like what storebuilder is using? > (assuming you even want to do this?)Because I won't use StoreBuilder for the site. I was just playing with it to see what it does. It would be useful to create a site, then modify it to suit some particular needs, though.StoreBuilder requires that each product be entered seperately. That's fine for a few items, but a bummer for large inventories. Some guys here have mega-sized databases for their products. I kinda doubt if they want to re-enter all that stuff by hand.> If you use a webcat redirect then human and bot alike will be instantly > redirected to > the page you specify when they try to access the page with the redirect in it.What if the redirect was placed at the bottom of the page? Wouldn't the bots see all the good stuff, catalog it, then hit the redirect?Glenn -- She spammed the wrong guy. http://belps.freewebsites.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list
. To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Associated Messages, from the most recent to the oldest:
It is written that on 06/10/00 11:24 AM John Butler of john@feeling-goods.com sayeth these words to us:>> >> >> Making one page per item in a large store could make the files pretty darned >> big, but if we gotta do that to get the bots to find our stuff, then we >> gotta. > > I assume that SM threw this in there just so your storebuilder-made store has > all the more chance of being found by 'bots and therefore by the humans who access data accumulated by those bots, but this is hopefully NOT the main way you are investing in your future sales!Nope. I just wanted to figure out what SM was up to with this thing.>> That could be a lotta pages and a lotta work for some sites with a >> lotta products and a webmaster who does all this by hand. Does carpel >> tunnel sound familiar? > > why do it by hand if you can use simple code like what storebuilder is using? > (assuming you even want to do this?)Because I won't use StoreBuilder for the site. I was just playing with it to see what it does. It would be useful to create a site, then modify it to suit some particular needs, though.StoreBuilder requires that each product be entered seperately. That's fine for a few items, but a bummer for large inventories. Some guys here have mega-sized databases for their products. I kinda doubt if they want to re-enter all that stuff by hand.> If you use a webcat redirect then human and bot alike will be instantly > redirected to > the page you specify when they try to access the page with the redirect in it.What if the redirect was placed at the bottom of the page? Wouldn't the bots see all the good stuff, catalog it, then hit the redirect?Glenn -- She spammed the wrong guy. http://belps.freewebsites.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Glenn Busbin
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Triggers (1999)
Setting up shop (1997)
Really need a answer (1999)
security (1997)
OFF-TOPIC: Lending investors ... (2002)
Logical and or in [hideif] (1997)
More Applescript (1997)
SetHeader (1999)
Google Web Accelerator (2005)
problems with 2 tags (1997)
Hierarchy of form/text/math variables (2000)
[OT] RE: Drop down menu (2003)
WebCat2b13MacPlugIn - [include] (1997)
IIS Brain Dead (1998)
[TaxableTotal] - not working with AOL and IE (1997)
[WebDNA] how can i grab the contents of a post? (2011)
Sitebuilder (2004)
help testing quicktime delivery (1997)
Problems passing [SKU] with $Replace in 2.0 (1997)
Mail Service Dead (1998)