Re: Spiders and Bots
This WebDNA talk-list message is from 2000
It keeps the original formatting.
numero = 33012
interpreted = N
texte = > > > I can't see why it's using an image, though. Whatever.Assuming the graphic IS a transparent pixel, then I assume so that the link to one of those static product pages does not tempt any human user to follow it. Remeber these are for the bots. You want the humans to use the links which goto pages you designed on purpose to more fully represent your store.> > > Making one page per item in a large store could make the files pretty darned > big, but if we gotta do that to get the bots to find our stuff, then we > gotta.I assume that SM threw this in there just so your storebuilder-made store has all the more chance of being found by 'bots and therefore by the humans who access data accumulated by those bots, but this is hopefully NOT the main way you are investing in your future sales! You still want to take steps so that the pages you actually want humans to enter the site with index well on the biggest search engines, etc. I wouldn't say you gotta have hidden links for bots. In fact I fully expect that some search engines' bots may now even may penalize for such invisible links (or else they may in the future).> That could be a lotta pages and a lotta work for some sites with a > lotta products and a webmaster who does all this by hand. Does carpel > tunnel sound familiar?why do it by hand if you can use simple code like what storebuilder is using? (assuming you even want to do this?)> > > The meta tags would still be necessary to keep the false orders from being > placed as long as the Add To Cart link is included, but I'd hate for > someone to enter a site from one of these pages found in a search engine.yeah, but again (if my assumptions are right), the store builder code (and resulting static product pages) is just icing on the cake - thrown in just for the chance to get a few more eyeballs into the site than would otherwise have come, NOT the primary entry points you would advertise etc.. Say you do a nice home page. Then you tweak it so you know it will rank well on some search engine (SE). Then when people goto that SE they see that listing and goto your site - via the page you intended they come in. All is great. Now say you used storebuilder and it made those static pages the way we are assuming. Then when the SE 'bot came along to index your site from when you submitted your nice home page, it crawled around your site and happened to land on that page where storebuilder created all those invisible links. So, being a 'bot, it DOES see them (even though most humans don't even notice them) and crawls those static pages as well as your homepage. SO then say the static page for product-094 happens to index well for a particular search phrase that has to do with the desciption of that product-94... so when a user of that SE types in (that search phrase) he sees a listing for your product-94.html (and perhaps also for your homepage - though maybe less likely since his search phrase is more specific to just product-94). He clicks it and goes in your site. Great! So you just got the attention of someone who otherwise may have never known your site existed if it weren't for that product-94.html page, and for that listing on the SE (which the bot wouldn't have found except for one of those invisible links).> > > The NOFOLLOW meta tag would keep the false orders from being created, but > the NOINDEX tag will keep the bots from even using the page. So, do we use > the NOFOLLOW meta tag and a redirect?If you use a webcat redirect then human and bot alike will be instantly redirected to the page you specify when they try to access the page with the redirect in it.>> Will a redirect foul up the purpose of > the Previous Product or Next Product links? > > Glenn > ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list
. To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Associated Messages, from the most recent to the oldest:
> > > I can't see why it's using an image, though. Whatever.Assuming the graphic IS a transparent pixel, then I assume so that the link to one of those static product pages does not tempt any human user to follow it. Remeber these are for the bots. You want the humans to use the links which goto pages you designed on purpose to more fully represent your store.> > > Making one page per item in a large store could make the files pretty darned > big, but if we gotta do that to get the bots to find our stuff, then we > gotta.I assume that SM threw this in there just so your storebuilder-made store has all the more chance of being found by 'bots and therefore by the humans who access data accumulated by those bots, but this is hopefully NOT the main way you are investing in your future sales! You still want to take steps so that the pages you actually want humans to enter the site with index well on the biggest search engines, etc. I wouldn't say you gotta have hidden links for bots. In fact I fully expect that some search engines' bots may now even may penalize for such invisible links (or else they may in the future).> That could be a lotta pages and a lotta work for some sites with a > lotta products and a webmaster who does all this by hand. Does carpel > tunnel sound familiar?why do it by hand if you can use simple code like what storebuilder is using? (assuming you even want to do this?)> > > The meta tags would still be necessary to keep the false orders from being > placed as long as the Add To Cart link is included, but I'd hate for > someone to enter a site from one of these pages found in a search engine.yeah, but again (if my assumptions are right), the store builder code (and resulting static product pages) is just icing on the cake - thrown in just for the chance to get a few more eyeballs into the site than would otherwise have come, NOT the primary entry points you would advertise etc.. Say you do a nice home page. Then you tweak it so you know it will rank well on some search engine (SE). Then when people goto that SE they see that listing and goto your site - via the page you intended they come in. All is great. Now say you used storebuilder and it made those static pages the way we are assuming. Then when the SE 'bot came along to index your site from when you submitted your nice home page, it crawled around your site and happened to land on that page where storebuilder created all those invisible links. So, being a 'bot, it DOES see them (even though most humans don't even notice them) and crawls those static pages as well as your homepage. SO then say the static page for product-094 happens to index well for a particular search phrase that has to do with the desciption of that product-94... so when a user of that SE types in (that search phrase) he sees a listing for your product-94.html (and perhaps also for your homepage - though maybe less likely since his search phrase is more specific to just product-94). He clicks it and goes in your site. Great! So you just got the attention of someone who otherwise may have never known your site existed if it weren't for that product-94.html page, and for that listing on the SE (which the bot wouldn't have found except for one of those invisible links).> > > The NOFOLLOW meta tag would keep the false orders from being created, but > the NOINDEX tag will keep the bots from even using the page. So, do we use > the NOFOLLOW meta tag and a redirect?If you use a webcat redirect then human and bot alike will be instantly redirected to the page you specify when they try to access the page with the redirect in it.>> Will a redirect foul up the purpose of > the Previous Product or Next Product links? > > Glenn > ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
John Butler
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
& in Lookups (1997)
counting characters and/or words (1997)
[SEARCH] Context for SKU prices not working... (1998)
Way Off Topic (2003)
[WebDNA] WebDNA7 url plus get? (2011)
.eml files (2001)
PCS Frames (1997)
WebCat2 - many [carts] on one template page? (1997)
aol (2000)
[SearchString] usage (1997)
New command suggestion (1997)
redirect from the errorsMessages.db entry (1997)
Need some assistance. (1999)
Re:E-mailer application times out (1998)
Adding up weights (1998)
Processing all html files through WebCat or Typhoon (1998)
Documentation Feedback (1997)
Sendmail Woes (2002)
WebCAT 3.x (2002)
[DOS]/DOS query perhaps OT (2003)