Re: Search Engine bots

This WebDNA talk-list message is from

2002


It keeps the original formatting.
numero = 44761
interpreted = N
texte = its not for you or any real people.google eats links for breakfast. we have a site http://www.logicalsystems.co.nz which has 20,000 + products. i wrote a nice little importer that created directories and subdirectories and static pages for each product, brand and category. the site map only lists the top level categories and brands and each directory has its own index file which displays products.check it out.when google visits it hits 3000 pages a time.----- Original Message ----- From: Donovan Brooke To: WebCatalog Talk Sent: Monday, November 04, 2002 3:21 PM Subject: Re: Search Engine bots > Thanks for all the comments, I figured this code would be out dated. > The site map is not a bad idea. I see how one could generate a nice, > easy to navigate, site map for a small amount of products. > but what if you have more than a thousand records in the .db? > This would make for a big site map. :-)....( Its an eyebrow cringe when I > land on a page only to wade through a maze of text to find what > I was searching for.) > > In this case, is there no real way to advertise this amount of products > in a nice individual add for each product like manner? > > I suppose I could buy a domain for each 20 products where my index > for each domain would be a page with all the 20 products listed with links > to the correct domain detail product page. (hey, This may actually work. > 2000 products and you will have to buy 100 domains.... @ $10/year each that > is a $1000 per year advertising cost which seems doable.) > > Anyway, sorry for the tangent but if anyone has any suggestions on this > problem I'd appreciate it. > > thanks, > Donovan > > > > > > > Andrew Simpson wrote: > > > yes invisible divs will get you banned as will a lot of text that a normal > > browser can't see. > > A whole bunch of pages that say the same thing and do the same thing and all > > point at the same thing will also get you banned. > > > > doesn't normally care about the directory structure however, its more when > > you have multiple domains all pointing at your one product > > > > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > Web Archive of this list is at: http://search.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: Browser compatibility (Was: Re: Search Engine bots) (Donovan Brooke 2002)
  2. Re: Browser compatibility (Was: Re: Search Engine bots) (Frank Nordberg 2002)
  3. Re: Browser compatibility (Was: Re: Search Engine bots) (Dan Strong 2002)
  4. Re: Browser compatibility (Was: Re: Search Engine bots) (Donovan Brooke 2002)
  5. Re: Browser compatibility (Was: Re: Search Engine bots) (Alain Russell 2002)
  6. Browser compatibility (Was: Re: Search Engine bots) (Frank Nordberg 2002)
  7. Re: Search Engine bots (Alain Russell 2002)
  8. Re: Search Engine bots (Dan Strong 2002)
  9. Re: Search Engine bots (Donovan Brooke 2002)
  10. Re: Search Engine bots (Andrew Simpson 2002)
  11. Re: Search Engine bots (Alain Russell 2002)
  12. Re: Search Engine bots (Andrew Simpson 2002)
  13. Re: Search Engine bots (Dan Strong 2002)
  14. Re: Search Engine bots (Andrew Simpson 2002)
  15. Re: Search Engine bots (Dan Strong 2002)
  16. Re: Search Engine bots (Donovan Brooke 2002)
  17. Re: Search Engine bots (Andrew Simpson 2002)
  18. Re: Search Engine bots (Donovan Brooke 2002)
  19. Re: Search Engine bots (Alain Russell 2002)
  20. Re: Search Engine bots (Glenn Busbin 2002)
  21. Re: Search Engine bots (Andrew Simpson 2002)
  22. Re: Search Engine bots (Donovan Brooke 2002)
  23. Re: Search Engine bots (Alain Russell 2002)
  24. Re: Search Engine bots (Donovan Brooke 2002)
  25. Re: Search Engine bots (Alain Russell 2002)
  26. Re: Search Engine bots (Andrew Simpson 2002)
  27. Search Engine bots (Donovan Brooke 2002)
its not for you or any real people.google eats links for breakfast. we have a site http://www.logicalsystems.co.nz which has 20,000 + products. i wrote a nice little importer that created directories and subdirectories and static pages for each product, brand and category. the site map only lists the top level categories and brands and each directory has its own index file which displays products.check it out.when google visits it hits 3000 pages a time.----- Original Message ----- From: Donovan Brooke To: WebCatalog Talk Sent: Monday, November 04, 2002 3:21 PM Subject: Re: Search Engine bots > Thanks for all the comments, I figured this code would be out dated. > The site map is not a bad idea. I see how one could generate a nice, > easy to navigate, site map for a small amount of products. > but what if you have more than a thousand records in the .db? > This would make for a big site map. :-)....( Its an eyebrow cringe when I > land on a page only to wade through a maze of text to find what > I was searching for.) > > In this case, is there no real way to advertise this amount of products > in a nice individual add for each product like manner? > > I suppose I could buy a domain for each 20 products where my index > for each domain would be a page with all the 20 products listed with links > to the correct domain detail product page. (hey, This may actually work. > 2000 products and you will have to buy 100 domains.... @ $10/year each that > is a $1000 per year advertising cost which seems doable.) > > Anyway, sorry for the tangent but if anyone has any suggestions on this > problem I'd appreciate it. > > thanks, > Donovan > > > > > > > Andrew Simpson wrote: > > > yes invisible divs will get you banned as will a lot of text that a normal > > browser can't see. > > A whole bunch of pages that say the same thing and do the same thing and all > > point at the same thing will also get you banned. > > > > doesn't normally care about the directory structure however, its more when > > you have multiple domains all pointing at your one product > > > > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > Web Archive of this list is at: http://search.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Andrew Simpson

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Protect (1997) What if SSL server down? MAC (1997) WebCommerce Security Alert! (1996) using showpage and showcart commands (1996) Rookie/New User Question (2003) value in forms (2000) creating writefile data from a nested search (1997) [searh] or [shownext]problem (1998) [newcart] (1998) Return records from another (1997) [WebDNA] WebDNA version 7 feature list? (2011) WebCat Ad! (2000) Purchased cart being overwritten - still !?? (1997) message board (2001) New public beta available (1997) absolute paths for databases? (1997) Image maps/Webcat (1997) SV: Mass Mail (2000) [WebDNA] Copy database from domain 1 to domain 2 (2010) webcat- multiple selection in input field (1997)