Re: How do I get Google to crawl a WebCat site?
This WebDNA talk-list message is from 2003
It keeps the original formatting.
numero = 48654
interpreted = N
texte = I have to disagree on the use of META tags:Do this:1.) Add a robots.txt file 2.) Add META description and keywords tags 3.) Include relevant text within the first 250 characters of plain HTML text displayed. 4.) Include your HTML links 5.) Submit yourself to Google! Don't wait for them to find you. Submit to all the search engines/directories, but submit to Google first!Other things you can do:1.) Get links to your page on as many other (related) websites as you can. 2.) Spend 50 bucks and purchase a pay-per-click service for a month or two. 3.) Be sure your intro text, meta descriptions and keywords are RELEVANT and don't repeat them. 4.) Create some other sites that interlink with each other. 5.) Develop some creative doorway style pages, but don't over do it!Basically your going to be judged on three things: (1) Relevance, (2) number of related page links leading to your page and (3) traffic.And as Donovan said, no tricks, just follow the search engine rules and spend the time to market and promote your website.Hope this helps, good luck!MK On Thursday, March 13, 2003, at 09:35 AM, Donovan wrote:> Dennis J. Bonsall, Jr. wrote: > >> I've developed numerous WebCat sites over the years, but have always >> had >> dismal results with search engines. While I have not had problems >> getting the home pages listed, I have never been able to get the >> remainder of the site crawled. I figured that part of the problem is >> related to the fact that all the links contain a '?' with at least >> 'cart=[cart]' after that point. However, on my most recent project, I >> have created a link on the home page that takes the search engine >> directly to the catalog without a question mark in the URL at all. >> But, >> Googlebot has visited the site three times over the past few months. >> According to my logs, it has requested robots.txt (as expected), then >> the home page. After that, it simply leaves and goes no further. >> There >> is no robots.txt file at all, so there is no restrictions on the >> search >> engines. I was hoping that someone on this list who knows more about >> search engines than I do might be able to tell me what I am doing >> wrong. The url for the site is http://www.cxsonline.com. >> > The most important things to remember is no tricks. do not include > any links with invisible > gifs or text links that are the same color as the back ground. > > IME, google will follow any link from the home page including ? links > > My best results come from a static link to a site map > > you might want to put a basic robots.txt file in your root of the > domain. > > # > # robots.txt for http://www.cxsonline.com/ > # > # $Id: robots.txt,v 1.22 2002/04/18 20:23:04 ted Exp $ > # > > # For use by all robots > User-agent: * > > Don't use the keywords meta tag > > Do use the Description meta tag > > Code in all the alt tags for graphics. > > HTH, > Donovan > >> >> Thanks in advance for the assistance, >> >> Dennis >> > > > -- > -Donovan Brooke > -Administrator of IT / > -Assc. Art Director > -Creative Services > -Epsen Hillmer Graphics > > -402.829.0123 > > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list
. > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Signed: Marc Kaiwi ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Associated Messages, from the most recent to the oldest:
I have to disagree on the use of META tags:Do this:1.) Add a robots.txt file 2.) Add META description and keywords tags 3.) Include relevant text within the first 250 characters of plain HTML text displayed. 4.) Include your HTML links 5.) Submit yourself to Google! Don't wait for them to find you. Submit to all the search engines/directories, but submit to Google first!Other things you can do:1.) Get links to your page on as many other (related) websites as you can. 2.) Spend 50 bucks and purchase a pay-per-click service for a month or two. 3.) Be sure your intro text, meta descriptions and keywords are RELEVANT and don't repeat them. 4.) Create some other sites that interlink with each other. 5.) Develop some creative doorway style pages, but don't over do it!Basically your going to be judged on three things: (1) Relevance, (2) number of related page links leading to your page and (3) traffic.And as Donovan said, no tricks, just follow the search engine rules and spend the time to market and promote your website.Hope this helps, good luck!MK On Thursday, March 13, 2003, at 09:35 AM, Donovan wrote:> Dennis J. Bonsall, Jr. wrote: > >> I've developed numerous WebCat sites over the years, but have always >> had >> dismal results with search engines. While I have not had problems >> getting the home pages listed, I have never been able to get the >> remainder of the site crawled. I figured that part of the problem is >> related to the fact that all the links contain a '?' with at least >> 'cart=[cart]' after that point. However, on my most recent project, I >> have created a link on the home page that takes the search engine >> directly to the catalog without a question mark in the URL at all. >> But, >> Googlebot has visited the site three times over the past few months. >> According to my logs, it has requested robots.txt (as expected), then >> the home page. After that, it simply leaves and goes no further. >> There >> is no robots.txt file at all, so there is no restrictions on the >> search >> engines. I was hoping that someone on this list who knows more about >> search engines than I do might be able to tell me what I am doing >> wrong. The url for the site is http://www.cxsonline.com. >> > The most important things to remember is no tricks. do not include > any links with invisible > gifs or text links that are the same color as the back ground. > > IME, google will follow any link from the home page including ? links > > My best results come from a static link to a site map > > you might want to put a basic robots.txt file in your root of the > domain. > > # > # robots.txt for http://www.cxsonline.com/ > # > # $Id: robots.txt,v 1.22 2002/04/18 20:23:04 ted Exp $ > # > > # For use by all robots > User-agent: * > > Don't use the keywords meta tag > > Do use the Description meta tag > > Code in all the alt tags for graphics. > > HTH, > Donovan > >> >> Thanks in advance for the assistance, >> >> Dennis >> > > > -- > -Donovan Brooke > -Administrator of IT / > -Assc. Art Director > -Creative Services > -Epsen Hillmer Graphics > > -402.829.0123 > > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Signed: Marc Kaiwi ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
marc@kaiwi.com (Marc Kaiwi)
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
WCS Newbie question (1997)
Reversed words (1997)
Multiple Newcarts (1996)
WebCat2: Items xx to xx shown, etc. (1997)
WebCat2.0 [format thousands .0f] no go (1997)
WebDNA Solutions ... sorry! (1997)
Sort Order on a page search (1997)
Return records from another (1997)
PCS Frames (1997)
headers (2004)
Grepping a csv (2003)
Still having problems with Authen (1997)
Signal Raised Error (Part III) (1997)
Re1000001: Setting up shop (1997)
Best way to upload file.... (2000)
New Plug-in and Type 11 errors (1997)
Cookie set browser session. (1998)
problems with 2 tags (1997)
Help name our technology! (1997)
Problem with empty form-variables in [search] (1998)