Re: WebCat table size.
This WebDNA talk-list message is from 2001
It keeps the original formatting.
numero = 37518
interpreted = N
texte = well using my talent for infinite short sightedness, i'm adding a row eachtime something happens, i will have to re-design the database.do something similar to the sam stats table. or go really wacky with someseriously normalised relational design and have 82 tables with 7 rows ineach one...hopefully i will be able to keep the functionality i currently have becausesome of the queries return some quite cool results.on 31/7/01 10:35 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:> That is not really that big, it will grow fast for a while and then the> growth should top out as all the pages that can be accessed are loaded into> the db. > > Are you only adding one entry per page and incrementing a value ?? Or adding> a new entry for every access?> > Alain> >> About 15000 rows and 3.9mb.>> >> on 31/7/01 10:02 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>> >>> How big is the db now ??>>> You can see this in the WebCat admin pages.>>> # of records etc.>>> >>> alain>>> >>>> Cheater!>>>> >>>> Well I have written this thing to record stats about hits on various area's>>>> of the site but it looks like if we keep on getting hits the way we are the>>>> table will out grow the machine in a matter of weeks.>>>> >>>> The sales people love it but it might fall over sooner rather than later.>>>> >>>> Might have to investigate some external database for it or at least>>>> re-arrange the data to minimise the number of characters collected.>>>> >>>> lets the sales staff see stuff like this though which is quite neat.>>>> >>>> COUNTRY COUNT>>>> sg 893>>>> hk 254>>>> nz 11>>>> my 346>>>> au 2320>>>> nz 6434>>>> us 4670>>>> >>>> page views since firday night.>>>> >>>> and lots more.>>>> >>>> on 31/7/01 9:10 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>>>> >>>>> Andrew,>>>>> WebCat will process the data fine - mine load the server a bit for a while>>>>> but it will get through it, the problem you will run into is the transfer>>>>> of>>>>> the info across the network. A 50MB HTML file will cause problems with IE>>>>> when it comes down at it.>>>>> >>>>> How do you mean the tables are used for appends ?? Are you appending on>>>>> every row in the table .. Can you explain this a bit more.>>>>> >>>>> Alain>>>>> PS: the machine is a 500MHz G4 :-)>>>>> >>>>>> What kind of db table size (byte size) can be comfortably accomadated>>>>>> before>>>>>> webcat/apache/webserver will start to complain or slow down ???>>>>>> >>>>>> On a G4 433mhz, 512mb, 14gb partion.>>>>>> >>>>>> os:10.0.4, webcat:4.0.2-v2, itools:v6.>>>>>> >>>>>> Anybody have any idea's>>>>>> >>>>>> 10mb table cause problems???>>>>>> 50mb table>>>>>> 1gb...>>>>>> >>>>>> Is it cummlative - would ten small tables used as frequently as one big>>>>>> one>>>>>> be just as slow???>>>>>> >>>>>> The table/s are just used for appends. Is there something that can be>>>>>> done>>>>>> to make tables be used more efficiently when you are not doing>>>>>> lookups/searchs on them or is this kind of thing automatic ???>>>>>> >>>>>> >>>>>> >>>>>> Andrew Simpson.>>>>>> >>>>>> >>>>>> ------------------------------------------------------------->>>>>> This message is sent to you because you are subscribed to>>>>>> the mailing list
.>>>>>> To unsubscribe, E-mail to: >>>>>> To switch to the DIGEST mode, E-mail to>>>>>> >>>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>>>> >>>>> >>>>> >>>>> ------------------------------------------------------------->>>>> This message is sent to you because you are subscribed to>>>>> the mailing list .>>>>> To unsubscribe, E-mail to: >>>>> To switch to the DIGEST mode, E-mail to>>>>> >>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>>> >>>> ------------------------------------------------------------->>>> This message is sent to you because you are subscribed to>>>> the mailing list .>>>> To unsubscribe, E-mail to: >>>> To switch to the DIGEST mode, E-mail to>>>> >>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>> >>> >>> ------------------------------------------------------------->>> This message is sent to you because you are subscribed to>>> the mailing list .>>> To unsubscribe, E-mail to: >>> To switch to the DIGEST mode, E-mail to>>> >>> Web Archive of this list is at: http://search.smithmicro.com/>> >> >> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://search.smithmicro.com/>> > > > -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://search.smithmicro.com/-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Associated Messages, from the most recent to the oldest:
well using my talent for infinite short sightedness, i'm adding a row eachtime something happens, i will have to re-design the database.do something similar to the sam stats table. or go really wacky with someseriously normalised relational design and have 82 tables with 7 rows ineach one...hopefully i will be able to keep the functionality i currently have becausesome of the queries return some quite cool results.on 31/7/01 10:35 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:> That is not really that big, it will grow fast for a while and then the> growth should top out as all the pages that can be accessed are loaded into> the db. > > Are you only adding one entry per page and incrementing a value ?? Or adding> a new entry for every access?> > Alain> >> About 15000 rows and 3.9mb.>> >> on 31/7/01 10:02 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>> >>> How big is the db now ??>>> You can see this in the WebCat admin pages.>>> # of records etc.>>> >>> alain>>> >>>> Cheater!>>>> >>>> Well I have written this thing to record stats about hits on various area's>>>> of the site but it looks like if we keep on getting hits the way we are the>>>> table will out grow the machine in a matter of weeks.>>>> >>>> The sales people love it but it might fall over sooner rather than later.>>>> >>>> Might have to investigate some external database for it or at least>>>> re-arrange the data to minimise the number of characters collected.>>>> >>>> lets the sales staff see stuff like this though which is quite neat.>>>> >>>> COUNTRY COUNT>>>> sg 893>>>> hk 254>>>> nz 11>>>> my 346>>>> au 2320>>>> nz 6434>>>> us 4670>>>> >>>> page views since firday night.>>>> >>>> and lots more.>>>> >>>> on 31/7/01 9:10 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>>>> >>>>> Andrew,>>>>> WebCat will process the data fine - mine load the server a bit for a while>>>>> but it will get through it, the problem you will run into is the transfer>>>>> of>>>>> the info across the network. A 50MB HTML file will cause problems with IE>>>>> when it comes down at it.>>>>> >>>>> How do you mean the tables are used for appends ?? Are you appending on>>>>> every row in the table .. Can you explain this a bit more.>>>>> >>>>> Alain>>>>> PS: the machine is a 500MHz G4 :-)>>>>> >>>>>> What kind of db table size (byte size) can be comfortably accomadated>>>>>> before>>>>>> webcat/apache/webserver will start to complain or slow down ???>>>>>> >>>>>> On a G4 433mhz, 512mb, 14gb partion.>>>>>> >>>>>> os:10.0.4, webcat:4.0.2-v2, itools:v6.>>>>>> >>>>>> Anybody have any idea's>>>>>> >>>>>> 10mb table cause problems???>>>>>> 50mb table>>>>>> 1gb...>>>>>> >>>>>> Is it cummlative - would ten small tables used as frequently as one big>>>>>> one>>>>>> be just as slow???>>>>>> >>>>>> The table/s are just used for appends. Is there something that can be>>>>>> done>>>>>> to make tables be used more efficiently when you are not doing>>>>>> lookups/searchs on them or is this kind of thing automatic ???>>>>>> >>>>>> >>>>>> >>>>>> Andrew Simpson.>>>>>> >>>>>> >>>>>> ------------------------------------------------------------->>>>>> This message is sent to you because you are subscribed to>>>>>> the mailing list .>>>>>> To unsubscribe, E-mail to: >>>>>> To switch to the DIGEST mode, E-mail to>>>>>> >>>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>>>> >>>>> >>>>> >>>>> ------------------------------------------------------------->>>>> This message is sent to you because you are subscribed to>>>>> the mailing list .>>>>> To unsubscribe, E-mail to: >>>>> To switch to the DIGEST mode, E-mail to>>>>> >>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>>> >>>> ------------------------------------------------------------->>>> This message is sent to you because you are subscribed to>>>> the mailing list .>>>> To unsubscribe, E-mail to: >>>> To switch to the DIGEST mode, E-mail to>>>> >>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>> >>> >>> ------------------------------------------------------------->>> This message is sent to you because you are subscribed to>>> the mailing list .>>> To unsubscribe, E-mail to: >>> To switch to the DIGEST mode, E-mail to>>> >>> Web Archive of this list is at: http://search.smithmicro.com/>> >> >> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://search.smithmicro.com/>> > > > -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://search.smithmicro.com/-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Andrew Simpson
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Need help (1998)
Weird Problem (1997)
Password protection (Was: Lost Password?) (2002)
WebCatalog on SUSE-Linux 6.3... please help! (2000)
[WebDNA] unique words (2009)
printing twice? and fix (1997)
[WebDNA] Bug with function parameter named "name" (2013)
Javascript & Search Results (1998)
Extended [ConvertChars] (1997)
Which GUI HTML editors work with WC ? (1997)
Very serious bug with the [protect] tag (2003)
Date Formats (1997)
[searchString] (1997)
[OT] BBedit Blank Line removal (2003)
Shell traceroute (2001)
[OT] Might be of interest... (2006)
WebCat2b15MacPlugin - showing [math] (1997)
one item in several different categories? (2000)
ASCII Code 127 (2004)
WebCatalog Help (2002)