Re: WebCat table size.
This WebDNA talk-list message is from 2001
It keeps the original formatting.
numero = 37518
interpreted = N
texte = well using my talent for infinite short sightedness, i'm adding a row eachtime something happens, i will have to re-design the database.do something similar to the sam stats table. or go really wacky with someseriously normalised relational design and have 82 tables with 7 rows ineach one...hopefully i will be able to keep the functionality i currently have becausesome of the queries return some quite cool results.on 31/7/01 10:35 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:> That is not really that big, it will grow fast for a while and then the> growth should top out as all the pages that can be accessed are loaded into> the db. > > Are you only adding one entry per page and incrementing a value ?? Or adding> a new entry for every access?> > Alain> >> About 15000 rows and 3.9mb.>> >> on 31/7/01 10:02 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>> >>> How big is the db now ??>>> You can see this in the WebCat admin pages.>>> # of records etc.>>> >>> alain>>> >>>> Cheater!>>>> >>>> Well I have written this thing to record stats about hits on various area's>>>> of the site but it looks like if we keep on getting hits the way we are the>>>> table will out grow the machine in a matter of weeks.>>>> >>>> The sales people love it but it might fall over sooner rather than later.>>>> >>>> Might have to investigate some external database for it or at least>>>> re-arrange the data to minimise the number of characters collected.>>>> >>>> lets the sales staff see stuff like this though which is quite neat.>>>> >>>> COUNTRY COUNT>>>> sg 893>>>> hk 254>>>> nz 11>>>> my 346>>>> au 2320>>>> nz 6434>>>> us 4670>>>> >>>> page views since firday night.>>>> >>>> and lots more.>>>> >>>> on 31/7/01 9:10 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>>>> >>>>> Andrew,>>>>> WebCat will process the data fine - mine load the server a bit for a while>>>>> but it will get through it, the problem you will run into is the transfer>>>>> of>>>>> the info across the network. A 50MB HTML file will cause problems with IE>>>>> when it comes down at it.>>>>> >>>>> How do you mean the tables are used for appends ?? Are you appending on>>>>> every row in the table .. Can you explain this a bit more.>>>>> >>>>> Alain>>>>> PS: the machine is a 500MHz G4 :-)>>>>> >>>>>> What kind of db table size (byte size) can be comfortably accomadated>>>>>> before>>>>>> webcat/apache/webserver will start to complain or slow down ???>>>>>> >>>>>> On a G4 433mhz, 512mb, 14gb partion.>>>>>> >>>>>> os:10.0.4, webcat:4.0.2-v2, itools:v6.>>>>>> >>>>>> Anybody have any idea's>>>>>> >>>>>> 10mb table cause problems???>>>>>> 50mb table>>>>>> 1gb...>>>>>> >>>>>> Is it cummlative - would ten small tables used as frequently as one big>>>>>> one>>>>>> be just as slow???>>>>>> >>>>>> The table/s are just used for appends. Is there something that can be>>>>>> done>>>>>> to make tables be used more efficiently when you are not doing>>>>>> lookups/searchs on them or is this kind of thing automatic ???>>>>>> >>>>>> >>>>>> >>>>>> Andrew Simpson.>>>>>> >>>>>> >>>>>> ------------------------------------------------------------->>>>>> This message is sent to you because you are subscribed to>>>>>> the mailing list
.>>>>>> To unsubscribe, E-mail to: >>>>>> To switch to the DIGEST mode, E-mail to>>>>>> >>>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>>>> >>>>> >>>>> >>>>> ------------------------------------------------------------->>>>> This message is sent to you because you are subscribed to>>>>> the mailing list .>>>>> To unsubscribe, E-mail to: >>>>> To switch to the DIGEST mode, E-mail to>>>>> >>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>>> >>>> ------------------------------------------------------------->>>> This message is sent to you because you are subscribed to>>>> the mailing list .>>>> To unsubscribe, E-mail to: >>>> To switch to the DIGEST mode, E-mail to>>>> >>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>> >>> >>> ------------------------------------------------------------->>> This message is sent to you because you are subscribed to>>> the mailing list .>>> To unsubscribe, E-mail to: >>> To switch to the DIGEST mode, E-mail to>>> >>> Web Archive of this list is at: http://search.smithmicro.com/>> >> >> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://search.smithmicro.com/>> > > > -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://search.smithmicro.com/-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Associated Messages, from the most recent to the oldest:
well using my talent for infinite short sightedness, i'm adding a row eachtime something happens, i will have to re-design the database.do something similar to the sam stats table. or go really wacky with someseriously normalised relational design and have 82 tables with 7 rows ineach one...hopefully i will be able to keep the functionality i currently have becausesome of the queries return some quite cool results.on 31/7/01 10:35 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:> That is not really that big, it will grow fast for a while and then the> growth should top out as all the pages that can be accessed are loaded into> the db. > > Are you only adding one entry per page and incrementing a value ?? Or adding> a new entry for every access?> > Alain> >> About 15000 rows and 3.9mb.>> >> on 31/7/01 10:02 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>> >>> How big is the db now ??>>> You can see this in the WebCat admin pages.>>> # of records etc.>>> >>> alain>>> >>>> Cheater!>>>> >>>> Well I have written this thing to record stats about hits on various area's>>>> of the site but it looks like if we keep on getting hits the way we are the>>>> table will out grow the machine in a matter of weeks.>>>> >>>> The sales people love it but it might fall over sooner rather than later.>>>> >>>> Might have to investigate some external database for it or at least>>>> re-arrange the data to minimise the number of characters collected.>>>> >>>> lets the sales staff see stuff like this though which is quite neat.>>>> >>>> COUNTRY COUNT>>>> sg 893>>>> hk 254>>>> nz 11>>>> my 346>>>> au 2320>>>> nz 6434>>>> us 4670>>>> >>>> page views since firday night.>>>> >>>> and lots more.>>>> >>>> on 31/7/01 9:10 AM, Alain Russell at alain.russell@blackpepper.co.nz wrote:>>>> >>>>> Andrew,>>>>> WebCat will process the data fine - mine load the server a bit for a while>>>>> but it will get through it, the problem you will run into is the transfer>>>>> of>>>>> the info across the network. A 50MB HTML file will cause problems with IE>>>>> when it comes down at it.>>>>> >>>>> How do you mean the tables are used for appends ?? Are you appending on>>>>> every row in the table .. Can you explain this a bit more.>>>>> >>>>> Alain>>>>> PS: the machine is a 500MHz G4 :-)>>>>> >>>>>> What kind of db table size (byte size) can be comfortably accomadated>>>>>> before>>>>>> webcat/apache/webserver will start to complain or slow down ???>>>>>> >>>>>> On a G4 433mhz, 512mb, 14gb partion.>>>>>> >>>>>> os:10.0.4, webcat:4.0.2-v2, itools:v6.>>>>>> >>>>>> Anybody have any idea's>>>>>> >>>>>> 10mb table cause problems???>>>>>> 50mb table>>>>>> 1gb...>>>>>> >>>>>> Is it cummlative - would ten small tables used as frequently as one big>>>>>> one>>>>>> be just as slow???>>>>>> >>>>>> The table/s are just used for appends. Is there something that can be>>>>>> done>>>>>> to make tables be used more efficiently when you are not doing>>>>>> lookups/searchs on them or is this kind of thing automatic ???>>>>>> >>>>>> >>>>>> >>>>>> Andrew Simpson.>>>>>> >>>>>> >>>>>> ------------------------------------------------------------->>>>>> This message is sent to you because you are subscribed to>>>>>> the mailing list .>>>>>> To unsubscribe, E-mail to: >>>>>> To switch to the DIGEST mode, E-mail to>>>>>> >>>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>>>> >>>>> >>>>> >>>>> ------------------------------------------------------------->>>>> This message is sent to you because you are subscribed to>>>>> the mailing list .>>>>> To unsubscribe, E-mail to: >>>>> To switch to the DIGEST mode, E-mail to>>>>> >>>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>>> >>>> ------------------------------------------------------------->>>> This message is sent to you because you are subscribed to>>>> the mailing list .>>>> To unsubscribe, E-mail to: >>>> To switch to the DIGEST mode, E-mail to>>>> >>>> Web Archive of this list is at: http://search.smithmicro.com/>>>> >>> >>> >>> ------------------------------------------------------------->>> This message is sent to you because you are subscribed to>>> the mailing list .>>> To unsubscribe, E-mail to: >>> To switch to the DIGEST mode, E-mail to>>> >>> Web Archive of this list is at: http://search.smithmicro.com/>> >> >> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://search.smithmicro.com/>> > > > -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://search.smithmicro.com/-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/
Andrew Simpson
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
searchable list archive (1997)
[WebDNA] TLS 1.2 and [tcpconnect] (2018)
Re:quit command on NT (1997)
webdelivery.html and webna (1997)
select multiple 2 more cents (1997)
WebCat2b13MacPlugIn - More limits on [include] (1997)
Multiple catalog databases and showcart (1997)
Silly Question (1997)
CommandSecurity? (1997)
2 databases (1998)
Sendmail Excel Attachment (2006)
WebCat2 - [include] tags (1997)
PIXO support (1997)
creator code (1997)
Upgrading old WebCat Database Files (1997)
Size limit for tmpl editor ? (1997)
Problems with [Applescript] (1997)
Re:Emailer and encryption (1997)
Single Link browsing (1997)
WebMerchant docs and testing (2000)