Re: Math Bug
This WebDNA talk-list message is from 1999
It keeps the original formatting.
numero = 25450
interpreted = N
texte = I've seen those 99999's appear all the way back to 2.1 versions of WebCat. For my purposes, I've just rounded off with [format] but not pretty before that.Sandy >I've run across a math bug when summarizing a large number of records using >this technique: >[some search context] >[math][founditems][commission]+[/founditems]0[/math] >[/search] > >Once the search hits about the 130-135th record the total which should look >like: 79924.24 instead gets formatted as 79924.2399999999. I've zapped >gremlins, reloaded the database, changed the startat value, verified that >all values are integers (all are formatted x.xx ), even modified the >contents of the records with different values and still the computed value >gets formatted as .xx99999999. > >As a further test I created a test db and wrote out the commission values >from the problem db to the test db and the results are the same - although >the problem begins at the 125th record - *does not* appear in the 126th >record but comes back at the 127th record. What the heck is going on here? > >Running 3.04PI w/Web* 4.0 on a G4 w/OS 8.6 >Thanks >Marty Schmid > > > >------------------------------------------------------------- >Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. >To end your Mail problems go to
. > >This message is sent to you because you are subscribed to > the mailing list . >To unsubscribe, E-mail to: >To switch to the DIGEST mode, E-mail to >------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Associated Messages, from the most recent to the oldest:
I've seen those 99999's appear all the way back to 2.1 versions of WebCat. For my purposes, I've just rounded off with [format] but not pretty before that.Sandy >I've run across a math bug when summarizing a large number of records using >this technique: >[some search context] >[math][founditems][commission]+[/founditems]0[/math] >[/search] > >Once the search hits about the 130-135th record the total which should look >like: 79924.24 instead gets formatted as 79924.2399999999. I've zapped >gremlins, reloaded the database, changed the startat value, verified that >all values are integers (all are formatted x.xx ), even modified the >contents of the records with different values and still the computed value >gets formatted as .xx99999999. > >As a further test I created a test db and wrote out the commission values >from the problem db to the test db and the results are the same - although >the problem begins at the 125th record - *does not* appear in the 126th >record but comes back at the 127th record. What the heck is going on here? > >Running 3.04PI w/Web* 4.0 on a G4 w/OS 8.6 >Thanks >Marty Schmid > > > >------------------------------------------------------------- >Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. >To end your Mail problems go to . > >This message is sent to you because you are subscribed to > the mailing list . >To unsubscribe, E-mail to: >To switch to the DIGEST mode, E-mail to >------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Sandra L. Pitner
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
ShipCost formula (for weight *and* quantities)? (1998)
WC2.0 Memory Requirements (1997)
showif errors (1998)
hidden databases (2000)
[SearchString] usage (1997)
WebCatalog2 Feature Feedback (1996)
Tiny Store: Remove Line Item? (2000)
[OT] Checkboxes! Javascript? (2005)
[OT] Airport Network (2003)
Max Record length restated as maybe bug (1997)
WebCat & WebTen (1997)
multi-paragraph fields (1997)
question: search return in order (1997)
many-to-one problem (1998)
Custom Shipping Charges (1997)
[authenticate] was [TIME] not working (2007)
[taxRate] [TaxTotal] ? (1997)
Re1000001: Setting up shop (1997)
Trouble with formula.db (1997)
WebCatalog 4.0 has been released! (2000)