Math Bug
This WebDNA talk-list message is from 1999
It keeps the original formatting.
numero = 25443
interpreted = N
texte = I've run across a math bug when summarizing a large number of records using this technique: [some search context] [math][founditems][commission]+[/founditems]0[/math] [/search]Once the search hits about the 130-135th record the total which should look like: 79924.24 instead gets formatted as 79924.2399999999. I've zapped gremlins, reloaded the database, changed the startat value, verified that all values are integers (all are formatted x.xx ), even modified the contents of the records with different values and still the computed value gets formatted as .xx99999999.As a further test I created a test db and wrote out the commission values from the problem db to the test db and the results are the same - although the problem begins at the 125th record - *does not* appear in the 126th record but comes back at the 127th record. What the heck is going on here?Running 3.04PI w/Web* 4.0 on a G4 w/OS 8.6 Thanks Marty Schmid------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to
.This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Associated Messages, from the most recent to the oldest:
I've run across a math bug when summarizing a large number of records using this technique: [some search context] [math][founditems][commission]+[/founditems]0[/math] [/search]Once the search hits about the 130-135th record the total which should look like: 79924.24 instead gets formatted as 79924.2399999999. I've zapped gremlins, reloaded the database, changed the startat value, verified that all values are integers (all are formatted x.xx ), even modified the contents of the records with different values and still the computed value gets formatted as .xx99999999.As a further test I created a test db and wrote out the commission values from the problem db to the test db and the results are the same - although the problem begins at the 125th record - *does not* appear in the 126th record but comes back at the 127th record. What the heck is going on here?Running 3.04PI w/Web* 4.0 on a G4 w/OS 8.6 Thanks Marty Schmid------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to
Marty Schmid
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
WebCat2 several catalogs? (1997)
two unique banners on one page (1997)
Serial Number Question (1997)
SSL problems (1998)
creating a ShipCosts database (1997)
The Top Ten (2002)
[input] questions (1997)
Date Formats (1997)
Not really WebCat (1997)
Server slowing down. (1997)
Sort Order on a page search (1997)
Notepad problems (1998)
What am I missing (1997)
Here we go again...WebDNA - SQL- Stored Procedures (2006)
apostrophe in search item (1997)
Summary search -- speed (1997)
.. more on sliding discounts... (1997)
WebCat2 Append problem (B14Macacgi) (1997)
WebCat2: multiple currency support (1997)
CART question (2004)