Re: inconsistent webcat calculation?

This WebDNA talk-list message is from

1997


It keeps the original formatting.
numero = 15008
interpreted = N
texte = >Just out of curiosity is there something bogus about the former way I did it?No, but you didn't say what was wrong either. I'll assume the numbers are slightly different, and that you were getting rounding errors based on your .2f formatting.Inside a math context, all numbers are computed out to a zillion digits. If you force the numbers down to fewer digits, they get rounded up or down.Grant Hulbert, V.P. Engineering | ==== eCommerce for the Rest of Us ==== Pacific Coast Software | WebCatalog, WebMerchant, 11770 Bernardo Plaza Court | SiteEdit Pro, PhotoMaster, San Diego, CA 92128 | Typhoon 619/675-1106 Fax: 619/675-0372 | http://www.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: inconsistent webcat calculation? (Grant Hulbert 1997)
  2. inconsistent webcat calculation? (w curt eggemeyer 1997)
>Just out of curiosity is there something bogus about the former way I did it?No, but you didn't say what was wrong either. I'll assume the numbers are slightly different, and that you were getting rounding errors based on your .2f formatting.Inside a math context, all numbers are computed out to a zillion digits. If you force the numbers down to fewer digits, they get rounded up or down.Grant Hulbert, V.P. Engineering | ==== eCommerce for the Rest of Us ==== Pacific Coast Software | WebCatalog, WebMerchant, 11770 Bernardo Plaza Court | SiteEdit Pro, PhotoMaster, San Diego, CA 92128 | Typhoon 619/675-1106 Fax: 619/675-0372 | http://www.smithmicro.com/ Grant Hulbert

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Status? (2000) WebCommerce: Folder organization ? (1997) Possible Bug in 2.0b15.acgi (1997) NT - Thanks and Taxes (1997) WebCatalog [FoundItems] Problem - AGAIN - (1997) [WebDNA] [hideif]'s not working in [sendmail] (2008) Separate SSL Server (1997) Searching for all records (1998) Trouble with formula.db + more explanation (1997) Pithy questions on webcommerce & siteedit (1997) Re:Hideif / Showif (1998) WebCommerce: Folder organization ? (1997) PIXO support (1997) Mime Headers for Mail (1998) Pre-flight public flag (1997) WebCatalog (1998) WebCat2b14MacPlugIn - [include] doesn't hide the search string (1997) Type 11 errors setting up WebCAt 2 (1997) [WriteFile] problems (1997) WebCatalog can't find database (1997)