Re: inconsistent webcat calculation?

This WebDNA talk-list message is from

1997


It keeps the original formatting.
numero = 15008
interpreted = N
texte = >Just out of curiosity is there something bogus about the former way I did it?No, but you didn't say what was wrong either. I'll assume the numbers are slightly different, and that you were getting rounding errors based on your .2f formatting.Inside a math context, all numbers are computed out to a zillion digits. If you force the numbers down to fewer digits, they get rounded up or down.Grant Hulbert, V.P. Engineering | ==== eCommerce for the Rest of Us ==== Pacific Coast Software | WebCatalog, WebMerchant, 11770 Bernardo Plaza Court | SiteEdit Pro, PhotoMaster, San Diego, CA 92128 | Typhoon 619/675-1106 Fax: 619/675-0372 | http://www.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: inconsistent webcat calculation? (Grant Hulbert 1997)
  2. inconsistent webcat calculation? (w curt eggemeyer 1997)
>Just out of curiosity is there something bogus about the former way I did it?No, but you didn't say what was wrong either. I'll assume the numbers are slightly different, and that you were getting rounding errors based on your .2f formatting.Inside a math context, all numbers are computed out to a zillion digits. If you force the numbers down to fewer digits, they get rounded up or down.Grant Hulbert, V.P. Engineering | ==== eCommerce for the Rest of Us ==== Pacific Coast Software | WebCatalog, WebMerchant, 11770 Bernardo Plaza Court | SiteEdit Pro, PhotoMaster, San Diego, CA 92128 | Typhoon 619/675-1106 Fax: 619/675-0372 | http://www.smithmicro.com/ Grant Hulbert

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

WebCat2b12 CGI Mac -- Problems propagating the cart through frames...still (1997) Plain Language Manual? (1998) slightly OT: advertising schemes (2004) Orderfile context problem (1998) Press Release hit the NewsWire!!! (1997) [Math] Problem!!!! (2004) Special delete ... (1997) Setting up shop (1997) Include a big block of text (1997) searchable list archive (1997) My X-Mas Wish (1999) Uploading out of FMP (2001) problems with 2 tags (1997) (1997) another problem (1997) Image download problem (2001) Bug Report, maybe (1997) Generating Report Totals (1997) Re:Variable Math (1998) wierd crashes for multi-sendmails on NT (1997)