Re: Odd [math] behaviour

This WebDNA talk-list message is from

2003

It keeps the original formatting. numero = 52774
interpreted = N
texte = I fully agree, I don't understand why any calculations or formatting are required. This is simple subtraction. 6000.4-5300.3 is 700.1 a small child could do it.Webcat seems to have no problem with these other difficult sums...6.0004-5.3003=0.700160.004-53.003=7.001600.04-530.03=70.016000.4-5300.3=700.09999999999960004-53003=7001600040-530030=7001060.4-53.3=7.1600.4-530.3=70.160000.4-53000.3=7000.1600000.4-530000.3=70000.1PaulOn Thursday, September 11, 2003, at 07:50 pm, Donovan wrote:> Since my background is art rather than math ;-)...>> I'm haveing difficulty understanding this.>> On my calculator:> If I take 3.2/3 I get 1.06 - repeating> If I take 6000.4-5300.3 I get 700.1>> How again does [math][/math] interpret this differently?>> sorry if my brain is thick.> (I'll blaim it on the late 80's)>> Donovan>>>> John Peacock wrote:> [snip]>> It's your computer, not WebDNA. Floating point math is not exact; it >> is approximate. Certain combinations will not ever work in the way >> you are used to "on paper" so you just have to deal with it.>> I see that round() is not a valid function within the [math] (which >> is dumb), so you'll have to brew your own:>> [math]floor((6000.4-5300.3+0.005)*100)/100[/math]>> will display what you would expect.>> NOTE: because you are using floating point, even the above may not >> work all of the time, because some decimal representations are not >> possible to accurately store using floating point numbers (which are >> stored internally as a power of 2 not 10).>> HTH>> John>>>> -- > =o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o> DONOVAN D. BROOKE> Eucalyptus Design> Developer / Consultant> <-Web Development (specializing in eCommerce), ->> <-Graphic Design, and Pre-Press Consultation ->>> ADDRESS:> Donovan Brooke> DBA Eucalyptus Design> P.O. Box 260153> Madison, WI 53726-0153>> PH:> 1.608.592.3567> email:> dbrooke@euca.us> Web:> http://www.euca.us> =o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

Re: Odd [math] behaviour ( Tim Robinson 2003)
Re: Odd [math] behaviour ( John Peacock 2003)
Re: Odd [math] behaviour ( Paul Willis 2003)
Re: Odd [math] behaviour ( Donovan 2003)
Re: Odd [math] behaviour ( John Peacock 2003)
Re: Odd [math] behaviour ( "WebDna @" 2003)
Re: Odd [math] behaviour ( John Peacock 2003)
Re: Odd [math] behaviour ( Donovan 2003)
Re: Odd [math] behaviour ( "WebDna @" 2003)
Re: Odd [math] behaviour ( Pat Holliday 2003)
Re: Odd [math] behaviour ( "WebDna @" 2003)
Re: Odd [math] behaviour ( John Peacock 2003)
Odd [math] behaviour ( Pat Holliday 2003)

I fully agree, I don't understand why any calculations or formatting are required. This is simple subtraction. 6000.4-5300.3 is 700.1 a small child could do it.Webcat seems to have no problem with these other difficult sums...6.0004-5.3003=0.700160.004-53.003=7.001600.04-530.03=70.016000.4-5300.3=700.09999999999960004-53003=7001600040-530030=7001060.4-53.3=7.1600.4-530.3=70.160000.4-53000.3=7000.1600000.4-530000.3=70000.1PaulOn Thursday, September 11, 2003, at 07:50 pm, Donovan wrote:> Since my background is art rather than math ;-)...>> I'm haveing difficulty understanding this.>> On my calculator:> If I take 3.2/3 I get 1.06 - repeating> If I take 6000.4-5300.3 I get 700.1>> How again does [math][/math] interpret this differently?>> sorry if my brain is thick.> (I'll blaim it on the late 80's)>> Donovan>>>> John Peacock wrote:> [snip]>> It's your computer, not WebDNA. Floating point math is not exact; it >> is approximate. Certain combinations will not ever work in the way >> you are used to "on paper" so you just have to deal with it.>> I see that round() is not a valid function within the [math] (which >> is dumb), so you'll have to brew your own:>> [math]floor((6000.4-5300.3+0.005)*100)/100[/math]>> will display what you would expect.>> NOTE: because you are using floating point, even the above may not >> work all of the time, because some decimal representations are not >> possible to accurately store using floating point numbers (which are >> stored internally as a power of 2 not 10).>> HTH>> John>>>> -- > =o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o> DONOVAN D. BROOKE> Eucalyptus Design> Developer / Consultant> <-Web Development (specializing in eCommerce), ->> <-Graphic Design, and Pre-Press Consultation ->>> ADDRESS:> Donovan Brooke> DBA Eucalyptus Design> P.O. Box 260153> Madison, WI 53726-0153>> PH:> 1.608.592.3567> email:> dbrooke@euca.us> Web:> http://www.euca.us> =o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o=o>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Paul Willis

DOWNLOAD WEBDNA NOW!

Re: Odd [math] behaviour

2003

Top Articles:

Related Readings: