Re: [ID 20000917.004] Internal floating-point rounding error?

Philip Andrew <Philip.Andrew@stanfordalumni.org> writes:
>
>(adding 1/10 of my resolution to the number), but what's the
>point -- the round-off is supposed to be correct, isn't it?

perl (like the C it is built upon) has float -> int as truncate toward
zero not round. Your '%04d' forces integer. If you use %f or %g 
then round should be to nearest (decimal) and hence "correct".

-- 
Nick Ing-Simmons <nik@tiuk.ti.com>
Via, but not speaking for: Texas Instruments Ltd.

• [ID 20000917.004] Internal floating-point rounding error? by Philip Andrew
• Re: [ID 20000917.004] Internal floating-point rounding error? by John Peacock
• Re: [ID 20000917.004] Internal floating-point rounding error? by Nick Ing-Simmons
• Re: [ID 20000917.004] Internal floating-point rounding error? by Tom Christiansen