poi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bugzi...@apache.org
Subject [Bug 58966] Row.getCell doesn't retrieve the same value than what VBA gives
Date Wed, 03 Feb 2016 16:33:38 GMT

--- Comment #3 from Javen O'Neal <onealj@apache.org> ---
(In reply to jmclej from comment #2)
> (...844174 cannot give ...8447)

Sure it can. You're thinking of base 10 rounding, while the computer does base
2 rounding. The binary representation of ...844174 and ...8447 might be
adjacent, depending on how the floats are stored, what arithmetic is used to
calculate the values, the rounding errors that are accumulated along the way,
etc. Even simple 3*(1.0/3) could give an answer like 1.000000000007 or
0.9999999999994, which doesn't round to the correct answer

You are receiving this mail because:
You are the assignee for the bug.

To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org

View raw message