View Single Post
  #19  
Old 06-29-2005, 04:19 PM
sakki sakki is offline
Junior Member
 
Join Date: Mar 2005
Posts: 8
Default Re: Got my calculator to lie

Light-weight [img]/images/graemlins/wink.gif[/img] analysis on the reasons why the results are inaccurate:
What every computer scientist should know about floating-point arithmetics

The fact is that it's not possible to represent e.g. 1/10 or 1/3 accurately with typical binary notations.
Reply With Quote