You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
36 lines
1.4 KiB
36 lines
1.4 KiB
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"> |
|
|
|
<html lang="en"> |
|
|
|
<head> |
|
<title>TTCalc - accuracy</title> |
|
<link rel="stylesheet" href="styles.css" type="text/css"> |
|
<object type="application/x-oleobject" classid="clsid:1e2a7bd0-dab9-11d0-b93a-00c04fc99f9e"> |
|
<param name="Keyword" value="accuracy"> |
|
</object> |
|
</head> |
|
|
|
<body> |
|
|
|
<h1>Accuracy</h1> |
|
|
|
<p> |
|
TTCalc uses binary floating point numbers. It means that your input values are first |
|
converted to a binary representation and then the calculations are performed. After |
|
calculating the result is again converted from the binary to the decimal (you can |
|
select the input and output format on the display tab). You must remember that not |
|
all values can be converted from binary to decimal (and vice versa) without loosing |
|
accuracy. For example decimal '5' can be converted to binary '101' and the '101' is |
|
exactly equal decimal 5. But decimal '0.3' has not a good binary representation, it |
|
is '0.010011001100110011.....'. And when you put decimal '0.3' the calculations are |
|
performed on an approximate value and the result is only an approximation too. |
|
</p> |
|
|
|
<p> |
|
For example try to calculate: 0.204 - 0.34*0.80 + 0.068, you would expect that the |
|
result was 0 but TTCalc gives you: 3.15544362088404722164691426e-30 which is |
|
a good approximation to the real zero (look at e-30 part which means 10^(-30)). |
|
</p> |
|
|
|
</body> |
|
</html>
|
|
|