Error while assigning a variable

if I assign x a value of 16.000001 then it stores 16.00000100000001... and if I assign x avalue of 15.000001 then it stores 15.00000099999999.. . How to remove this error

Answer 1

[dipak nigam]

You can refer to this answer to understand the above behaviour.

https://www.mathworks.com/matlabcentral/answers/357800-how-to-store-only-3-digits-after-the-decimal-point

A possible workaround is to define these values as:

xN = 15000001;

yN = 16000001;

D = 1000000;

and then use them in your calculations for best possible precision.

Answer 2

[Shubhankar Poundrik]

Hi Himanshu,

I understand that you are trying to store floating point numbers in variables and are not sure why the value in the variable is slightly different from what you entered.

This problem occurs because not all floating point numbers can be accurately represented in binary format. To store the float (floating point number) a certain number of bytes are used, and the binary representation of the float may have 1s beyond what can be stored in the available bytes.

Read for more detailed explanation :

http://effbot.org/pyfaq/why-are-floating-point-calculations-so-inaccurate.htm#:~:text=It's%20a%20problem%20caused%20by,resulting%20in%20small%20roundoff%20errors.&text=In%20base%202%2C%201%2F2,8%20%3D%200.001%2C%20etc.%20.

Regards,

Shubhankar.

[Walter Roberson]

Statistically, the fraction of real numbers that can be stored as floating point, is zero. There are real numbers, but less than floating point numbers, and a finite non-zero number divided by an infinite quantity gives 0.