Sorry havign a thick day what does 3.402823466e+38 equate too?
john paley said:3.402823466e+38 translates to 3.402823466 times 10 to the 38th power. Or in laymen's terms--a ****load.
A 24 bit mantissa can represent numbers to (2^16)-1 or about 16000000. That is 7 full digits and a little more.TWControls said:It retains 10 digits of accuracy
Jezz said:Sorry havign a thick day what does 3.402823466e+38 equate too?
Jezz said:... the max value is 41,040,000.00 will the float hold this ?
Peter Nachtwey said:A 24 bit mantissa can represent numbers to (2^16)-1 or about 16000000. That is 7 full digits and a little more.
There is an important question that must be asked. Since this topic has been covered a few times before I will let someone else figure it out.
I am expressedly interested to understand how it can provide 10 digit precision.
It can't. As Alaric pointed out, one can count to a little over 16 million by one without losing precision. This is only 7 full decimal places or digits.
I thought this was stating it could use 10 digits for floating point but that was not what you were saying. You were giving the information that using LONG integers he could use 40,040,000 value if the decimal aspect was not a critical factor.BTW, The ML1100 can support 32 bit long integers. The 32 bit long will accurately count to over 2 billion (2,147,483,647).
rsdoran said:You were giving the information that using LONG integers he could use 40,040,000 value if the decimal aspect was not a critical factor.
Peter Nachtwey said:I am expressedly interested to understand how it can provide 10 digit precision.
I stand correct, 7 digits as Peter and Alaric pointed outIt can't. As Alaric pointed out, one can count to a little over 16 million by one without losing precision. This is only 7 full decimal places or digits.