PDA

View Full Version : [SOLVED:] Excel Mod function error


Emily
08-29-2005, 05:11 AM
Mod(10737418239,80) = 79

10737418240 - 80*INT(10737418240/80) = 0

Mod(10737418240,80) = #Num

Number > 10737418239 then Mod() reports #Num error

Any body know why?

Thanks in advance
Emily
Bob Phillips
08-29-2005, 05:18 AM
Mod(10737418239,80) = 79

10737418240 - 80*INT(10737418240/80) = 0

Mod(10737418240,80) = #Num

Number > 10737418239 then Mod() reports #Num error

Any body know why?

Thanks in advance
Emily

Don't know for sure, FP arithmetic nuances are not my field, but I bet it is lack of precision in FP.

MOD uses FP, the other example doesn't, works in integer arithmetic.

.
Emily
08-30-2005, 01:31 AM
Solved:
Reference http://www.bettersolutions.com/excel/6122425999101021601724152112245/6122425999101012119002071325127.htm
Bob Phillips
08-30-2005, 02:25 AM
Solved:
Reference http://www.bettersolutions.com/excel/6122425999101021601724152112245/6122425999101012119002071325127.htm

Yeah, there is a KB article on it

http://support.microsoft.com/default.aspx?kbid=119083 (http://support.microsoft.com/default.aspx?kbid=119083)

XL: MOD() Function Returns #NUM! Error Value

as well as an interesting Google discussion
http://tinyurl.com/9qaqj