PDA

View Full Version : [SOLVED] Inaccurate results from formula



Aussiebear
12-20-2013, 03:32 AM
I've been amending gps marks from Time Degrees to Decimal degrees and the results are not quite what I was expecting. The formula I use is "=Left(A1,3) + Mid(A3,4,2)/60 + Right(A1,3)/60/60" which strips strings based on Degrees.Minutes.Seconds

A string such as 150.50.000 is returning 150.00833333 which is clearly wrong if anything it should be 150.83333333 since the Left function returns 150, the Mid function is meant to return 0.83333333, and the Right function returns zero. What could be happening here?

snb
12-20-2013, 03:41 AM
I'd say, use

Mid(A3,5,2)/60

Aussiebear
12-20-2013, 03:41 AM
Never mind. Too many hours in the hot sun I guess. Formula is incorrect and should read "=Left(A1,3)+Mid(A1,5,2)/60+Right(A1,3)/60/60" :blush

Aussiebear
12-20-2013, 03:42 AM
Thanks snb