This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Getting odd floating point results.

((lat2-lat1)*BETA*(lat2-lat1)*BETA + (long2-long1)*delta*(long2-long1)*delta)

I'm writing some C code and I am getting some screwy results. Basically lat1, lat2, long1, long2 are all latitudes and longitudes in radians, delta is another precalculated parameter. BETA is a defined constant.

As far as I can tell this code always results in an answer equal to BETA regardless of changing inputs. Additionally when I brake out the two addition terms: (lat2-lat1)*BETA*(lat2-lat1)*BETA and (long2-long1)*delta*(long2-long1)*delta), and compute them separately I get a result of "0". I have been trying to wrap my head around what is wrong without success for a day now. Any suggestions for things to try would be appreciated.

Thanks in advance.

Parents
  • Thanks all for the help, I believe I have resolved this with your help.

            arc_lat = lat1 - lat2;
            part1 = cos(lat1);
            part2 = long1-long2;
            arc_long = ECC*part1*part2;
            part1 = pow(arc_lat,2);
            part2 = pow(arc_long,2);
            return BETA * sqrt( part1+part2 );
    

    Without using pow() I could not get valid results for computing the hypotenuse...

Reply
  • Thanks all for the help, I believe I have resolved this with your help.

            arc_lat = lat1 - lat2;
            part1 = cos(lat1);
            part2 = long1-long2;
            arc_long = ECC*part1*part2;
            part1 = pow(arc_lat,2);
            part2 = pow(arc_long,2);
            return BETA * sqrt( part1+part2 );
    

    Without using pow() I could not get valid results for computing the hypotenuse...

Children