Repository navigation
Improve AltAz to RaDec accuracy tests - #3296
Conversation
There was a problem hiding this comment.
Anyone has an idea what the origin of the 31 arcsec difference is?
I'm not sure what the humidity and wavelength is for the PyEphem result ... that might be it.
And this is a rather extreme example at 30 km.
I'll now try and fix the other examples.
There was a problem hiding this comment.
@cdeil - can you make a plot of the offset for many different inputs to see if it is always in the same direction, or always around 31 arcsec? I.e. is it systematic?
There was a problem hiding this comment.
I'll do that over in coordinates-benchmarks ...
|
@cdeil - is this good to merge for now, and we can update later if we can get a better accuracy? |
|
No, there's still a bunch of skipped tests that I want to fix ... I'll finish this today, OK? |
|
@cdeil - sounds good! |
320ef64 to
ed3378e
Compare
|
@astrofrog - I'm afraid understanding the discrepancies here and the work on There's one test here, If someone else has time to try to try to find these errors and debug these tests, great! But if not, I think it would be OK to merge this as-is and continue with the precision checks over in |
|
I looked at the wrong assert, the difference against the |
There was a problem hiding this comment.
In the example .pro file, it is 10 PM local time, while you enter a UT. It should be '2041-12-26 06:00:00'.
There was a problem hiding this comment.
But I need to use '2041-12-26 05:00:00' to get the right answer...
There was a problem hiding this comment.
Thanks for finding this bug ... fixed.
|
@cdeil - it seems I at least found the reason for the egregious difference with the idl routine. But I find it rather worrying that the other results are so far off -- this kind of stuff should be good to an arcsec or so... |
|
Is it going to be something related to leap seconds? If the 30 arcsecond shift is always systematic it could be a 2s difference in the time (easily done with a couple of leap seconds). I think it's important to figure out if the differences are systematic or random for this reason. |
ed3378e to
5e5514c
Compare
|
I've updated this PR with the fixes pointed out by @mhvk . I'll try to find time tomorrow to add some more extensive tests to |
|
@cdeil is the 2.6285" error systematic or just the largest error you found? |
|
@astrofrog - I have not done any systematic testing ... I will start this in |
|
@cdeil - would you like us to merge this now, or do you want to wait for the systematic testing? This is already a lot better than what's in the core, but if you think it could get better in the next few days I can hold off from merging. |
|
Might as well wait a few days then in case I or someone else finds more issues / improved understanding with these numbers ... of course don't let this hold up the 1.0 branching. :-) |
|
prompted by @astrofrog's comment, I went and tracked down where pyephem gets its leap seconds from: it appears to be a hard-coded table that ends in 2011... So anything after that might by wrong in pyephem. |
|
An update on some of this: as an independent check I've written my own tests to compare against pyephem, pytpm, ho2eq/eq2hor, and a c routine that uses erfa (which really ought to be the same because most of astropy uses that directly or indirectly). After much struggling to try to convince them all to not do atmospheric refraction (because the models there are all quite different), I'm now getting them to match astropy to ~2 arcsec (with the exception of eq2hor ... but it doesn't even match hor2eq, so I'm not so worried that it's the only outlier...). What I've done all requires external packages, though, of course (along the lines of the benchmark repo, but much hackier). So probably it shouldn't be added here. But it gives me much more confidence that the situation is pretty much ok. |
|
@eteq - Would you be OK to merge this now? I think it's an improvement over what's in And would you mind sharing your test scripts somewhere on Github and make a new issue in |
|
@cdeil - yeah, I will give it one last look and then merge it. The tests I did are in https://github.com/eteq/astropy_astrometry_tests - that includes data files so all the comparisons should be possible even if you don't have IDL or want to bother with compiling against ERFA. Also, I found a newer version of |
|
I'll go ahead and merge this, but I'm going to issue another PR that builds on it some. It's not necessarily RC critical, but will be good to have in before the actual release. |
Improve AltAz to RaDec accuracy tests
Implements #3244
cc @astrofrog @eteq