Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24277

Apply proper motion and parallax while loading refcats in Jointcal

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: jointcal
    • Labels:
      None
    • Story Points:
      8
    • Sprint:
      AP S20-5 (April), AP S20-6 (May), AP F20-1 (June), AP F20-2 (July)
    • Team:
      Alert Production
    • Urgent?:
      No

      Description

      There's existing code in the stack to apply proper motions and parallaxes from the reference catalog. Find it, dust it off, and get it going in Jointcal. It may require some modification. If it requires substantial overhauls (e.g. rewriting completely because it's too slow), let's make a new ticket to capture that.

      For now, we will correct the reference catalog to the mean epoch of the loaded data.

        Attachments

          Issue Links

            Activity

            Hide
            swinbank John Swinbank added a comment -

            Question arises: is the mean actually the best date to use? Is there another date which will minimize the parallax-contributed error?

            On this ticket, regard that as out of scope (but feel free to think about it); but make it possible to parameterize what date is used.

            Show
            swinbank John Swinbank added a comment - Question arises: is the mean actually the best date to use? Is there another date which will minimize the parallax-contributed error? On this ticket, regard that as out of scope (but feel free to think about it); but make it possible to parameterize what date is used.
            Hide
            cwalter Chris Walter added a comment -

            Just as a heads up:  since these features weren't ready when we were designing DC2, they were turned off there. They were actually on in DC1 which is how we found out they weren't supported .

             

            So, probably good to have application be a config option turned on by default but possible to turn off.

            Show
            cwalter Chris Walter added a comment - Just as a heads up:  since these features weren't ready when we were designing DC2, they were turned off there. They were actually on in DC1 which is how we found out they weren't supported .   So, probably good to have application be a config option turned on by default but possible to turn off.
            Show
            Parejkoj John Parejko added a comment - - edited Jenkins run: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/32206/pipeline
            Hide
            Parejkoj John Parejko added a comment -

            Paul Price: are you able to do this medium sized review?

            As implemented, the code uses the mean of the dates in the data, which might not be ideal but I think the bigger step will be DM-24278 which will shift all of the internal positions by known PM values. That should make the question of mean/median/mode/whatever mostly irrelevant.

            Also note that we do not have code to compute the parallax corrections in the stack right now: the refcat loader only does proper motion corrections. My meas_algorithms branch cleans up some docstrings related to that. I don't know if implementing refcat parallax corrections in meas_algorithms should be part of this ticket, or on a separate ticket.

            Show
            Parejkoj John Parejko added a comment - Paul Price : are you able to do this medium sized review? As implemented, the code uses the mean of the dates in the data, which might not be ideal but I think the bigger step will be DM-24278 which will shift all of the internal positions by known PM values. That should make the question of mean/median/mode/whatever mostly irrelevant. Also note that we do not have code to compute the parallax corrections in the stack right now: the refcat loader only does proper motion corrections. My meas_algorithms branch cleans up some docstrings related to that. I don't know if implementing refcat parallax corrections in meas_algorithms should be part of this ticket, or on a separate ticket.
            Hide
            price Paul Price added a comment -

            Code looks good.

            Can you confirm that proper motion correction can be disabled via config parameters, and that we fail over smoothly if there are no proper motion columns in the catalog?

            Show
            price Paul Price added a comment - Code looks good. Can you confirm that proper motion correction can be disabled via config parameters, and that we fail over smoothly if there are no proper motion columns in the catalog?
            Hide
            Parejkoj John Parejko added a comment -

            Question answered on github: proper motions are now always applied if available and the default is to fail with an error if they are not. That can be changed by setting astrometryRefObjLoader.requireProperMotion=False, which will allow astrometry to run without PM corrections.

            I ran a tract of HSC RC2 successfully with this new code, so it looks like it's fine for HSC. However, doing so led me to discover that the logic for requireProperMotion in meas_algorithms is not robust: if the refcat has a pm_ra field but it is not an Angle, then you'll just receive a warning instead of a failure if that config is True. I've filed DM-25807 about this issue.

            Show
            Parejkoj John Parejko added a comment - Question answered on github: proper motions are now always applied if available and the default is to fail with an error if they are not. That can be changed by setting astrometryRefObjLoader.requireProperMotion=False , which will allow astrometry to run without PM corrections. I ran a tract of HSC RC2 successfully with this new code, so it looks like it's fine for HSC. However, doing so led me to discover that the logic for requireProperMotion in meas_algorithms is not robust: if the refcat has a pm_ra field but it is not an Angle, then you'll just receive a warning instead of a failure if that config is True . I've filed DM-25807 about this issue.

              People

              Assignee:
              Parejkoj John Parejko
              Reporter:
              swinbank John Swinbank
              Reviewers:
              Paul Price
              Watchers:
              Chris Walter, Jim Bosch, John Parejko, John Swinbank, Paul Price
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.