Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-30054

Generalize fgcmLoadReferenceCatalog for broader use.

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: fgcmcal, meas_algorithms
    • Labels:
      None

      Description

      The task FgcmLoadReferenceCatalogTask is a layer on top of LoadIndexedReferenceObjectsTask that provides these additional features:

      • Loads multiple reference filters at once.
      • Integrated referenceSelector
      • Applies color terms (if configured)
      • Ability to select by healpix number (on top of loadSkyCircle)
      • Returns the catalog as a convenient numpy record array.

      After discussions with Keith Bechtol I realized that with modest modification this will be ideal for use in faro. This ticket will move this task from fgcmcal to meas_algorithms, rename everything to remove "fgcm" name references, and add additional features including the option to return pandas dataframes.

      This ticket does not solve the question of how to update the underlying LoadIndexedReferenceObjectsTask to be a better gen3 citizen.

        Attachments

          Issue Links

            Activity

            No builds found.
            erykoff Eli Rykoff created issue -
            kbechtol Keith Bechtol made changes -
            Field Original Value New Value
            Remote Link This issue links to "Page (Confluence)" [ 28430 ]
            erykoff Eli Rykoff made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            kbechtol Keith Bechtol made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28603 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-29154 [ 458511 ] DM-30473 [ 509199 ]
            lauren Lauren MacArthur made changes -
            Watchers Eli Rykoff, Keith Bechtol [ Eli Rykoff, Keith Bechtol ] Eli Rykoff, Keith Bechtol, Lauren MacArthur [ Eli Rykoff, Keith Bechtol, Lauren MacArthur ]
            erykoff Eli Rykoff made changes -
            Reviewers Lee Kelvin [ lskelvin ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            lguy Leanne Guy made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28800 ]
            Hide
            lskelvin Lee Kelvin added a comment -

            Thanks Eli, this is a very nicely written ticket, and I took away a lot from going through it. This ticket adds the LoadReferenceCatalogTask into meas_algorithms, implementing several useful features for general use. The unit tests are comprehensive, and very nicely written. I've added minor comments on GitHub which I hope are useful. Assuming Jenkins doesn't complain, then this looks good to merge to me.

            Show
            lskelvin Lee Kelvin added a comment - Thanks Eli, this is a very nicely written ticket, and I took away a lot from going through it. This ticket adds the LoadReferenceCatalogTask into meas_algorithms , implementing several useful features for general use. The unit tests are comprehensive, and very nicely written. I've added minor comments on GitHub which I hope are useful. Assuming Jenkins doesn't complain, then this looks good to merge to me.
            lskelvin Lee Kelvin made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            Show
            erykoff Eli Rykoff added a comment - Jenkins is green: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/34455/pipeline/
            erykoff Eli Rykoff made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            kbechtol Keith Bechtol made changes -
            Remote Link This issue links to "Page (Confluence)" [ 29161 ]
            lguy Leanne Guy made changes -
            Remote Link This issue links to "Page (Confluence)" [ 29161 ]
            lguy Leanne Guy made changes -
            Link This issue has to be done before DM-30732 [ DM-30732 ]

              People

              Assignee:
              erykoff Eli Rykoff
              Reporter:
              erykoff Eli Rykoff
              Reviewers:
              Lee Kelvin
              Watchers:
              Eli Rykoff, John Parejko, Keith Bechtol, Lauren MacArthur, Lee Kelvin
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.