Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33946

Configure basic healpix support in butler data repositories

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Team:
      Architecture
    • Urgent?:
      No

      Description

      To configure basic butler support for HEALPix, allowing reference catalogs and other prerequisite inputs to use HEALPix dimensions in the same way we currently support HTM, we just need to update the dimensions configuration by adding the following

      skypix:
        healpix:
          class: lsst.sphgeom.HealpixPixelization
          max_level: 17
      

      (leaving all other entries under the "skypix" heading as-is.

      I don't think this change alone should actually affect the SQL schema, but our versioning logic knows that dimension configuration changes could affect the schema so I think it's best to treat it as a migration that happens to do nothing.

        Attachments

          Issue Links

            Activity

            Hide
            jbosch Jim Bosch added a comment -

            Tim Jenness, according to DM-33734 importing healpy here is unexpectedly slow. We should probably move HealpixPixelization to a module that isn't imported by default and update the fully-qualified class name in the dimensions config accordingly before we bake that class name in anywhere, to avoid paying that price when we don't need to.

            Show
            jbosch Jim Bosch added a comment - Tim Jenness , according to DM-33734 importing healpy here is unexpectedly slow. We should probably move HealpixPixelization to a module that isn't imported by default and update the fully-qualified class name in the dimensions config accordingly before we bake that class name in anywhere, to avoid paying that price when we don't need to.
            Hide
            tjenness Tim Jenness added a comment -

            We presumably could leave it in sphgeom but stop importing it into the init script.

            Show
            tjenness Tim Jenness added a comment - We presumably could leave it in sphgeom but stop importing it into the init script.
            Hide
            jbosch Jim Bosch added a comment -

            Yes, that's exactly what I was thinking.

            Show
            jbosch Jim Bosch added a comment - Yes, that's exactly what I was thinking.
            Hide
            tjenness Tim Jenness added a comment -

            I've made a standalone change to define the healpix dimension but it needed me to add namespace support to the dimensions.yaml because otherwise it clashes with the test dimensions in pipe_base and ctrl_mpexec.

            Show
            tjenness Tim Jenness added a comment - I've made a standalone change to define the healpix dimension but it needed me to add namespace support to the dimensions.yaml because otherwise it clashes with the test dimensions in pipe_base and ctrl_mpexec.
            Hide
            jbosch Jim Bosch added a comment -

            Looks good, no comments at all.

            Show
            jbosch Jim Bosch added a comment - Looks good, no comments at all.
            Hide
            tjenness Tim Jenness added a comment -

            Build worked locally (and worked as part of the other branch on Jenkins last week) so I will merge.

            Show
            tjenness Tim Jenness added a comment - Build worked locally (and worked as part of the other branch on Jenkins last week) so I will merge.
            Hide
            tjenness Tim Jenness added a comment -

            Tatiana Goldina with this change we now support a "namespace" field in the dimensions.yaml – you should add it to your local dimensions.yaml so that in the future it will be possible for one python process to access a SPHEREx repo and a LSST repo without getting a confusion of universes.

            Show
            tjenness Tim Jenness added a comment - Tatiana Goldina with this change we now support a "namespace" field in the dimensions.yaml – you should add it to your local dimensions.yaml so that in the future it will be possible for one python process to access a SPHEREx repo and a LSST repo without getting a confusion of universes.

              People

              Assignee:
              tjenness Tim Jenness
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Jim Bosch
              Watchers:
              Eli Rykoff, Jim Bosch, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.