Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33946

Configure basic healpix support in butler data repositories

    XMLWordPrintable

Details

    • 2
    • Architecture
    • No

    Description

      To configure basic butler support for HEALPix, allowing reference catalogs and other prerequisite inputs to use HEALPix dimensions in the same way we currently support HTM, we just need to update the dimensions configuration by adding the following

      skypix:
        healpix:
          class: lsst.sphgeom.HealpixPixelization
          max_level: 17
      

      (leaving all other entries under the "skypix" heading as-is.

      I don't think this change alone should actually affect the SQL schema, but our versioning logic knows that dimension configuration changes could affect the schema so I think it's best to treat it as a migration that happens to do nothing.

      Attachments

        Issue Links

          Activity

            jbosch Jim Bosch added a comment -

            tjenness, according to DM-33734 importing healpy here is unexpectedly slow. We should probably move HealpixPixelization to a module that isn't imported by default and update the fully-qualified class name in the dimensions config accordingly before we bake that class name in anywhere, to avoid paying that price when we don't need to.

            jbosch Jim Bosch added a comment - tjenness , according to DM-33734 importing healpy here is unexpectedly slow. We should probably move HealpixPixelization to a module that isn't imported by default and update the fully-qualified class name in the dimensions config accordingly before we bake that class name in anywhere, to avoid paying that price when we don't need to.
            tjenness Tim Jenness added a comment -

            We presumably could leave it in sphgeom but stop importing it into the init script.

            tjenness Tim Jenness added a comment - We presumably could leave it in sphgeom but stop importing it into the init script.
            jbosch Jim Bosch added a comment -

            Yes, that's exactly what I was thinking.

            jbosch Jim Bosch added a comment - Yes, that's exactly what I was thinking.
            tjenness Tim Jenness added a comment -

            I've made a standalone change to define the healpix dimension but it needed me to add namespace support to the dimensions.yaml because otherwise it clashes with the test dimensions in pipe_base and ctrl_mpexec.

            tjenness Tim Jenness added a comment - I've made a standalone change to define the healpix dimension but it needed me to add namespace support to the dimensions.yaml because otherwise it clashes with the test dimensions in pipe_base and ctrl_mpexec.
            jbosch Jim Bosch added a comment -

            Looks good, no comments at all.

            jbosch Jim Bosch added a comment - Looks good, no comments at all.
            tjenness Tim Jenness added a comment -

            Build worked locally (and worked as part of the other branch on Jenkins last week) so I will merge.

            tjenness Tim Jenness added a comment - Build worked locally (and worked as part of the other branch on Jenkins last week) so I will merge.
            tjenness Tim Jenness added a comment -

            tatianag with this change we now support a "namespace" field in the dimensions.yaml – you should add it to your local dimensions.yaml so that in the future it will be possible for one python process to access a SPHEREx repo and a LSST repo without getting a confusion of universes.

            tjenness Tim Jenness added a comment - tatianag with this change we now support a "namespace" field in the dimensions.yaml – you should add it to your local dimensions.yaml so that in the future it will be possible for one python process to access a SPHEREx repo and a LSST repo without getting a confusion of universes.

            People

              tjenness Tim Jenness
              jbosch Jim Bosch
              Jim Bosch
              Eli Rykoff, Jim Bosch, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.