Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13990

Add support for different SkyPix systems to Registry DataUnit schema

    XMLWordPrintable

    Details

    • Story Points:
      8
    • Sprint:
      BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10, BG3_F18_11, BG3_S19_01
    • Team:
      Data Release Production

      Description

      Gen2 repositories already have SkyPix datasets (reference catalogs) that use possibly-different levels of HTM.  That'll be tricky to support with our (probably naive) plan to have a single SkyPix pixelization and level in each Registry.  Come up with a design that solves that problem, and at least think about whether HiPS/MOC datasets pose a similar problem (they probably do).

      Options include:

      • RFC rewriting reference catalogs to a common level.
      • Have a common level for all join tables, but allow Datasets to use other levels (with either another join table or an in-database function to relate them).

      We also need to think about how to deal with HTM vs. HEALPix; we need support for HTM for reference catalogs now (and already have the necessary low-level code in sphgeom), but we know we'll need to do HEALPix in the future.  That will probably require adding HEALPix to sphgeom (backed by third-party HEALPix libraries, but still not trivial), which we'd rather not do now (not part of this ticket).  But once HEALPix is available, do we do a big-bang switch to it and drop HTM, or do we design a system that permits both to exist within the same registry?

      Outputs: write up a proposed design (Confluence or DMTN), and RFC it.

        Attachments

          Issue Links

            Activity

            No builds found.
            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Epic Link DM-12738 [ 36337 ]
            jbosch Jim Bosch made changes -
            Rank Ranked higher
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04 [ 704 ] BG3_S18_04, BG3_S18_05 [ 704, 728 ]
            vaikunth Vaikunth Thukral made changes -
            Risk Score 0
            fritzm Fritz Mueller made changes -
            Sprint BG3_S18_04, BG3_S18_05 [ 704, 728 ] BG3_S18_04, BG3_S18_05, BG3_F18_06 [ 704, 728, 745 ]
            swinbank John Swinbank made changes -
            Epic Link DM-12738 [ 36337 ] DM-14448 [ 80390 ]
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04, BG3_S18_05, BG3_F18_06 [ 704, 728, 745 ] BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07 [ 704, 728, 745, 759 ]
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07 [ 704, 728, 745, 759 ] BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08 [ 704, 728, 745, 759, 772 ]
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08 [ 704, 728, 745, 759, 772 ] BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09 [ 704, 728, 745, 759, 772, 779 ]
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09 [ 704, 728, 745, 759, 772, 779 ] BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10 [ 704, 728, 745, 759, 772, 779, 797 ]
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10 [ 704, 728, 745, 759, 772, 779, 797 ] BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10, BG3_F18_11 [ 704, 728, 745, 759, 772, 779, 797, 812 ]
            Hide
            jbosch Jim Bosch added a comment -

            As part of this ticket, we should define some named constants to avoid special "SkyPix" or "skypix" string literals in the Registry classes.

            Show
            jbosch Jim Bosch added a comment - As part of this ticket, we should define some named constants to avoid special "SkyPix" or "skypix" string literals in the Registry classes.
            yusra Yusra AlSayyad made changes -
            Epic Link DM-14448 [ 80390 ] DM-16675 [ 235235 ]
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10, BG3_F18_11 [ 704, 728, 745, 759, 772, 779, 797, 812 ] BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10, BG3_F18_11, BG3_S19_01 [ 704, 728, 745, 759, 772, 779, 797, 812, 850 ]
            vaikunth Vaikunth Thukral made changes -
            Sprint BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10, BG3_F18_11, BG3_S19_01 [ 704, 728, 745, 759, 772, 779, 797, 812, 850 ] BG3_S18_04, BG3_S18_05, BG3_F18_06, BG3_F18_07, BG3_F18_08, BG3_F18_09, BG3_F18_10, BG3_F18_11, BG3_S19_01, BG3_S19_02 [ 704, 728, 745, 759, 772, 779, 797, 812, 850, 857 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-16675 [ 235235 ] DM-16771 [ 235477 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-16771 [ 235477 ] DM-20166 [ 323037 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-20166 [ 323037 ] DM-21254 [ 414685 ]
            Hide
            jbosch Jim Bosch added a comment -

            This was done on DM-17023; different skypix systems are now different dimensions.

            Show
            jbosch Jim Bosch added a comment - This was done on DM-17023 ; different skypix systems are now different dimensions.
            jbosch Jim Bosch made changes -
            Link This issue is contained by DM-17023 [ DM-17023 ]
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status To Do [ 10001 ] Invalid [ 11005 ]
            fritzm Fritz Mueller made changes -
            Rank Ranked higher

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Jim Bosch
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins Builds

                  No builds found.