Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-26407

Change how dimensions are stored in a Butler repository

    XMLWordPrintable

    Details

      Description

      Dimensions.yaml should be locked in and read-only as soon as the schema is created during the makeRepo phase. At the moment there is nothing stopping a repository from breaking if dimensions.yaml is updated in daf_butler and there is nothing stopping a user editing the config file after repository creation and breaking things.

      We propose to remove dimensions.yaml from ButlerConfig and have it as an explicit argument for makeRepo (defaulting to pkg://lsst.daf.butler/configs/dimensions.yaml) which will then ensure that the dimensions configuration is locked in for that repository.

      We will still require that it be possible to migrate a registry to a new dimensions definition but that migration should be by explicit request.

        Attachments

          Issue Links

            Activity

            tjenness Tim Jenness created issue -
            tjenness Tim Jenness made changes -
            Field Original Value New Value
            Remote Link This issue links to "Page (Confluence)" [ 25769 ]
            salnikov Andy Salnikov made changes -
            Assignee Andy Salnikov [ salnikov ]
            salnikov Andy Salnikov made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-27033 [ DM-27033 ]
            tjenness Tim Jenness made changes -
            Labels gen2-deprecation-blocker gen3-middleware gen2-deprecation-blocker gen3-middleware gen3-registry-incompatibility
            salnikov Andy Salnikov made changes -
            Reviewers Jim Bosch [ jbosch ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            jbosch Jim Bosch made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            salnikov Andy Salnikov made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            tjenness Tim Jenness made changes -
            Watchers Andy Salnikov, Jim Bosch, Michelle Gower, Tim Jenness [ Andy Salnikov, Jim Bosch, Michelle Gower, Tim Jenness ] Andy Salnikov, Jim Bosch, Kian-Tat Lim, Michelle Gower, Tim Jenness [ Andy Salnikov, Jim Bosch, Kian-Tat Lim, Michelle Gower, Tim Jenness ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-27256 [ DM-27256 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-27266 [ DM-27266 ]
            fritzm Fritz Mueller made changes -
            Epic Link DM-25244 [ 435560 ]

              People

              Assignee:
              salnikov Andy Salnikov
              Reporter:
              tjenness Tim Jenness
              Reviewers:
              Jim Bosch
              Watchers:
              Andy Salnikov, Jim Bosch, Kian-Tat Lim, Michelle Gower, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.