Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-204

Move all config and tract/patch dataset definitions to base CameraMapper

    XMLWordPrintable

    Details

    • Type: RFC
    • Status: Implemented
    • Resolution: Done
    • Component/s: DM
    • Labels:
      None

      Description

      We now have the option to define mapper datasets that are the same for all cameras in a common location (the config files for the base class CameraMapper). I propose that we go ahead and do this for all common datasets - essentially anything that doesn't depend on the keys of the raw data ID - now. This will massively reduce code duplication in the mapper files, and reduce our dependence on paf files (since we'll be moving to the new YAML-ish format).

      There are two possible hangups:

      • We probably need to resolve DM-6858 first (we currently compare the list of centrally-defined datasets against a list hard-coded into the test).
      • This will change the location of some data products for at least some cameras. I think this is a good thing in the long run, as there's no reason for different cameras to put common datasets in different locations, but this opinion may not be unanimous, and it may cause some backwards compatibility problems. If these are important, I suggest we define additional backwards compability mappers that do not move these datasets for a transitional period. The good news is that a preliminary look suggests that most of our mappers already define things consistently; obs_sdss may be the only one that uses different conventions for coadd datasets.

      I do not have anyone already signed up to do this work (I'm hoping to get by on the kindness of TCAMs), but this really shouldn't be more than a couple of days - there are a lot of lines to move and reformat, but it's dead simple.

      I do believe doing this sooner rather than later (and in particular not waiting on the dynamic dataset definition feature) will make Science Pipelines developers' lives easier, and I think it may be helpful to Nate Pease [X] in adding support for compound datasets as well.

        Attachments

          Issue Links

            Activity

            Hide
            jbosch Jim Bosch added a comment -

            Implementation issue is DM-7049, which will only make strictly backwards-compatible changes. It will also spawn new per-camera issues for non-backwards-compatible standardization.

            Show
            jbosch Jim Bosch added a comment - Implementation issue is DM-7049 , which will only make strictly backwards-compatible changes. It will also spawn new per-camera issues for non-backwards-compatible standardization.
            Hide
            tjenness Tim Jenness added a comment -

            Now that DM-7049 has been completed, is this RFC now complete and ready to be marked Implemented?

            Show
            tjenness Tim Jenness added a comment - Now that DM-7049 has been completed, is this RFC now complete and ready to be marked Implemented?
            Hide
            jbosch Jim Bosch added a comment -

            Added another implementation ticket, DM-7677.

            Show
            jbosch Jim Bosch added a comment - Added another implementation ticket, DM-7677 .
            Hide
            tjenness Tim Jenness added a comment -

            Jim Bosch is this RFC now implemented?

            Show
            tjenness Tim Jenness added a comment - Jim Bosch is this RFC now implemented?
            Hide
            jbosch Jim Bosch added a comment -

            Yes, marked as such.

            Show
            jbosch Jim Bosch added a comment - Yes, marked as such.

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Jim Bosch, John Swinbank, Paul Price, Robert Lupton, Russell Owen, Tim Jenness, Xiuqin Wu [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Planned End:

                  Jenkins

                  No builds found.