Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-23109

gen3 metadata only use Task._DefaultName for output file

    Details

      Description

      The metadata output in gen3 always write to the same filename, which prevents multiple calls to the same task in a pipeline. If this respected the task label in the pipeline, or if the output name (like the lsst.pipe.base.connectionTypes.Output.name field) was settable, this would resolve this.

        Attachments

          Issue Links

            Activity

            Hide
            salnikov Andy Salnikov added a comment -

            Christopher Waters, if I recall it right we should be using task labels to construct metadata dataset names, this is the code that does that: https://github.com/lsst/pipe_base/blob/master/python/lsst/pipe/base/pipeline.py#L90-L98. There could be bugs in other places of course, can you give me some more info or maybe a way to reproduce what you see?

            Show
            salnikov Andy Salnikov added a comment - Christopher Waters , if I recall it right we should be using task labels to construct metadata dataset names, this is the code that does that: https://github.com/lsst/pipe_base/blob/master/python/lsst/pipe/base/pipeline.py#L90-L98 . There could be bugs in other places of course, can you give me some more info or maybe a way to reproduce what you see?
            Hide
            czw Christopher Waters added a comment -

            Rerunning tests shows that what I thought was a problem was actually just me using labels too similar to the _DefaultName and confusing myself. Sorry for spreading that confusion.

            I'll mark this ticket invalid.

            Show
            czw Christopher Waters added a comment - Rerunning tests shows that what I thought was a problem was actually just me using labels too similar to the _DefaultName and confusing myself. Sorry for spreading that confusion. I'll mark this ticket invalid.

              People

              • Assignee:
                salnikov Andy Salnikov
                Reporter:
                czw Christopher Waters
                Watchers:
                Andy Salnikov, Christopher Waters
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: