Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27237

Write characterization report for 21.0.0 Science Pipelines release

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Team:
      DM Science
    • Urgent?:
      No

      Attachments

        Issue Links

          Activity

          No builds found.
          gcomoretto Gabriele Comoretto [X] (Inactive) created issue -
          gcomoretto Gabriele Comoretto [X] (Inactive) made changes -
          Field Original Value New Value
          Link This issue is triggered by DM-22815 [ DM-22815 ]
          gcomoretto Gabriele Comoretto [X] (Inactive) made changes -
          Link This issue is blocked by DM-27234 [ DM-27234 ]
          lguy Leanne Guy made changes -
          Watchers Gabriele Comoretto, Kian-Tat Lim, Leanne Guy [ Gabriele Comoretto, Kian-Tat Lim, Leanne Guy ] Gabriele Comoretto, Jeffrey Carlin, Kian-Tat Lim, Leanne Guy [ Gabriele Comoretto, Jeffrey Carlin, Kian-Tat Lim, Leanne Guy ]
          lguy Leanne Guy made changes -
          Assignee Jeffrey Carlin [ jcarlin ]
          gcomoretto Gabriele Comoretto [X] (Inactive) made changes -
          Team DM Science [ 12218 ]
          jcarlin Jeffrey Carlin made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          Hide
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment -

          I have created in Docushare the DMTR-281 placeholder for this characterization report

          Show
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment - I have created in Docushare the DMTR-281 placeholder for this characterization report
          Hide
          jcarlin Jeffrey Carlin added a comment -

          A complete draft of the report is at https://dmtr-281.lsst.io/v/DM-27237/index.html.

          Show
          jcarlin Jeffrey Carlin added a comment - A complete draft of the report is at https://dmtr-281.lsst.io/v/DM-27237/index.html .
          jcarlin Jeffrey Carlin made changes -
          Reviewers Leanne Guy [ lguy ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          Hide
          lguy Leanne Guy added a comment -

          A few comments:

          • The reference in the abstract to the previous release's CMR is not rendering: " can be found in [ ? ]"
          • Figure 1: The “regression” ... This isn't strictly speaking a regression but rather a difference in performance between 2 algorithms, jointcal and FGCM. I'd say: "The degraded performance in the photometry metrics after late June was due to the introduction of a new
            photometric calibration method known as FGCM, replacing Jointcal.
          • Figure11 : "... The metrics have continued to improve since the introduction of FGCM, but are still worse than previous results using jointcal"
          • Section 2: Dashboard summary of performance metrics – I would rename this section just "Summary of performance metrics" and provide a summary of notable metrics or changes, not just those for which we have a dashboard plot. The point is to summarize the performance for this releaser, not the dashboard. E.g. AM2: r and AF2: z show and ~ 20% improvement. What changed? Do keep the dashboard plot, it's very useful, just don't limit the summary discussion to those metrics in the dashboard.
          Show
          lguy Leanne Guy added a comment - A few comments: The reference in the abstract to the previous release's CMR is not rendering: " can be found in [ ? ]" Figure 1: The “regression” ... This isn't strictly speaking a regression but rather a difference in performance between 2 algorithms, jointcal and FGCM. I'd say: "The degraded performance in the photometry metrics after late June was due to the introduction of a new photometric calibration method known as FGCM, replacing Jointcal. Figure11 : "... The metrics have continued to improve since the introduction of FGCM, but are still worse than previous results using jointcal " Section 2: Dashboard summary of performance metrics – I would rename this section just "Summary of performance metrics" and provide a summary of notable metrics or changes, not just those for which we have a dashboard plot. The point is to summarize the performance for this releaser, not the dashboard. E.g. AM2: r and AF2: z show and ~ 20% improvement. What changed? Do keep the dashboard plot, it's very useful, just don't limit the summary discussion to those metrics in the dashboard.
          Hide
          lguy Leanne Guy added a comment - - edited

          Once comments are addressed, this is good to go. No issues blocking release.

          Show
          lguy Leanne Guy added a comment - - edited Once comments are addressed, this is good to go. No issues blocking release.
          lguy Leanne Guy made changes -
          Status In Review [ 10004 ] Reviewed [ 10101 ]
          jcarlin Jeffrey Carlin made changes -
          Resolution Done [ 10000 ]
          Status Reviewed [ 10101 ] Done [ 10002 ]
          Hide
          jcarlin Jeffrey Carlin added a comment -

          Final version is in docushare at this link

          Show
          jcarlin Jeffrey Carlin added a comment - Final version is in docushare at this link

            People

            Assignee:
            jcarlin Jeffrey Carlin
            Reporter:
            gcomoretto Gabriele Comoretto [X] (Inactive)
            Reviewers:
            Leanne Guy
            Watchers:
            Gabriele Comoretto [X] (Inactive), Jeffrey Carlin, Kian-Tat Lim, Leanne Guy
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins Builds

                No builds found.