Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10540

DPDD incorrectly defines "level 1" and "level 2"

    Details

      Description

      The DPDD tells us that "Level 1 data products are a result of difference image analysis" (§3.1), as opposed to "Level 2 data products [which] result from direct image analysis" (§4.1).

      However, this definition is incorrect. Per LSE-29 (which is the highest-level document in which I can find this defined), "Level 1 Data Products [are] the result of processing of the stream of image data from the Data Collection system during the course of normal observing" (LSR-REQ-0033), while "Level 2 Data Products [are] the result of periodic processing of the entire archive of raw image data from the Data Collection system" (LSR-REQ-0036).

      This isn't just mindless pedantry: I think there's an important distinction to be made here. A literal reading of the DPDD would suggest that level some 1 data products are generated during an annual data release, while some of the products of nightly processing (e.g. PVIs) are actually level 2. That's inconsistent with usage elsewhere, and I find it actively confusing. Can we fix it, please?

        Attachments

          Activity

          swinbank John Swinbank created issue -
          swinbank John Swinbank made changes -
          Field Original Value New Value
          Description The DPDD tells us that "Level 1 data products are a result of difference image analysis" (§3.1), as opposed to "Level 2 data products [which] result from direct image analysis" (§4.1).

          However, this definition is incorrect. Per LSE-29 (which is the highest-level document in which I can find this defined), "Level 1 Data Products [are] the result of processing of the stream of image data from the Data Collection system during the course of normal observing" (LSR-REQ-0033), while "Level 2 Data Products [are] the result of periodic processing of the entire archive of raw image data from the Data Collection system" (LSR-REQ-0036).

          This isn't just mindless pedantry: I think there's an important distinction to be made here. A literal reading of the DPDD would suggest that level 1 data products are generated during an annual data release, while some of the products of nightly processing (e.g. PVIs) are actually level 2. That's inconsistent with usage elsewhere, and I find it actively confusing. Can we fix it, please?
          The DPDD tells us that "Level 1 data products are a result of difference image analysis" (§3.1), as opposed to "Level 2 data products [which] result from direct image analysis" (§4.1).

          However, this definition is incorrect. Per LSE-29 (which is the highest-level document in which I can find this defined), "Level 1 Data Products [are] the result of processing of the stream of image data from the Data Collection system during the course of normal observing" (LSR-REQ-0033), while "Level 2 Data Products [are] the result of periodic processing of the entire archive of raw image data from the Data Collection system" (LSR-REQ-0036).

          This isn't just mindless pedantry: I think there's an important distinction to be made here. A literal reading of the DPDD would suggest that level some 1 data products are generated during an annual data release, while some of the products of nightly processing (e.g. PVIs) are actually level 2. That's inconsistent with usage elsewhere, and I find it actively confusing. Can we fix it, please?
          tjenness Tim Jenness made changes -
          Watchers John Swinbank, Tim Jenness [ John Swinbank, Tim Jenness ] Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Tim Jenness [ Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Tim Jenness ]
          mjuric Mario Juric made changes -
          Labels LSE-163 LSE-163 dm-sst
          mjuric Mario Juric made changes -
          Priority Undefined [ 10000 ] Minor [ 4 ]
          swinbank John Swinbank made changes -
          Team Project Science [ 11800 ] DM Science [ 12218 ]
          tjenness Tim Jenness made changes -
          Watchers Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Lynne Jones, Mario Juric, Tim Jenness [ Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Lynne Jones, Mario Juric, Tim Jenness ] Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Lynne Jones, Mario Juric, Tim Jenness, Wil O'Mullane [ Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Lynne Jones, Mario Juric, Tim Jenness, Wil O'Mullane ]
          mjuric Mario Juric made changes -
          Assignee Mario Juric [ mjuric ] Leanne Guy [ lguy ]
          mjuric Mario Juric made changes -
          Risk Score 0
          ctslater Colin Slater made changes -
          Risk Score 0 1
          lguy Leanne Guy made changes -
          Due Date 31/Aug/18
          lguy Leanne Guy made changes -
          Risk Score 1 0
          lguy Leanne Guy made changes -
          Component/s DM Subsystem Science [ 12208 ]
          Component/s Requirements Documents [ 12815 ]
          Component/s Design Documents [ 12816 ]
          lguy Leanne Guy made changes -
          Due Date 31/Aug/18 14/Sep/18
          ctslater Colin Slater made changes -
          Epic Link DM-20277 [ 333355 ]
          ctslater Colin Slater made changes -
          Assignee Leanne Guy [ lguy ] Colin Slater [ ctslater ]
          ctslater Colin Slater made changes -
          Reviewers John Swinbank [ swinbank ]
          Status To Do [ 10001 ] In Review [ 10004 ]
          swinbank John Swinbank made changes -
          Status In Review [ 10004 ] Reviewed [ 10101 ]
          ctslater Colin Slater made changes -
          Resolution Done [ 10000 ]
          Status Reviewed [ 10101 ] Done [ 10002 ]

            People

            • Assignee:
              ctslater Colin Slater
              Reporter:
              swinbank John Swinbank
              Reviewers:
              John Swinbank
              Watchers:
              Colin Slater, Eric Bellm, Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Leanne Guy, Lynne Jones, Tim Jenness, Wil O'Mullane
            • Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved:

                Summary Panel