Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-28753

Create gen3 analysis_drp sky object sky plot

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      6
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      This ticket is the first of two which aim to replicate the two gen2 pipe_analysis plots created to help track sky objects: one plot showing the distribution of sky objects in tract/patch space (this ticket), and a second showing their recovered flux in two histograms (see referenced tickets below).

        Attachments

          Issue Links

            Activity

            Hide
            lskelvin Lee Kelvin added a comment - - edited

            After setting up the analysis_drp repo using setup -j -r analysis_drp, running the following command produces the figure attached to this ticket:

            pipetask --long-log run --register-dataset-types \
            -b /repo/main \
            -i HSC/runs/RC2/w_2021_30/DM-31182 \
            --output-run u/lskelvin/coaddQAPlots \
            -p $ANALYSIS_DRP_DIR/pipelines/coaddQAPlots.yaml \
            -d "skymap='hsc_rings_v1' AND instrument='HSC' AND tract=9615"
            

            (for reference, the pipe_analysis gen2 version of this figure is also attached).

            Show
            lskelvin Lee Kelvin added a comment - - edited After setting up the analysis_drp repo using setup -j -r analysis_drp , running the following command produces the figure attached to this ticket: pipetask --long-log run --register-dataset-types \ -b /repo/main \ -i HSC/runs/RC2/w_2021_30/DM-31182 \ --output-run u/lskelvin/coaddQAPlots \ -p $ANALYSIS_DRP_DIR/pipelines/coaddQAPlots.yaml \ -d "skymap='hsc_rings_v1' AND instrument='HSC' AND tract=9615" (for reference, the pipe_analysis gen2 version of this figure is also attached).
            Hide
            lskelvin Lee Kelvin added a comment -
            Show
            lskelvin Lee Kelvin added a comment - GitHub pull request here .
            Hide
            csaunder Clare Saunders added a comment -

            The actual values in the plots seem pretty different--is this because there are still differences in the backgrounds in the Gen2 and Gen3 processing?

            Show
            csaunder Clare Saunders added a comment - The actual values in the plots seem pretty different--is this because there are still differences in the backgrounds in the Gen2 and Gen3 processing?
            Hide
            lskelvin Lee Kelvin added a comment -

            Ah yes, thank you for bringing that up. The gen2 plots were scaled into 'human-readable' units by arbitrarily scaling them up by a factor of 10^12 (referenced in the color bar label). The gen3 plots use the more physically motivated nanojanskys, in agreement with DPDD recommendations. Other than that, the two plots above do differ as you suggest also, with the gen2 figure originating from an older build of the stack before a number of changes had been made to data processing (such as switching on Scarlet, for example).

            Show
            lskelvin Lee Kelvin added a comment - Ah yes, thank you for bringing that up. The gen2 plots were scaled into 'human-readable' units by arbitrarily scaling them up by a factor of 10^12 (referenced in the color bar label). The gen3 plots use the more physically motivated nanojanskys, in agreement with DPDD recommendations. Other than that, the two plots above do differ as you suggest also, with the gen2 figure originating from an older build of the stack before a number of changes had been made to data processing (such as switching on Scarlet, for example).
            Hide
            csaunder Clare Saunders added a comment -

            Ok, thanks for the explanation, plus the responses to my questions on the pull request. Looks good to go ahead!

            Show
            csaunder Clare Saunders added a comment - Ok, thanks for the explanation, plus the responses to my questions on the pull request. Looks good to go ahead!
            Hide
            lskelvin Lee Kelvin added a comment -

            Thanks Clare. Branch merged and deleted!

            Show
            lskelvin Lee Kelvin added a comment - Thanks Clare. Branch merged and deleted!

              People

              Assignee:
              lskelvin Lee Kelvin
              Reporter:
              lskelvin Lee Kelvin
              Reviewers:
              Clare Saunders
              Watchers:
              Clare Saunders, Lee Kelvin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.