Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13080

Add reference band flags used for forced coadd measurements to persisted parquet tables

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_analysis
    • Labels:
      None
    • Story Points:
      2
    • Epic Link:
    • Sprint:
      DRP S18-1
    • Team:
      Data Release Production

      Description

      It is very useful for qa/debugging to know which band was used as the reference band for the measurements in forced photometry on the coadds. These are currently only persisted in the deepCoadd_ref output file, so will need to read these in and add the appropriate columns to the parquet tables.

        Attachments

          Issue Links

            Activity

            Hide
            lauren Lauren MacArthur added a comment -

            Tim, would you mind having a look to make sure the correct columns have been added to the forced coadd catalog parquet tables? I am running off this branch on the soon-to-be RC2 dataset (DM-11345) and am persisting the parquet tables, so you should be able to look at the following if you don't want to do a run yourself:

            /datasets/hsc/repo/rerun/private/lauren/DM-11345/WIDE_VVDS_9697/plots/
            /datasets/hsc/repo/rerun/private/lauren/DM-11345/WIDE_GAMA15H_9615/plots/
            

            Show
            lauren Lauren MacArthur added a comment - Tim, would you mind having a look to make sure the correct columns have been added to the forced coadd catalog parquet tables? I am running off this branch on the soon-to-be RC2 dataset ( DM-11345 ) and am persisting the parquet tables, so you should be able to look at the following if you don't want to do a run yourself: /datasets/hsc/repo/rerun/private/lauren/DM-11345/WIDE_VVDS_9697/plots/ /datasets/hsc/repo/rerun/private/lauren/DM-11345/WIDE_GAMA15H_9615/plots/
            Hide
            lauren Lauren MacArthur added a comment -

            Oh, and note that I am now making forced and unforced magnitude comparison plots for the coadds, so their names now have either _forced or _unforced in them (in case any of your notebooks/scripts depend on the exact filenames).

            Show
            lauren Lauren MacArthur added a comment - Oh, and note that I am now making forced and unforced magnitude comparison plots for the coadds, so their names now have either _forced or _unforced in them (in case any of your notebooks/scripts depend on the exact filenames).
            Hide
            tmorton Tim Morton added a comment -

            Thanks! As soon as I can update my convenience RC-loading functions to RC2, I'll check this out. If I can't finish this morning, I'll get to it as soon as I can (I'm mostly off the rest of the week).

            Show
            tmorton Tim Morton added a comment - Thanks! As soon as I can update my convenience RC-loading functions to RC2, I'll check this out. If I can't finish this morning, I'll get to it as soon as I can (I'm mostly off the rest of the week).
            Hide
            tmorton Tim Morton added a comment -

            Beautiful! This answers our question about the gauss-psf mags. See attached screenshot movie.

            Show
            tmorton Tim Morton added a comment - Beautiful! This answers our question about the gauss-psf mags. See attached screenshot movie.
            Hide
            lauren Lauren MacArthur added a comment -

            Thanks Tim. I took the opportunity to do a bit more cleanup (most notably fixing the plotting limits that had some of our mag comparison plots going off scale, updating flag culling for the ellipticity residual quiver plots, and updating some highlighting for better visibility).

            Show
            lauren Lauren MacArthur added a comment - Thanks Tim. I took the opportunity to do a bit more cleanup (most notably fixing the plotting limits that had some of our mag comparison plots going off scale, updating flag culling for the ellipticity residual quiver plots, and updating some highlighting for better visibility).

              People

              • Assignee:
                lauren Lauren MacArthur
                Reporter:
                lauren Lauren MacArthur
                Reviewers:
                Tim Morton
                Watchers:
                John Swinbank, Lauren MacArthur, Tim Morton
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel