Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12038

Update pipe_analysis to provide inputs for Bokeh based QA system

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_analysis
    • Labels:
      None
    • Story Points:
      2
    • Epic Link:
    • Sprint:
      DRP F17-4, DRP F17-5, DRP F17-6
    • Team:
      Data Release Production

      Description

      Together with Lauren MacArthur, ensure that the pipe_analysis scripts efficiently & effectively dump all the information that Tim's plotting scripts need to Parquet files without wasting time generating redundant plots or stripping out useful data.

        Attachments

          Issue Links

            Activity

            Hide
            lauren Lauren MacArthur added a comment - - edited

            PR made, thanks for the reminder! And just did a quick fixup/rebase (forgot to update the colorAnalysis script again!)

            Show
            lauren Lauren MacArthur added a comment - - edited PR made, thanks for the reminder! And just did a quick fixup/rebase (forgot to update the colorAnalysis script again!)
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            Left a few comments in a GH review; main thing is I'd suggest to get rid of the exact code duplication in the makeBadArray methods, so in the future if you want to change this, you don't have to remember to change in two places.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - Left a few comments in a GH review; main thing is I'd suggest to get rid of the exact code duplication in the makeBadArray methods, so in the future if you want to change this, you don't have to remember to change in two places.
            Hide
            lauren Lauren MacArthur added a comment -

            I've addressed your comments and, as per our discussion today, I've added a ccdId column to the visit-level catalogs and a patchId column to the coadd-level catalogs for use in your interactive analysis. Please let me know if all looks as it should.

            Show
            lauren Lauren MacArthur added a comment - I've addressed your comments and, as per our discussion today, I've added a ccdId column to the visit-level catalogs and a patchId column to the coadd-level catalogs for use in your interactive analysis. Please let me know if all looks as it should.
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            Looks good; I'm just trying to run this to test but am currently hampered by not being able to build meas_mosaic...

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - Looks good; I'm just trying to run this to test but am currently hampered by not being able to build meas_mosaic ...
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            OK, looks good!

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - OK, looks good!

              People

              Assignee:
              lauren Lauren MacArthur
              Reporter:
              swinbank John Swinbank
              Reviewers:
              Tim Morton [X] (Inactive)
              Watchers:
              John Swinbank, Lauren MacArthur, Tim Morton [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.