Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21335

Create a prepareQADashboard.py task

    XMLWordPrintable

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      8
    • Team:
      Data Release Production

      Description

      The QA dashboard is currently doing some data reshaping and additional computations upon load in order to get all the data it uses to have the format and content it needs. In addition, it expects to be able to read a metadata file specifying which columns need to be visualized. Make a new task that does all this required preparation so that the dashboard can load quicker.

        Attachments

          Issue Links

          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23824 Make a new test dataset for QA dashboard based on XMM-LSS field

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23567 Organize faro metrics into a tidy dataset

          • Won't Fix

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            tmorton Tim Morton [X] (Inactive) added a comment -

            Issue tracker on GitHub for this:

            https://github.com/Quansight/lsst_dashboard/issues/54

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - Issue tracker on GitHub for this: https://github.com/Quansight/lsst_dashboard/issues/54
            Hide
            Permalink
            tmorton Tim Morton [X] (Inactive) added a comment -

            Just to update progress here, during the next push with Quansight, I will be working with them to make sure the data prepared by this task is optimally configured/partitioned for best performance on the dashboard as we scale to larger datasets. In addition, in consultation with Jeffrey Carlin, I plan to add some validate_drp metric-collection action, to enable interactive visualization of those as well.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - Just to update progress here, during the next push with Quansight, I will be working with them to make sure the data prepared by this task is optimally configured/partitioned for best performance on the dashboard as we scale to larger datasets. In addition, in consultation with Jeffrey Carlin , I plan to add some validate_drp metric-collection action, to enable interactive visualization of those as well.

              People

              Assignee:
              tmorton Tim Morton [X] (Inactive)
              Reporter:
              tmorton Tim Morton [X] (Inactive)
              Watchers:
              John Swinbank, Tim Morton [X] (Inactive), Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.