Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21461

Generate quantum graph for HSC-RC2

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Tests related to generating quantum graph pickle files based on a HSC-RC2 registry on AWS-RDS.

        Attachments

          Activity

          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          In attempting this, slowness was observed with the RDS instance initially. A larger RDS instance or applying the known indices from June/July milestone run effort alone were not enough to lower the qgraph generation to a reasonable time. Dino traced down the slowness.  Extra indices and views were added. Moved views to materialized views. 

          Show
          hchiang2 Hsin-Fang Chiang added a comment - In attempting this, slowness was observed with the RDS instance initially. A larger RDS instance or applying the known indices from June/July milestone run effort alone were not enough to lower the qgraph generation to a reasonable time. Dino traced down the slowness.  Extra indices and views were added. Moved views to materialized views. 
          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          For generating the qgraph pickle, configurations from https://github.com/lsst-dm/gen3-hsc-rc2.git were used

          For tract=9615, ignore the patches that are known to fail. In other words,
          -d "tract=9615 and patch!=28 and patch!=72"

          Also skipped ForcedPhotCcdTask which isn't Gen3 ready.

          Show
          hchiang2 Hsin-Fang Chiang added a comment - For generating the qgraph pickle, configurations from https://github.com/lsst-dm/gen3-hsc-rc2.git were used For tract=9615, ignore the patches that are known to fail. In other words, -d "tract=9615 and patch!=28 and patch!=72" Also skipped ForcedPhotCcdTask which isn't Gen3 ready.

            People

            Assignee:
            hchiang2 Hsin-Fang Chiang
            Reporter:
            hchiang2 Hsin-Fang Chiang
            Watchers:
            Hsin-Fang Chiang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.