Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14256

Run validate_drp with w_2018_17 HSC RC2 outputs

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Run matchedVisitMetrics.py validateDrp.py and reportPerformance.py with the HSC RC2 w_2018_17 outputs from DM-14055.

        Attachments

          Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. DM-14257 matchedVisitMetrics.py is broken

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-14055 Reprocess RC2 with w_2018_17

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            Tried running this with w_2018_17 and found out that matchedVisitMetrics.py has been broken since w_2018_16. I've filed DM-14257.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Tried running this with w_2018_17 and found out that matchedVisitMetrics.py has been broken since w_2018_16 . I've filed DM-14257 .
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            Using the fix in DM-14257, the tickets/DM-14257 branch of validate_drp at commit 9aadba7 was then used.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Using the fix in DM-14257 , the tickets/ DM-14257 branch of validate_drp at commit 9aadba7 was then used.
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            Updated command line was also needed. 

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Updated command line was also needed. 
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment - - edited

            Different from w_2018_15(DM-14144), the RuntimeError for filter=NB0921 was no longer seen in running matchedVisitMetrics.py. A json file was generated, and it's available at /datasets/hsc/repo/rerun/RC/w_2018_17/DM-14055/validateDrp/matchedVisitMetrics/9813/NB0921/matchedVisit_NB0921.json

            However, running validateDrp.py and reportPerformance.py with it gave the following errors: 

            Traceback (most recent call last):
            		 
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/bin/validateDrp.py", line 101, in <module>
            		 
                validate.run(args.repo, **kwargs)
            		 
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/validate.py", line 164, in run
            		 
                print_pass_fail_summary(jobs, default_level=level)
            		 
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/validate.py", line 515, in print_pass_fail_summary
            		 
                spec_set = specs[metric]
            		 
            KeyError: 'PA1'


            Traceback (most recent call last):
            		 
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/bin/reportPerformance.py", line 69, in <module>
            		 
                release_level=args.release_level)
            		 
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/report_performance.py", line 51, in run
            		 
                input_table = objects_to_table(input_objects, level=srd_level)
            		 
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/report_performance.py", line 116, in objects_to_table
            		 
                spec_set = specs[metric]
            		 
            KeyError: 'PA1'

            I've therefore excluded NB0921 for validateDrp.py and reportPerformance.py.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - - edited Different from w_2018_15 ( DM-14144 ), the RuntimeError for filter=NB0921 was no longer seen in running matchedVisitMetrics.py . A json file was generated, and it's available at /datasets/hsc/repo/rerun/RC/w_2018_17/ DM-14055 /validateDrp/matchedVisitMetrics/9813/NB0921/matchedVisit_NB0921.json However, running validateDrp.py and reportPerformance.py with it gave the following errors: Traceback (most recent call last): File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/bin/validateDrp.py", line 101, in <module> validate.run(args.repo, **kwargs) File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/validate.py", line 164, in run print_pass_fail_summary(jobs, default_level=level) File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/validate.py", line 515, in print_pass_fail_summary spec_set = specs[metric] KeyError: 'PA1' Traceback (most recent call last): File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/bin/reportPerformance.py", line 69, in <module> release_level=args.release_level) File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/report_performance.py", line 51, in run input_table = objects_to_table(input_objects, level=srd_level) File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-5-gfa4ad3e+2/python/lsst/validate/drp/report_performance.py", line 116, in objects_to_table spec_set = specs[metric] KeyError: 'PA1' I've therefore excluded NB0921 for validateDrp.py and reportPerformance.py .
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment - - edited

            Simon Krughoff Michael Wood-Vasey, with Simon Krughoff's current fix at DM-14257 ticket branch, I was able to run them. Please see the previous comment if you care about filter=NB0921.

            Results and logs are at /datasets/hsc/repo/rerun/RC/w_2018_17/DM-14055/validateDrp/

            A web access is at https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_17/validate_drp/

            Show
            hchiang2 Hsin-Fang Chiang added a comment - - edited Simon Krughoff Michael Wood-Vasey , with Simon Krughoff 's current fix at DM-14257 ticket branch, I was able to run them. Please see the previous comment if you care about filter=NB0921. Results and logs are at /datasets/hsc/repo/rerun/RC/w_2018_17/ DM-14055 /validateDrp/ A web access is at https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_17/validate_drp/

              People

              Assignee:
              hchiang2 Hsin-Fang Chiang
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.