Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14341

Run validate_drp with w_2018_18 HSC RC2 outputs

    XMLWordPrintable

Details

    • Story
    • Status: Done
    • Resolution: Done
    • None
    • None
    • None

    Description

      Run matchedVisitMetrics.py validateDrp.py and reportPerformance.py with the HSC RC2 w_2018_18 outputs from DM-14243.

      Attachments

        Issue Links

          Activity

            validateDrp.py is broken:

            $ validateDrp.py /datasets/hsc/repo/rerun/RC/w_2018_18/DM-14243/validateDrp/matchedVisitMetrics/9615/HSC-G/matchedVisit_HSC-G.json  --noplot
            Traceback (most recent call last):
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-7-gea15604/bin/validateDrp.py", line 101, in <module>
                validate.run(args.repo, **kwargs)
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-7-gea15604/python/lsst/validate/drp/validate.py", line 147, in run
                job = load_json_output(json_path, **kwargs)
            TypeError: load_json_output() got an unexpected keyword argument 'verbose'
            

            I've filed DM-14342

            hchiang2 Hsin-Fang Chiang added a comment - validateDrp.py is broken: $ validateDrp.py /datasets/hsc/repo/rerun/RC/w_2018_18/DM-14243/validateDrp/matchedVisitMetrics/9615/HSC-G/matchedVisit_HSC-G.json --noplot Traceback (most recent call last): File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-7-gea15604/bin/validateDrp.py", line 101, in <module> validate.run(args.repo, **kwargs) File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-7-gea15604/python/lsst/validate/drp/validate.py", line 147, in run job = load_json_output(json_path, **kwargs) TypeError: load_json_output() got an unexpected keyword argument 'verbose' I've filed DM-14342

            Using the ticket branch of DM-14342, I was able to run the same validateDrp.py command without errors.

            Same as in DM-14256, the NB0921 filter needs to be excluded, otherwise the following errors were seen:

              File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/validateDrp.py", line 101, in <module>
                validate.run(args.repo, **kwargs)
              File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 161, in run
                print_metrics(job)
              File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 464, in print_metrics
                metric = job.metrics[metric_set[0]] # Pick the first one for the description
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/verify/15.0-1-g8f0875c/python/lsst/verify/metricset.py", line 207, in __getitem__
                return self._metrics[key]
            KeyError: Name('release', 'PF1')
             
             
            Traceback (most recent call last):
              File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/reportPerformance.py", line 69, in <module>
                release_level=args.release_level)
              File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 52, in run
                input_table = objects_to_table(input_objects, level=srd_level)
              File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 120, in objects_to_table
                spec_set = specs[metric]
            KeyError: 'PA1'
            

            hchiang2 Hsin-Fang Chiang added a comment - Using the ticket branch of  DM-14342 , I was able to run the same validateDrp.py command without errors. Same as in DM-14256 , the NB0921 filter needs to be excluded, otherwise the following errors were seen: File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/validateDrp.py", line 101, in <module> validate.run(args.repo, **kwargs) File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 161, in run print_metrics(job) File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 464, in print_metrics metric = job.metrics[metric_set[0]] # Pick the first one for the description File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/verify/15.0-1-g8f0875c/python/lsst/verify/metricset.py", line 207, in __getitem__ return self._metrics[key] KeyError: Name('release', 'PF1')     Traceback (most recent call last): File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/reportPerformance.py", line 69, in <module> release_level=args.release_level) File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 52, in run input_table = objects_to_table(input_objects, level=srd_level) File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 120, in objects_to_table spec_set = specs[metric] KeyError: 'PA1'

            Results and logs are at {{/datasets/hsc/repo/rerun/RC/w_2018_18/DM-14243/validateDrp }}

            A web access is at https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_18/validate_drp/

            hchiang2 Hsin-Fang Chiang added a comment - Results and logs are at {{/datasets/hsc/repo/rerun/RC/w_2018_18/ DM-14243 /validateDrp }} A web access is at https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_18/validate_drp/

            People

              hchiang2 Hsin-Fang Chiang
              hchiang2 Hsin-Fang Chiang
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.