Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22258

Monthly November ap_pipe HiTS rerun

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_pipe
    • Labels:
      None
    • Story Points:
      1
    • Sprint:
      AP F19-6 (November)
    • Team:
      Alert Production

      Description

      It is November? Time to reprocess the full HiTS dataset with ap_pipe. Stick with the higher-res templates until DM-21330 is complete.

        Attachments

          Activity

          Hide
          mrawls Meredith Rawls added a comment -

          Can you please review this, Chris Morrison? The latest ap_pipe rerun on the full HiTS 2015 dataset lives on lsst-dev in /project/mrawls/hits2015/rerun/highres2. It uses the same high-resolution (0.2 pixel scale) templates created by Ian that were used for the highres1 rerun. The rerun was done via slurm, and logs are in /project/mrawls/slurm/ap_pipe*226895*. There was a single fatal processing error on visit 411657 ccd 47, and the run otherwise completed successfully.

          Show
          mrawls Meredith Rawls added a comment - Can you please review this, Chris Morrison ? The latest ap_pipe rerun on the full HiTS 2015 dataset lives on lsst-dev in /project/mrawls/hits2015/rerun/highres2. It uses the same high-resolution (0.2 pixel scale) templates created by Ian that were used for the highres1 rerun. The rerun was done via slurm, and logs are in /project/mrawls/slurm/ap_pipe*226895*. There was a single fatal processing error on visit 411657 ccd 47, and the run otherwise completed successfully.
          Hide
          cmorrison Chris Morrison added a comment -

          What would you like me to review besides check the files exist?

          Show
          cmorrison Chris Morrison added a comment - What would you like me to review besides check the files exist?
          Hide
          mrawls Meredith Rawls added a comment -

          This is the ~monthly ap_pipe rerun of the HiTS 2015 dataset (all 3 fields). Typically I run it with the same data that is in the ap_verify_hits2015 repo, but we have temporarily adopted higher resolution coadd templates Ian made until DM-21330 is done. The science images are the same as in ap_verify_hits2015. Since we don't presently have slurm scripts to run ap_verify, I have just run ap_pipe, and no metrics are recorded. The deliverable for the ticket is the processed data (PVIs, source catalogs, diffims, diffexp catalogs, etc.) and the APDB in the output rerun repo I specified above. Reviewing the files exist and the APDB looks valid to you should be sufficient.

          Show
          mrawls Meredith Rawls added a comment - This is the ~monthly ap_pipe rerun of the HiTS 2015 dataset (all 3 fields). Typically I run it with the same data that is in the ap_verify_hits2015 repo, but we have temporarily adopted higher resolution coadd templates Ian made until DM-21330 is done. The science images are the same as in ap_verify_hits2015. Since we don't presently have slurm scripts to run ap_verify, I have just run ap_pipe, and no metrics are recorded. The deliverable for the ticket is the processed data (PVIs, source catalogs, diffims, diffexp catalogs, etc.) and the APDB in the output rerun repo I specified above. Reviewing the files exist and the APDB looks valid to you should be sufficient.
          Hide
          cmorrison Chris Morrison added a comment -

          Looks fine. Everything seems to be there after loading the Apdb.

          Show
          cmorrison Chris Morrison added a comment - Looks fine. Everything seems to be there after loading the Apdb.

            People

            • Assignee:
              mrawls Meredith Rawls
              Reporter:
              mrawls Meredith Rawls
              Reviewers:
              Chris Morrison
              Watchers:
              Chris Morrison, Meredith Rawls
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel