Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22258

Monthly November ap_pipe HiTS rerun

    XMLWordPrintable

Details

    • Story
    • Status: Done
    • Resolution: Done
    • None
    • ap_pipe
    • None
    • 1
    • AP F19-6 (November)
    • Alert Production

    Description

      It is November? Time to reprocess the full HiTS dataset with ap_pipe. Stick with the higher-res templates until DM-21330 is complete.

      Attachments

        Activity

          Can you please review this, cmorrison? The latest ap_pipe rerun on the full HiTS 2015 dataset lives on lsst-dev in /project/mrawls/hits2015/rerun/highres2. It uses the same high-resolution (0.2 pixel scale) templates created by Ian that were used for the highres1 rerun. The rerun was done via slurm, and logs are in /project/mrawls/slurm/ap_pipe*226895*. There was a single fatal processing error on visit 411657 ccd 47, and the run otherwise completed successfully.

          mrawls Meredith Rawls added a comment - Can you please review this, cmorrison ? The latest ap_pipe rerun on the full HiTS 2015 dataset lives on lsst-dev in /project/mrawls/hits2015/rerun/highres2. It uses the same high-resolution (0.2 pixel scale) templates created by Ian that were used for the highres1 rerun. The rerun was done via slurm, and logs are in /project/mrawls/slurm/ap_pipe*226895*. There was a single fatal processing error on visit 411657 ccd 47, and the run otherwise completed successfully.

          What would you like me to review besides check the files exist?

          cmorrison Chris Morrison [X] (Inactive) added a comment - What would you like me to review besides check the files exist?

          This is the ~monthly ap_pipe rerun of the HiTS 2015 dataset (all 3 fields). Typically I run it with the same data that is in the ap_verify_hits2015 repo, but we have temporarily adopted higher resolution coadd templates Ian made until DM-21330 is done. The science images are the same as in ap_verify_hits2015. Since we don't presently have slurm scripts to run ap_verify, I have just run ap_pipe, and no metrics are recorded. The deliverable for the ticket is the processed data (PVIs, source catalogs, diffims, diffexp catalogs, etc.) and the APDB in the output rerun repo I specified above. Reviewing the files exist and the APDB looks valid to you should be sufficient.

          mrawls Meredith Rawls added a comment - This is the ~monthly ap_pipe rerun of the HiTS 2015 dataset (all 3 fields). Typically I run it with the same data that is in the ap_verify_hits2015 repo, but we have temporarily adopted higher resolution coadd templates Ian made until DM-21330 is done. The science images are the same as in ap_verify_hits2015. Since we don't presently have slurm scripts to run ap_verify, I have just run ap_pipe, and no metrics are recorded. The deliverable for the ticket is the processed data (PVIs, source catalogs, diffims, diffexp catalogs, etc.) and the APDB in the output rerun repo I specified above. Reviewing the files exist and the APDB looks valid to you should be sufficient.

          Looks fine. Everything seems to be there after loading the Apdb.

          cmorrison Chris Morrison [X] (Inactive) added a comment - Looks fine. Everything seems to be there after loading the Apdb.

          People

            mrawls Meredith Rawls
            mrawls Meredith Rawls
            Chris Morrison [X] (Inactive)
            Chris Morrison [X] (Inactive), Meredith Rawls
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Jenkins

                No builds found.