Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17743

Shepherd tickets for HSC release candidate

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Team:
      External

      Description

      The HSC release candidate is blocked on the following tickets:

      • DM-17413: Investigate performance of background tweak during dynamic detection
      • DM-17423: Mask ghosts in HSC
      • DM-17425: Investigate use of smaller patch sizes
      • DM-17426: Improve full-visit sky subtraction
      • DM-17427: Incorporate Goulding bright star masks
      • DM-17428: Allow rotation before interpolating on coadd
      • DM-17429: PSFs on coadds are narrower than in model
      • DM-17431: Peak culling is removing real sources
      • DM-13054: Add colorterm config support to jointcal
      • DM-18174: Update HSC defects
      • DM-18314: Namespace confusion prevents use of MatchOptimisticB with singleFrameDriver
      • DM-19277: Update HSC defects again

        Attachments

          Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. DM-19015 HSC warp making is broken with doApplyUberCal=True

          • Done

          Bug - A problem which impairs or prevents the functions of the product. DM-17413 Investigate performance of background tweak during dynamic detection

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17990 Retrain star/galaxy separation in cosmos and use for HSC

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19672 Use smaller-scale sky subtraction for HSC release

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19265 Jacobian lost in meas_mosaic photometric solution

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-10826 fix jointcal collectRefStar handling of position errors

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-13054 Add colorterm config support to jointcal

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-18895 Use std::ptrdiff_t as index type in jointcal Eigen objects

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17426 Improve full-visit sky subtraction

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17427 Incorporate Goulding bright star masks

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17428 Allow rotation before interpolating on coadd

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17429 PSFs on coadds are narrower than in model

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17431 Peak culling is removing real sources

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17830 Investigate color-dependent offsets from ref cat in jointcal vs. meas_mosaic

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17991 Run FGCM on HSC data release S19A

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-18174 constructFlat fails when image is identically zero

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-18314 Namespace confusion prevents use of MatchOptimisticB with singleFrameDriver

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19277 Update HSC defects again

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19393 Fix HSC y stray-light lookup In Gen2

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19412 Bad CCD rotations in visualizeVisit.py

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17878 Initial background tweak in DynamicDetectionTask has no effect

          • Invalid
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17830 Investigate color-dependent offsets from ref cat in jointcal vs. meas_mosaic

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19253 HSC bright object masks are set incorrectly in the database

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            masayuki.tanaka Masayuki Tanaka added a comment -

            My suggestions for the hscPipe release would be:

            1.  implement "DM-17426: Improve full-visit sky subtraction".  Looking at the plots there, this seems like a low-risk change and is an improvement.
            2. partly implement "DM-17423: Mask ghosts in HSC".  We propagate mask bits for ghosts to deepCoadd_calexp but do not use them in warpCompare to actually mask them.  This is because we probably will not be able to fully validate the ghost masks in time for the release.
            3. implement "DM-17413: Investigate performance of background tweak during dynamic detection" as Mineo-kun's changes, which he will add to the ticket later, seem reasonable.
            4. the previous item is related to "DM-17425: Investigate use of smaller patch sizes".  We are now testing local sky background subtraction for D+UD.  If that reduces the computing time, then we go with 4k patches.  Otherwise, we go with 2k.
            5. let's see what Bob has to say on the S18A reprocessing.  This is "DM-17429: PSFs on coadds are narrower than in model".
            6. it would be great if Yusra can track down "DM-17431: Peak culling is removing real sources", but that is not the highest priority for this release.
            Show
            masayuki.tanaka Masayuki Tanaka added a comment - My suggestions for the hscPipe release would be:  implement " DM-17426 : Improve full-visit sky subtraction".  Looking at the plots there, this seems like a low-risk change and is an improvement. partly implement " DM-17423 : Mask ghosts in HSC".  We propagate mask bits for ghosts to deepCoadd_calexp but do not use them in warpCompare to actually mask them.  This is because we probably will not be able to fully validate the ghost masks in time for the release. implement " DM-17413 : Investigate performance of background tweak during dynamic detection" as Mineo-kun's changes, which he will add to the ticket later, seem reasonable. the previous item is related to " DM-17425 : Investigate use of smaller patch sizes".  We are now testing local sky background subtraction for D+UD.  If that reduces the computing time, then we go with 4k patches.  Otherwise, we go with 2k. let's see what Bob has to say on the S18A reprocessing.  This is " DM-17429 : PSFs on coadds are narrower than in model". it would be great if Yusra can track down " DM-17431 : Peak culling is removing real sources", but that is not the highest priority for this release.
            Hide
            Permalink
            yusra Yusra AlSayyad added a comment -

            I just added 5 "In review" tickets to the issue links I know that we need for this release to be either waited on or backported.

            Show
            yusra Yusra AlSayyad added a comment - I just added 5 "In review" tickets to the issue links I know that we need for this release to be either waited on or backported.

              People

              Assignee:
              masayuki.tanaka Masayuki Tanaka
              Reporter:
              price Paul Price
              Watchers:
              Hisanori Furusawa, Jim Bosch, John Swinbank, Masayuki Tanaka, Paul Price, Robert Lupton, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.