Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9907

Release hscPipe 5.0-beta2

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Team:
      Data Release Production

      Description

      These are the last science-impacting features we aim to include in the release:

      • DM-9855: Select images for coadd based on PSF quality
      • DM-9795: CModel priors are weighted incorrectly relative to likelihood
      • DM-9862: Update meas_mosaic's wcs/fcr output files to reflect LSST coordinate system
      • DM-9885: Rename deepCoadd_srcMatch as deepCoadd_measMatch (blocked by RFC-306)
      • DM-9828: Enable rectangular binSizes in SubtractBackgroundTask
      • DM-9985: Reduce Wcs pickle size
      • DM-9926: Reduce memory footprint of meas_mosaic read
      • DM-9556: All NaNs in coord_ra and coord_dec columns in deepCoadd forced src tables

      In the future we also hope to include:

      • DM-5766: Implement spatial exposure selection task

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-10129 Process HSC RC dataset using Stack version chosen for the full S17B reprocessing

          • Done
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. DM-9556 All NaNs in coord_ra and coord_dec columns in deepCoadd forced src tables

          • Done

          Bug - A problem which impairs or prevents the functions of the product. DM-9795 CModel priors are weighted incorrectly relative to likelihood

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9862 Update meas_mosaic's wcs/fcr output files to reflect LSST coordinate system

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9828 Enable rectangular binSizes in SubtractBackgroundTask

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9855 Select images for coadd based on PSF quality.

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9885 Rename deepCoadd_srcMatch as deepCoadd_measMatch

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9926 Reduce memory footprint of meas_mosaic read

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9985 Reduce Wcs pickle size

          • Done

            Activity

            Ascending order - Click to sort in descending order
            9 older comments
            Hide
            Permalink
            jbosch Jim Bosch added a comment - - edited

            DM-9855:

            Merged to HSC/master after rebasing tickets/DM-9855 branches for pipe_tasks and obs_subaru onto HSC/master. Only conflict was an addition of imports (including from __future__) to pipe_tasks/selectImages.py on the ticket branches; these needed to be reordered to make sure the __future__ imports came first.

            Show
            jbosch Jim Bosch added a comment - - edited DM-9855 : Merged to HSC/master after rebasing tickets/ DM-9855 branches for pipe_tasks and obs_subaru onto HSC/master. Only conflict was an addition of imports (including from __future__ ) to pipe_tasks/selectImages.py on the ticket branches; these needed to be reordered to make sure the __future__ imports came first.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            Release is mostly complete; I'm doing a test install into the existing HSC stack directory on tiger overnight to test. I'll announce it in the morning if it succeeds.

            Some notes (mostly for myself, assuming I'm going to making the next release as well) on the process:

            • Should add afwdata and testdata_* to etc/exclusions.txt so we never release these. Have commit in HSC/lsstsw ready to push.
            • Need to packages before official release (especially meas_mosaic, which has no tags). Do we re-tag packages still at LSST's 13.0 tag?
            • Had to upload to ~jbosch on master instead of ~price on master because of permissions, but copied over existing server dir.
            • Need to make sure we upload to HSC/versiondb when making the official release, so we don't generate new versions for already-released packages.
            • lsst/newinstall.sh doesn't appear to exist anymore. I'm not sure if the old one still work, or if we need to update our installation bootstrap somehow. For now I'll test by installing into existing stacks.
            Show
            jbosch Jim Bosch added a comment - Release is mostly complete; I'm doing a test install into the existing HSC stack directory on tiger overnight to test. I'll announce it in the morning if it succeeds. Some notes (mostly for myself, assuming I'm going to making the next release as well) on the process: Should add afwdata and testdata_* to etc/exclusions.txt so we never release these. Have commit in HSC/lsstsw ready to push. Need to packages before official release (especially meas_mosaic, which has no tags). Do we re-tag packages still at LSST's 13.0 tag? Had to upload to ~jbosch on master instead of ~price on master because of permissions, but copied over existing server dir. Need to make sure we upload to HSC/versiondb when making the official release, so we don't generate new versions for already-released packages. lsst/newinstall.sh doesn't appear to exist anymore. I'm not sure if the old one still work, or if we need to update our installation bootstrap somehow. For now I'll test by installing into existing stacks.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            Release is out.

            Show
            jbosch Jim Bosch added a comment - Release is out.
            Hide
            Permalink
            tjenness Tim Jenness added a comment -

            newinstall.sh is in the scripts/ directory: https://github.com/lsst/lsst/blob/master/scripts/newinstall.sh

            Show
            tjenness Tim Jenness added a comment - newinstall.sh is in the scripts/ directory: https://github.com/lsst/lsst/blob/master/scripts/newinstall.sh
            Hide
            Permalink
            price Paul Price added a comment -

            But please use the newinstall.sh from the HSC branch: https://github.com/HyperSuprime-Cam/lsst/blob/master/scripts/newinstall.sh

            Show
            price Paul Price added a comment - But please use the newinstall.sh from the HSC branch: https://github.com/HyperSuprime-Cam/lsst/blob/master/scripts/newinstall.sh

              People

              Assignee:
              price Paul Price
              Reporter:
              price Paul Price
              Watchers:
              Jim Bosch, Paul Price, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.