Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9907

Release hscPipe 5.0-beta2

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Team:
      Data Release Production

      Description

      These are the last science-impacting features we aim to include in the release:

      • DM-9855: Select images for coadd based on PSF quality
      • DM-9795: CModel priors are weighted incorrectly relative to likelihood
      • DM-9862: Update meas_mosaic's wcs/fcr output files to reflect LSST coordinate system
      • DM-9885: Rename deepCoadd_srcMatch as deepCoadd_measMatch (blocked by RFC-306)
      • DM-9828: Enable rectangular binSizes in SubtractBackgroundTask
      • DM-9985: Reduce Wcs pickle size
      • DM-9926: Reduce memory footprint of meas_mosaic read
      • DM-9556: All NaNs in coord_ra and coord_dec columns in deepCoadd forced src tables

      In the future we also hope to include:

      • DM-5766: Implement spatial exposure selection task

        Attachments

          Issue Links

            Activity

            Hide
            jbosch Jim Bosch added a comment - - edited

            DM-9855:

            Merged to HSC/master after rebasing tickets/DM-9855 branches for pipe_tasks and obs_subaru onto HSC/master. Only conflict was an addition of imports (including from __future__) to pipe_tasks/selectImages.py on the ticket branches; these needed to be reordered to make sure the __future__ imports came first.

            Show
            jbosch Jim Bosch added a comment - - edited DM-9855 : Merged to HSC/master after rebasing tickets/ DM-9855 branches for pipe_tasks and obs_subaru onto HSC/master. Only conflict was an addition of imports (including from __future__ ) to pipe_tasks/selectImages.py on the ticket branches; these needed to be reordered to make sure the __future__ imports came first.
            Hide
            jbosch Jim Bosch added a comment -

            Release is mostly complete; I'm doing a test install into the existing HSC stack directory on tiger overnight to test. I'll announce it in the morning if it succeeds.

            Some notes (mostly for myself, assuming I'm going to making the next release as well) on the process:

            • Should add afwdata and testdata_* to etc/exclusions.txt so we never release these. Have commit in HSC/lsstsw ready to push.
            • Need to packages before official release (especially meas_mosaic, which has no tags). Do we re-tag packages still at LSST's 13.0 tag?
            • Had to upload to ~jbosch on master instead of ~price on master because of permissions, but copied over existing server dir.
            • Need to make sure we upload to HSC/versiondb when making the official release, so we don't generate new versions for already-released packages.
            • lsst/newinstall.sh doesn't appear to exist anymore. I'm not sure if the old one still work, or if we need to update our installation bootstrap somehow. For now I'll test by installing into existing stacks.
            Show
            jbosch Jim Bosch added a comment - Release is mostly complete; I'm doing a test install into the existing HSC stack directory on tiger overnight to test. I'll announce it in the morning if it succeeds. Some notes (mostly for myself, assuming I'm going to making the next release as well) on the process: Should add afwdata and testdata_* to etc/exclusions.txt so we never release these. Have commit in HSC/lsstsw ready to push. Need to packages before official release (especially meas_mosaic, which has no tags). Do we re-tag packages still at LSST's 13.0 tag? Had to upload to ~jbosch on master instead of ~price on master because of permissions, but copied over existing server dir. Need to make sure we upload to HSC/versiondb when making the official release, so we don't generate new versions for already-released packages. lsst/newinstall.sh doesn't appear to exist anymore. I'm not sure if the old one still work, or if we need to update our installation bootstrap somehow. For now I'll test by installing into existing stacks.
            Hide
            jbosch Jim Bosch added a comment -

            Release is out.

            Show
            jbosch Jim Bosch added a comment - Release is out.
            Hide
            tjenness Tim Jenness added a comment -

            newinstall.sh is in the scripts/ directory: https://github.com/lsst/lsst/blob/master/scripts/newinstall.sh

            Show
            tjenness Tim Jenness added a comment - newinstall.sh is in the scripts/ directory: https://github.com/lsst/lsst/blob/master/scripts/newinstall.sh
            Hide
            price Paul Price added a comment -

            But please use the newinstall.sh from the HSC branch: https://github.com/HyperSuprime-Cam/lsst/blob/master/scripts/newinstall.sh

            Show
            price Paul Price added a comment - But please use the newinstall.sh from the HSC branch: https://github.com/HyperSuprime-Cam/lsst/blob/master/scripts/newinstall.sh

              People

              • Assignee:
                price Paul Price
                Reporter:
                price Paul Price
                Watchers:
                Jim Bosch, Paul Price, Tim Jenness
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: