Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-711

Request: Upgrade astrometry.net to release 0.48

    Details

    • Type: Improvement
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: SAT, TCT
    • Labels:
      None
    • Team:
      Alert Production

      Description

      Release 0.30 is from 2010. Specific changes that we benefit from include:

      • (a) fixes to eups table file to not set CFLAGS. This was a mistake and it
        continues to cause trouble with builds.
      • (b) fixes to the build system
        giving more control over setting the include and library paths, making it
        easier to avoid conflicts between system versions and 'setup' versions.
      • (c) the ability to use the 'setup' gsl rather than a shipped subset of
        gsl.
      • (d) the ability to use "multi-index" files, with the ability to
        unload and reload them from memory to control resource use.
      • (e) the
        ability to redirect logging.

      Of these, (a) fixes a small but annoying problem, (b) and (c) are fairly minor, (e) is nice-to-have (Astrometry.net log messages are captured as pex_logging messages), and (d) is the big win. Currently, the astrometry_net_data files contain multiple copies of the reference stars, and these are loaded into memory and used independently. With the multi-index changes, we can eliminate this duplication, increasing the speed and decreasing the on-disk and in-memory footprint of astrometry_net_data. The multi-index work also moves us toward refactoring meas_astrom to separate the tasks of storing reference stars (for astrometric and photometric calibration) and solving astrometry.

      Changes to the LSST Stack to accommodate release 0.48 have been made as part of #2481. These include a couple of minor changes adapting to changes in the Astrometry.net API, plus a larger refactor to use multi-index files and more carefully manage resources.

        Attachments

          Issue Links

            Activity

            Hide
            ktl Kian-Tat Lim added a comment -

            At its meeting on 2014-05-22, the SAT decided to recommend that this upgrade be approved by the TCT.

            Show
            ktl Kian-Tat Lim added a comment - At its meeting on 2014-05-22, the SAT decided to recommend that this upgrade be approved by the TCT.
            Hide
            robyn Robyn Allsman [X] (Inactive) added a comment -

            The virtual TCT meeting of May 23- 28, 2014 recommended to the DM PM and DM PS that these upgrades should be installed.

            The DM Project Manager approved the recommendation to upgrade the software on May 28, 2014.
            This task will be assigned to the DevOps Team to carry out the upgrade.

            Show
            robyn Robyn Allsman [X] (Inactive) added a comment - The virtual TCT meeting of May 23- 28, 2014 recommended to the DM PM and DM PS that these upgrades should be installed. The DM Project Manager approved the recommendation to upgrade the software on May 28, 2014. This task will be assigned to the DevOps Team to carry out the upgrade.
            Hide
            robyn Robyn Allsman [X] (Inactive) added a comment -

            The first phase of this Issue - acquiring the permission to upgrade the software - has been completed.
            I will now move the Issue back into the ToDo phase in order to actually perform the upgrade.
            [We can discuss the proper Jira approach later : create a new Issue or to reuse the Issue]

            Show
            robyn Robyn Allsman [X] (Inactive) added a comment - The first phase of this Issue - acquiring the permission to upgrade the software - has been completed. I will now move the Issue back into the ToDo phase in order to actually perform the upgrade. [We can discuss the proper Jira approach later : create a new Issue or to reuse the Issue]
            Hide
            gpdf Gregory Dubois-Felsmann added a comment -

            Robyn commented: "[We can discuss the proper Jira approach later : create a new Issue or to reuse the Issue]".

            Perhaps create subtasks? One for the SAT/TCT/PM action and one for the implementation of the decision?

            Show
            gpdf Gregory Dubois-Felsmann added a comment - Robyn commented: " [We can discuss the proper Jira approach later : create a new Issue or to reuse the Issue] ". Perhaps create subtasks? One for the SAT/TCT/PM action and one for the implementation of the decision?
            Hide
            robyn Robyn Allsman [X] (Inactive) added a comment -

            Mario approved upgrade to astrometry_net to 0.49.

            Robyn asked: "The upgrade to 0.48 was tested with the current DM stack with necessary source upgrades.. Has the upgrade to 0.49 been similarly tested?"

            Dustin said: "Yes, I have a branch of meas_astrom using the 0.49 upgrade (meas_astrom branch u/dstn/an-0.49). Only meas_astrom is affected."

            Show
            robyn Robyn Allsman [X] (Inactive) added a comment - Mario approved upgrade to astrometry_net to 0.49. Robyn asked: "The upgrade to 0.48 was tested with the current DM stack with necessary source upgrades.. Has the upgrade to 0.49 been similarly tested?" Dustin said: "Yes, I have a branch of meas_astrom using the 0.49 upgrade (meas_astrom branch u/dstn/an-0.49). Only meas_astrom is affected."
            Hide
            robyn Robyn Allsman [X] (Inactive) added a comment -

            astrometry_net has been upgraded in the DM stack to version an-0.50

            Show
            robyn Robyn Allsman [X] (Inactive) added a comment - astrometry_net has been upgraded in the DM stack to version an-0.50

              People

              • Assignee:
                krughoff Simon Krughoff
                Reporter:
                dstn Dustin Lang [X] (Inactive)
                Reviewers:
                Robyn Allsman [X] (Inactive)
                Watchers:
                Andrew Connolly, Gregory Dubois-Felsmann, Kian-Tat Lim, Mario Juric, Mike Freemon [X] (Inactive), Robert Lupton, Robyn Allsman [X] (Inactive), Simon Krughoff
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel