Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-1579

Implement replacement for A.net index files

    Details

    • Story Points:
      5
    • Sprint:
      Science Pipelines DM-W15-3, Science Pipelines DM-W15-4, Science Pipelines DM-S15-1, Science Pipelines DM-S15-4, Science Pipelines DM-S15-5, Science Pipelines DM-S15-6, Science Pipelines DM-W16-1, Science Pipelines DM-W16-2, Alert Production X16 - 03
    • Team:
      Alert Production

      Description

      Astrometry.net index files are hard to generate and hard to read. We need another, more flexible, more standard system for storing reference files. We should also be able to read FITS files and other formats, but having a standard format with the utilities to create and query them is a must.

      Coming up with a format that satisfies astrometry.net's solver may be too hard, because a.net requires quads, which a non-blind solver may not need. However, a format that we can convert to something suitable for a.net would probably suffice (conversion would presumably be a separate task that is run once).

      It will be easier to identify a suitable format once we have identified at least one solver other than than a.net that we wish to implement or adapt. hscAstrom appears to use a catalog of star positions, which is nice and simple.

        Attachments

          Issue Links

            Activity

            Hide
            price Paul Price added a comment -

            Yes, thank you.

            Show
            price Paul Price added a comment - Yes, thank you.
            Hide
            krughoff Simon Krughoff added a comment -

            Merged. Paul Price, thanks for the really useful comments.

            Show
            krughoff Simon Krughoff added a comment - Merged. Paul Price , thanks for the really useful comments.
            Hide
            swinbank John Swinbank added a comment -

            Hey Simon Krughoff – is there any documentation I can refer to to find out what's actually happened here? It looks interesting, but I'm not sure I understand the broader context. Does it mean astrometry_net_data packages are going away, for instance? While I understand the new catalogue format is based on HTM, is there a reference to what it actually looks like?

            Show
            swinbank John Swinbank added a comment - Hey Simon Krughoff – is there any documentation I can refer to to find out what's actually happened here? It looks interesting, but I'm not sure I understand the broader context. Does it mean astrometry_net_data packages are going away, for instance? While I understand the new catalogue format is based on HTM, is there a reference to what it actually looks like?
            Hide
            krughoff Simon Krughoff added a comment -

            John Swinbank I'm sorry for the lack of documentation. I will make sure to improve that situation. We can't use the replacements yet because of issues covered in RFC-173. My hope is that we can remove all explicit dependency on a.net, but still support it optionally. Regarding file formats, they are just afwTable.SourceCatalogs with the minimum schema defined in the task documentation here.

            Show
            krughoff Simon Krughoff added a comment - John Swinbank I'm sorry for the lack of documentation. I will make sure to improve that situation. We can't use the replacements yet because of issues covered in RFC-173 . My hope is that we can remove all explicit dependency on a.net, but still support it optionally. Regarding file formats, they are just afwTable.SourceCatalogs with the minimum schema defined in the task documentation here .
            Hide
            swinbank John Swinbank added a comment -

            Thanks Simon – that's all I need to know to orient myself for now, anyway. More docs would obviously be nice long term, but that's really a general truism...

            Show
            swinbank John Swinbank added a comment - Thanks Simon – that's all I need to know to orient myself for now, anyway. More docs would obviously be nice long term, but that's really a general truism...

              People

              • Assignee:
                krughoff Simon Krughoff
                Reporter:
                krughoff Simon Krughoff
                Reviewers:
                David Reiss
                Watchers:
                David Reiss, John Parejko, John Swinbank, Paul Price, Russell Owen, Simon Krughoff
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel