Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16360

Estimate expected density of reference sources from Gaia

    XMLWordPrintable

    Details

    • Team:
      DM Science

      Description

      Understand the distribution of and peak densities of reference catalogs possible in Gaia.

        Attachments

          Issue Links

            Activity

            No builds found.
            cmorrison Chris Morrison [X] (Inactive) created issue -
            cmorrison Chris Morrison [X] (Inactive) made changes -
            Field Original Value New Value
            Epic Link DM-14447 [ 80385 ]
            swinbank John Swinbank made changes -
            Summary Estimate expected density of reference sources from Gia Estimate expected density of reference sources from Gaia
            swinbank John Swinbank made changes -
            Link This issue blocks DM-16361 [ DM-16361 ]
            swinbank John Swinbank made changes -
            Sprint AP F18-6 [ 751 ]
            ctslater Colin Slater made changes -
            Assignee Colin Slater [ ctslater ]
            ctslater Colin Slater made changes -
            Epic Link DM-14447 [ 80385 ]
            ctslater Colin Slater made changes -
            Sprint AP F18-6 [ 751 ]
            ctslater Colin Slater made changes -
            Team Alert Production [ 10300 ] DM Science [ 12218 ]
            ctslater Colin Slater made changes -
            Story Points 1
            Hide
            ctslater Colin Slater added a comment -

            In DM-15921, we noticed excessive memory usage when the loaded refcat had ~37k sources covering a single Decam CCD (with surrounding buffer area). This density corresponds to roughly 700k/sq deg. Taking the entire Gaia DR2 catalog (with no cuts), this density is met or exceeded in 0.5% of sky area.

            The matcher memory usage is proportional to N^2, so if the refcat density is closer to 10k/CCD (190k/sq deg), the memory usage is reduced by a factor of 13. Approximately 5% of the reference catalog area exceeds this density.

            Show
            ctslater Colin Slater added a comment - In DM-15921 , we noticed excessive memory usage when the loaded refcat had ~37k sources covering a single Decam CCD (with surrounding buffer area). This density corresponds to roughly 700k/sq deg. Taking the entire Gaia DR2 catalog (with no cuts), this density is met or exceeded in 0.5% of sky area. The matcher memory usage is proportional to N^2, so if the refcat density is closer to 10k/CCD (190k/sq deg), the memory usage is reduced by a factor of 13. Approximately 5% of the reference catalog area exceeds this density.
            Hide
            ctslater Colin Slater added a comment -

            I think I've provided all that was asked for.

            Show
            ctslater Colin Slater added a comment - I think I've provided all that was asked for.
            ctslater Colin Slater made changes -
            Reviewers Chris Morrison [ cmorrison ]
            Status To Do [ 10001 ] In Review [ 10004 ]
            cmorrison Chris Morrison [X] (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status In Review [ 10004 ] Done [ 10002 ]

              People

              Assignee:
              ctslater Colin Slater
              Reporter:
              cmorrison Chris Morrison [X] (Inactive)
              Reviewers:
              Chris Morrison [X] (Inactive)
              Watchers:
              Chris Morrison [X] (Inactive), Colin Slater, Eric Bellm, John Swinbank
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.