Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-29936

Enable getting Children without repeatedly checking if the SourceCatalog is sorted

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      While Fred Moolekamp was chasing the errors in DM-29907, it was realized that `afwTable.SourceCatalog` forbids getting children if the catalog is unsorted. In checking if the catalog is sorted, it performs an operation that is O( n), which is as expensive as fetching the children even from an unsorted catalog. Moreover, this check is performed for each parent, thereby making getting the children for all parents an O(n^2) operation. However, it is desirable to check (somewhere, once) if the catalog is sorted, as "unsortedness" could indicate a potentially serious problem elsewhere. This ticket captures potential solutions, and discussions made towards that on Slack.

        Attachments

          Issue Links

          is duplicated by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-30105 Get children sources without repeatedly checking if the afw SourceCatalog is sorted by parent

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29737 Check if a SourceCatalog is sorted when calling `find`

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29907 Fix meas_extensions_scarlet sorting issue

          • Done

            Activity

            Ascending order - Click to sort in descending order
            kannawad Arun Kannawadi created issue -
            kannawad Arun Kannawadi made changes -
            Field Original Value New Value
            Link This issue relates to DM-29907 [ DM-29907 ]
            kannawad Arun Kannawadi made changes -
            Link This issue relates to DM-29737 [ DM-29737 ]
            kannawad Arun Kannawadi made changes -
            Description While [~fred3m] was chasing the errors in DM-29907, it was realized that `afwTable.SourceCatalog` forbids getting children if the catalog is unsorted. In checking if the catalog is sorted, it performs an operation that is O(n), which is as expensive as fetching the children even from an unsorted catalog. Moreover, this check is performed for each parent, thereby making getting the children an O(n^2) operation. However, it is desirable to check (somewhere, once) if the catalog is sorted, as "unsortedness" could indicate a potentially serious problem elsewhere. This ticket captures potential solutions, and discussions made towards that on Slack. While [~fred3m] was chasing the errors in DM-29907, it was realized that `afwTable.SourceCatalog` forbids getting children if the catalog is unsorted. In checking if the catalog is sorted, it performs an operation that is O( n), which is as expensive as fetching the children even from an unsorted catalog. Moreover, this check is performed for each parent, thereby making getting the children an O(n^2) operation. However, it is desirable to check (somewhere, once) if the catalog is sorted, as "unsortedness" could indicate a potentially serious problem elsewhere. This ticket captures potential solutions, and discussions made towards that on Slack.
            kannawad Arun Kannawadi made changes -
            Description While [~fred3m] was chasing the errors in DM-29907, it was realized that `afwTable.SourceCatalog` forbids getting children if the catalog is unsorted. In checking if the catalog is sorted, it performs an operation that is O( n), which is as expensive as fetching the children even from an unsorted catalog. Moreover, this check is performed for each parent, thereby making getting the children an O(n^2) operation. However, it is desirable to check (somewhere, once) if the catalog is sorted, as "unsortedness" could indicate a potentially serious problem elsewhere. This ticket captures potential solutions, and discussions made towards that on Slack. While [~fred3m] was chasing the errors in DM-29907, it was realized that `afwTable.SourceCatalog` forbids getting children if the catalog is unsorted. In checking if the catalog is sorted, it performs an operation that is O( n), which is as expensive as fetching the children even from an unsorted catalog. Moreover, this check is performed for each parent, thereby making getting the children for all parents an O(n^2) operation. However, it is desirable to check (somewhere, once) if the catalog is sorted, as "unsortedness" could indicate a potentially serious problem elsewhere. This ticket captures potential solutions, and discussions made towards that on Slack.
            kannawad Arun Kannawadi made changes -
            Summary Enable getting Children even if the SourceCatalog is unsorted Enable getting Children without repeatedly checking if the SourceCatalog is sorted
            kannawad Arun Kannawadi made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            kannawad Arun Kannawadi made changes -
            Assignee Arun Kannawadi [ kannawad ]
            kannawad Arun Kannawadi made changes -
            Reviewers Fred Moolekamp [ fred3m ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            fred3m Fred Moolekamp made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            kannawad Arun Kannawadi made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            kannawad Arun Kannawadi made changes -
            Story Points 2
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status Done [ 10002 ] To Do [ 10001 ]
            jbosch Jim Bosch made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            kannawad Arun Kannawadi made changes -
            Link This issue is duplicated by DM-30105 [ DM-30105 ]
            kannawad Arun Kannawadi made changes -
            Status In Progress [ 3 ] To Do [ 10001 ]
            kannawad Arun Kannawadi made changes -
            Resolution Done [ 10000 ]
            Status To Do [ 10001 ] Won't Fix [ 10405 ]
            yusra Yusra AlSayyad made changes -
            Story Points 2 0

              People

              Assignee:
              kannawad Arun Kannawadi
              Reporter:
              kannawad Arun Kannawadi
              Reviewers:
              Fred Moolekamp
              Watchers:
              Arun Kannawadi, Fred Moolekamp, Jim Bosch
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.