Details

    • Type: Milestone
    • Status: Resolved
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: F16
    • Component/s: Planning
    • Labels:
    • Milestone Level:
      3

      Description

      Working implementation of shared scans capable of supporting both single-table scan, and synchronized multi-table scans. Demonstration involves:

      1. run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
      2. run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

      Scale: 10% of DR1.

      Details of shared scans can be found in ยง8.10 of LDM-135.

        Attachments

          Issue Links

            Activity

            No builds found.
            jbecla Jacek Becla created issue -
            jbecla Jacek Becla made changes -
            Field Original Value New Value
            Link This issue is blocked by DM-2077 [ DM-2077 ]
            jbecla Jacek Becla made changes -
            Fix Version/s S16 [ 10906 ]
            jbecla Jacek Becla made changes -
            Description Demonstrate shared scanning for two types of queries:
            # full table scan (single table)
            # full table scan (a join between two tables, for example, Object and Source)

            Demonstration involves running
            # 5 full-table-scan queries and showing each of them can complete in approx the time it takes to do a single scan. For example, if a single scan through the table takes 50 minutes, 5 queries run simultaneously should complete in ~ 50 min each, not 250 minutes.
            # run simultaneously 5 full-table-scan queries on Object table and demonstrate they complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they complete in approx the time it takes to do a single pass through the Source table.
            jbecla Jacek Becla made changes -
            Description # run simultaneously 5 full-table-scan queries on Object table and demonstrate they complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they complete in approx the time it takes to do a single pass through the Source table.
            # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.
            jbecla Jacek Becla made changes -
            Description # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.
            # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

            Scale: 10% of DR1.
            jbecla Jacek Becla made changes -
            Summary S16 Shared Scans Shared Scans
            jbecla Jacek Becla made changes -
            Link This issue blocks DLP-27 [ DLP-27 ]
            jbecla Jacek Becla made changes -
            Description # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

            Scale: 10% of DR1.
            Working implementation of shared scans capable of supporting both single-table scan, and synchronized multi-table scans. Demonstration involves:
            # # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

            Scale: 10% of DR1.
            jbecla Jacek Becla made changes -
            Description Working implementation of shared scans capable of supporting both single-table scan, and synchronized multi-table scans. Demonstration involves:
            # # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

            Scale: 10% of DR1.
            Working implementation of shared scans capable of supporting both single-table scan, and synchronized multi-table scans. Demonstration involves:
            # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

            Scale: 10% of DR1.
            jbecla Jacek Becla made changes -
            Description Working implementation of shared scans capable of supporting both single-table scan, and synchronized multi-table scans. Demonstration involves:
            # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

            Scale: 10% of DR1.
            Working implementation of shared scans capable of supporting both single-table scan, and synchronized multi-table scans. Demonstration involves:
            # run simultaneously 5 full-table-scan queries on Object table and demonstrate they all complete in approx the time it takes to do a single pass through the table.
            # run simultaneously 5 full-table-join queries (Object joined with Source) and demonstrate they all complete in approx the time it takes to do a single pass through the Source table plus the Object table.

            Scale: 10% of DR1.

            Details of shared scans can be found in §8.10 of [LDM-135|http://ls.st/LDM-135*].
            frossie Frossie Economou made changes -
            Workflow jira [ 22031 ] DM Long-range Planning Workflow [ 24571 ]
            fritzm Fritz Mueller made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13512 ]
            fritzm Fritz Mueller made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13512 ] This issue links to "Page (Confluence)" [ 13512 ]
            fritzm Fritz Mueller made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13512 ] This issue links to "Page (Confluence)" [ 13512 ]
            fritzm Fritz Mueller made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13512 ] This issue links to "Page (Confluence)" [ 13512 ]
            fritzm Fritz Mueller made changes -
            Assignee Jacek Becla [ jbecla ] Fritz Mueller [ fritzm ]
            jbecla Jacek Becla made changes -
            Labels L3Milestone
            frossie Frossie Economou made changes -
            Milestone Level 3 [ 11502 ]
            fritzm Fritz Mueller made changes -
            Resolution Done [ 10000 ]
            Status Open [ 1 ] Resolved [ 5 ]

              People

              Assignee:
              fritzm Fritz Mueller
              Reporter:
              jbecla Jacek Becla
              Watchers:
              Jacek Becla
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.