Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22521

enable partial image reads in cp_pipe combine to avoid memory issues

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: cp_pipe
    • Labels:
      None

      Description

      cpCombineTask currently loads all input images as full images. It would be safer for large number of inputs if this could defer loading and iterate over chunks instead (as with the "rows" option in the previous generation).

        Attachments

          Issue Links

            Activity

            czw Christopher Waters created issue -
            czw Christopher Waters made changes -
            Field Original Value New Value
            Link This issue FF-depends on DM-21212 [ DM-21212 ]
            swinbank John Swinbank made changes -
            Team Data Release Production [ 10301 ]
            czw Christopher Waters made changes -
            Epic Link DM-22586 [ 427653 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-22586 [ 427653 ] DM-23737 [ 431393 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-23737 [ 431393 ] DM-25268 [ 435627 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-25268 [ 435627 ] DM-26786 [ 439736 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-26786 [ 439736 ] DM-27956 [ 442730 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-27956 [ 442730 ] DM-29149 [ 458506 ]

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              czw Christopher Waters
              Watchers:
              Christopher Waters
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated: