Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4716

Track down reason for slow performance when running many jobs of processCcdDEcam on bambam

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Science Pipelines
    • Labels:
      None

      Description

      During the processing of the COSMOS data for the verification dataset work I ran many jobs of processCcdDecam.py on the new linux server, bambam. The performance was very slow, 4x longer than running a single job at a time. Figure out what is going on.

        Attachments

          Issue Links

            Activity

            Hide
            nidever David Nidever [X] (Inactive) added a comment -

            The problem was being caused by an OpenBlas issue. We opened a ticket on it.

            Show
            nidever David Nidever [X] (Inactive) added a comment - The problem was being caused by an OpenBlas issue. We opened a ticket on it.
            Hide
            nidever David Nidever [X] (Inactive) added a comment -

            We figured out the problem after a couple days of work and filed a ticket on the OpenBlas problem.

            Show
            nidever David Nidever [X] (Inactive) added a comment - We figured out the problem after a couple days of work and filed a ticket on the OpenBlas problem.

              People

              • Assignee:
                nidever David Nidever [X] (Inactive)
                Reporter:
                nidever David Nidever [X] (Inactive)
                Watchers:
                David Nidever [X] (Inactive), Frossie Economou, J Matt Peterson [X] (Inactive)
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: