Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-5632

test run coaddDriver and multiBandDriver with DECam data

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Preparation work to learn about ctrl_pool and pipe_drivers packages.

      • Install ctrl_pool and pipe_drivers packages on my OSX desktop (no slurm).
      • Run the ctrl_pool mpiexec example to verify if the mpi is working.
      • Obtain a HSC data repo from ci_hsc as sanity checks.
      • Construct a small DECam data repo, using raw Stripe82 data consisting of two visits, one band, one patch.
      • Run ctrlPoolDemo.py with the HSC data repo and then the DECam data repo.
      • Run the pipe_drivers scripts coaddDriver and multiBandDriver with the HSC data repo and then the DECam data repo.
      • All with the default batch system SMP to run on a single machine.

        Attachments

          Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. DM-5409 mpi4py does not build on OS X El Capitan

          • Done

          Bug - A problem which impairs or prevents the functions of the product. DM-5586 Fix obs_decam butler level

          • Done

          Bug - A problem which impairs or prevents the functions of the product. DM-5595 daf_persistence build failure on OSX

          • Done

          Bug - A problem which impairs or prevents the functions of the product. DM-5326 propagateVisitFlags.py doesn't work with DECam and lsstSim data

          • Won't Fix

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-5593 fix issue where butler repository search returns list for single item

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-5607 check & correct comparison operators in daf_persistence and daf_butlerUtils

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-5615 Add pipe_drivers to lsstsw

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-5633 Add data products and config in obs_decam for multi-band processing

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -
            • For building on OSX El Cap, DM-5409 and DM-5595 are needed. DM-5615 helps too.
            • For running the ctrlPoolDemo with DECam data, DM-5586 is needed to fix the obs_decam bug regarding the butler subset level.
            • A Butler bug was noticed when running coaddDriver with a DECam repo: either DM-5593 or DM-5607 is needed on my machine.
            • DM-5326 is needed for running multiBandDriver with DECam data.
            Show
            hchiang2 Hsin-Fang Chiang added a comment - For building on OSX El Cap, DM-5409 and DM-5595 are needed. DM-5615 helps too. For running the ctrlPoolDemo with DECam data, DM-5586 is needed to fix the obs_decam bug regarding the butler subset level. A Butler bug was noticed when running coaddDriver with a DECam repo: either DM-5593 or DM-5607 is needed on my machine. DM-5326 is needed for running multiBandDriver with DECam data.
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            File DM-5633 for adding necessary config and data products in obs_decam

            Show
            hchiang2 Hsin-Fang Chiang added a comment - File DM-5633 for adding necessary config and data products in obs_decam
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            Close for March. Acquired some basic understanding of pipe_drivers and ctrl_pool. Successfully ran a small set of DECam calexp data through CoaddDriver and MultiBandDriver on one desktop.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Close for March. Acquired some basic understanding of pipe_drivers and ctrl_pool. Successfully ran a small set of DECam calexp data through CoaddDriver and MultiBandDriver on one desktop.

              People

              Assignee:
              hchiang2 Hsin-Fang Chiang
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.