Uploaded image for project: 'OBSOLETE DM Long-range Planning OBSOLETE'
  1. OBSOLETE DM Long-range Planning OBSOLETE
  2. DLP-579

Usability and developer efficiency

    XMLWordPrintable

    Details

    • Milestone Level:
      3

      Description

      Internal and external developers can process precursor datasets (HSC, DECam, CFHT-LS, LSST lab data), generating and analyzing data products at small scale, with comparable difficulty to other toolkits. Documentation exists that external developers can use to add new algorithms. Problem reports can be turned into automated tests.

        Attachments

          Issue Links

          is blocked by

          Milestone - An overall project milestone DLP-378 Refactor Orchestration, including task deployment and execution

          • Major - Major loss of function.
          • Unplanned

          Milestone - An overall project milestone DLP-384 Refactor pipeline construction toolkit with modifications to support I/O

          • Major - Major loss of function.
          • Unplanned

          Milestone - An overall project milestone DLP-216 Provide basic APIs to use Firefly visualization components

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-217 Provide APIs for tabular data display using Firefly

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-218 Provide API for image display in Firefly

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-343 Native binary stack distribution releases implemented

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-564 Able to use some data-access APIs developed by database team

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-21 Working Butler Framework

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-342 Publish updated introductory software guide to developing with the stack

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-346 SQuaSH Prototype using existing architectural components deployed

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-390 Hierarchy of logging domains

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-391 Initial version of inter-process messaging framework, wrapping MPI and Event Services

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-457 Support runs on real cameras data and ImSim data

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-458 Ingest of bulk data from real cameras to ComCam scale

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-459 Qserv capability to hold data reduced at NCSA

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. DM-7540 Two DLP milestones may be misplaced in PMCS under 02C.06

          • Won't Fix

          Bug - A problem which impairs or prevents the functions of the product. DM-7541 DLP-579 may be at the wrong level in PMCS

          • Won't Fix

            Activity

            Hide
            Permalink
            ktl Kian-Tat Lim added a comment -

            Precursor datasets can be processed reasonably well with pipe_tasks, pipe_drivers, and the DESDM framework (as evidenced by LDM-503-2) at small to moderate scale. Documentation has been improved substantially for tasks, task writing, and overall development. The pytest framework has improved unit testing, and coding problems can be turned into unit tests relatively easily. Scientific problems are discovered and monitored through regular runs.

            While there is still much work to be done, I feel this is adequate for closing this long-delayed milestone.

            Show
            ktl Kian-Tat Lim added a comment - Precursor datasets can be processed reasonably well with pipe_tasks , pipe_drivers , and the DESDM framework (as evidenced by LDM-503-2) at small to moderate scale. Documentation has been improved substantially for tasks, task writing, and overall development. The pytest framework has improved unit testing, and coding problems can be turned into unit tests relatively easily. Scientific problems are discovered and monitored through regular runs. While there is still much work to be done, I feel this is adequate for closing this long-delayed milestone.

              People

              Assignee:
              ktl Kian-Tat Lim
              Reporter:
              ktl Kian-Tat Lim
              Watchers:
              Kian-Tat Lim
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.