Uploaded image for project: 'OBSOLETE DM Long-range Planning OBSOLETE'
  1. OBSOLETE DM Long-range Planning OBSOLETE
  2. DLP-579

Usability and developer efficiency

    XMLWordPrintable

    Details

    • Milestone Level:
      3

      Description

      Internal and external developers can process precursor datasets (HSC, DECam, CFHT-LS, LSST lab data), generating and analyzing data products at small scale, with comparable difficulty to other toolkits. Documentation exists that external developers can use to add new algorithms. Problem reports can be turned into automated tests.

        Attachments

          Issue Links

          is blocked by

          Milestone - An overall project milestone DLP-378 Refactor Orchestration, including task deployment and execution

          • Major - Major loss of function.
          • Unplanned

          Milestone - An overall project milestone DLP-384 Refactor pipeline construction toolkit with modifications to support I/O

          • Major - Major loss of function.
          • Unplanned

          Milestone - An overall project milestone DLP-216 Provide basic APIs to use Firefly visualization components

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-217 Provide APIs for tabular data display using Firefly

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-218 Provide API for image display in Firefly

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-343 Native binary stack distribution releases implemented

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-564 Able to use some data-access APIs developed by database team

          • Major - Major loss of function.
          • Resolved

          Milestone - An overall project milestone DLP-21 Working Butler Framework

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-342 Publish updated introductory software guide to developing with the stack

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-346 SQuaSH Prototype using existing architectural components deployed

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-390 Hierarchy of logging domains

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-391 Initial version of inter-process messaging framework, wrapping MPI and Event Services

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-457 Support runs on real cameras data and ImSim data

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-458 Ingest of bulk data from real cameras to ComCam scale

          • Major - Major loss of function.
          • Closed

          Milestone - An overall project milestone DLP-459 Qserv capability to hold data reduced at NCSA

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. DM-7540 Two DLP milestones may be misplaced in PMCS under 02C.06

          • Won't Fix

          Bug - A problem which impairs or prevents the functions of the product. DM-7541 DLP-579 may be at the wrong level in PMCS

          • Won't Fix

            Activity

            Ascending order - Click to sort in descending order
            No builds found.
            ktl Kian-Tat Lim created issue -
            ktl Kian-Tat Lim made changes -
            Field Original Value New Value
            Labels L2.5M L2.5Milestone
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-346 [ DLP-346 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-218 [ DLP-218 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-457 [ DLP-457 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-216 [ DLP-216 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-458 [ DLP-458 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-217 [ DLP-217 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-390 [ DLP-390 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-391 [ DLP-391 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-491 [ DLP-491 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-342 [ DLP-342 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-496 [ DLP-496 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-343 [ DLP-343 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-123 [ DLP-123 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-21 [ DLP-21 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-564 [ DLP-564 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-378 [ DLP-378 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-384 [ DLP-384 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-241 [ DLP-241 ]
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-459 [ DLP-459 ]
            ktl Kian-Tat Lim made changes -
            Fix Version/s S16 [ 10906 ]
            ktl Kian-Tat Lim made changes -
            WBS 02C.09
            frossie Frossie Economou made changes -
            Workflow jira [ 21738 ] DM Long-range Planning Workflow [ 24517 ]
            jbecla Jacek Becla made changes -
            Labels L2.5Milestone L3Milestone
            frossie Frossie Economou made changes -
            Milestone Level 3 [ 11502 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-7541 [ DM-7541 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-7540 [ DM-7540 ]
            gpdf Gregory Dubois-Felsmann made changes -
            Labels L3Milestone DMRev2017-Q7 L3Milestone
            ktl Kian-Tat Lim made changes -
            Link This issue is blocked by DLP-241 [ DLP-241 ]
            Hide
            Permalink
            ktl Kian-Tat Lim added a comment -

            Precursor datasets can be processed reasonably well with pipe_tasks, pipe_drivers, and the DESDM framework (as evidenced by LDM-503-2) at small to moderate scale. Documentation has been improved substantially for tasks, task writing, and overall development. The pytest framework has improved unit testing, and coding problems can be turned into unit tests relatively easily. Scientific problems are discovered and monitored through regular runs.

            While there is still much work to be done, I feel this is adequate for closing this long-delayed milestone.

            Show
            ktl Kian-Tat Lim added a comment - Precursor datasets can be processed reasonably well with pipe_tasks , pipe_drivers , and the DESDM framework (as evidenced by LDM-503-2) at small to moderate scale. Documentation has been improved substantially for tasks, task writing, and overall development. The pytest framework has improved unit testing, and coding problems can be turned into unit tests relatively easily. Scientific problems are discovered and monitored through regular runs. While there is still much work to be done, I feel this is adequate for closing this long-delayed milestone.
            ktl Kian-Tat Lim made changes -
            Resolution Done [ 10000 ]
            Status Open [ 1 ] Resolved [ 5 ]

              People

              Assignee:
              ktl Kian-Tat Lim
              Reporter:
              ktl Kian-Tat Lim
              Watchers:
              Kian-Tat Lim
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.