Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-25244

F20 Gen3 Middleware

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      F20 Gen3 Middleware
    • Story Points:
      111
    • WBS:
      02C.06.04
    • Team:
      Data Access and Database
    • Cycle:
      Fall 2020

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
       
      DM-27373

      Improve error message for missing butler_attributes table

      1 Andy Salnikov Done
       
      DM-27351

      --long-log does not work with butler command line command

      1 Nate Pease [X] (Inactive) Done
       
      DM-27344

      Add butler query-dimension-records subcommand

      4 Nate Pease [X] (Inactive) Done
       
      DM-27293

      Add expression parser support for bindparams and topological operators

      Andy Salnikov Done
       
      DM-27519

      --show history doesn't report complete results in pipetask

      2 Andy Salnikov Done
       
      DM-27500

      add a comment in butler & pipetask subcommand about more options in butler --help

      2 Nate Pease [X] (Inactive) Done
       
      DM-26136

      Improve handling of crashes in pipetask

      4 Andy Salnikov Done
       
      DM-26131

      Pipetask should handle SIGINT and back out of database transactions

      4 Andy Salnikov Done
       
      DM-26103

      make lsst.log config in butler command conditional

      2 Nate Pease [X] (Inactive) Done
       
      DM-26728

      Growing open file count in pipetask

      1 Andy Salnikov Done
       
      DM-26597

      fix --log-level help and default value

      2 Nate Pease [X] (Inactive) Done
       
      DM-26591

      Include instrument data ID value when provided on pipetask command-line or Pipeline yaml file

      6 Nate Pease [X] (Inactive) Done
       
      DM-25885

      Export/Import of some datasets prints time warnings

      2 Andy Salnikov Done
       
      DM-25385

      begin pipetask command conversion to Click, implement the 'build' subcommand.

      24 Nate Pease [X] (Inactive) Done
       
      DM-25355

      Add support for defining schema version defined by daf_butler

      6 Andy Salnikov Done
       
      DM-25354

      Extend registry schema to support metadata/configuration

      2 Andy Salnikov Done
       
      DM-25317

      cleanup items for butler CLI

      2 Nate Pease [X] (Inactive) Done
       
      DM-25468

      Add protection for repeated schema initialization

      2 Andy Salnikov Done
       
      DM-25411

      Fix broken postgres test due to attribute manager

      1 Andy Salnikov Done
       
      DM-27154

      Usability improvement suggestions for butler collection commands

      5 Nate Pease [X] (Inactive) Done
       
      DM-27422

      @option_section() doesn't seem to work well with Sphinx

      2 Nate Pease [X] (Inactive) Done
       
      DM-26774

      Instrument-finding code incorrectly requires a data query

      Nate Pease [X] (Inactive) Done
       
      DM-27118

      Switch to spawn method in ctrl_mpexec to fix ci_hsc_gen3 failing on macOS jenkins

      2 Andy Salnikov Done
       
      DM-26690

      Add command-line tool for Registry.queryDataIds

      8 Nate Pease [X] (Inactive) Done
       
      DM-26685

      Add command-line tool for Registry.queryDatasets

      5 Nate Pease [X] (Inactive) Done
       
      DM-26684

      Add command-line tool for Butler.pruneCollection

      2 Nate Pease [X] (Inactive) Done
       
      DM-26645

      Add a default value for pipetask2 -j option

      2 Nate Pease [X] (Inactive) Done
       
      DM-25985

      Save schema version(s) in the database

      6 Andy Salnikov Done
       
      DM-24414

      Implement --prune-replaced option in ctrl_mpexec

      2 Andy Salnikov Done
       
      DM-24398

      Add Click documentation to the developer guide

      4 Nate Pease [X] (Inactive) Done
       
      DM-24329

      add sphinx documentation of the Click CLI in daf_butler

      4 Nate Pease [X] (Inactive) Done
       
      DM-26230

      Improve pipetask dignostics on multiprocessing timeouts.

      1 Andy Salnikov Done
       
      DM-26181

      Ensure that filters are defined in pipetask multiprocessing

      1 Andy Salnikov Done
       
      DM-24803

      Plan for Gen3 schema migrations using Alembic

      10 Andy Salnikov Done
       
      DM-24508

      Add lsst log message init to Click CLI tools

      1 Nate Pease [X] (Inactive) Done
       
      DM-26974

      Fix timing issue in ctrl_mpexec unit test

      1 Andy Salnikov Done
       
      DM-26415

      remove chained commands from pipetask2

      4 Nate Pease [X] (Inactive) Done
       
      DM-26407

      Change how dimensions are stored in a Butler repository

      10 Andy Salnikov Done
       
      DM-26388

      pipetask2 --butler-config should accept a repository URI

      1 Nate Pease [X] (Inactive) Done
       
      DM-26874

      rename pipetask2 to pipetask, remove old pipetask

      4 Nate Pease [X] (Inactive) Done
       
      DM-26539

      w_35 ci_hsc_gen pipeline.sh dying due to SSL Error

      1 Andy Salnikov Done
       
      DM-25760

      add --glob to butler query-collections

      4 Nate Pease [X] (Inactive) Done
       
      DM-25627

      make qgraph and run subcommands for pipetask

      8 Nate Pease [X] (Inactive) Done
       
      DM-25151

      in butler CLI add -h as an alias for --help

      1 Nate Pease [X] (Inactive) Done
       
      DM-25101

      butler ingest-raws CLI ingesting subsets of files in directory

      4 Nate Pease [X] (Inactive) Done
       
      DM-25028

      change butler create --config-file to --seed-config

      2 Nate Pease [X] (Inactive) Done
       
      DM-25196

      make query-collections and query-dataset-types butler commands

      5 Nate Pease [X] (Inactive) Done
       
      DM-10351

      Concise progress tracking for long-running jobs

      1 Andy Salnikov Done

        Activity

        There are no comments yet on this issue.

          People

          Assignee:
          Unassigned Unassigned
          Reporter:
          fritzm Fritz Mueller
          Watchers:
          Fritz Mueller
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

            Dates

            Created:
            Updated:
            Resolved:

              Jenkins

              No builds found.