Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18068

Write pipe_analysis parquet tables as butler datasets

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Story Points:
      2
    • Epic Link:
    • Team:
      Data Release Production

      Description

      The parquet tables written from within pipe_analysis currently still use the Filenamer hack to get the filename. As we now have a way to write parquet tables as butler datasets, we can make these tables butler datasets and properly "put" them. Most significantly, this will enable them to be loaded with a butler.

        Attachments

          Activity

            People

            • Assignee:
              tmorton Tim Morton
              Reporter:
              tmorton Tim Morton
              Reviewers:
              Lauren MacArthur
              Watchers:
              John Swinbank, Lauren MacArthur, Tim Morton, Yusra AlSayyad
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel