Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27770

Write a report on Qserv Ingest of HSC-RC2 Objects

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Summarize Qserv Ingest of HSC-RC2 Objects in a DMTN

        Attachments

          Activity

          Hide
          hchiang2 Hsin-Fang Chiang added a comment -
          Show
          hchiang2 Hsin-Fang Chiang added a comment - Started  dmtn-170.lsst.io
          Hide
          hchiang2 Hsin-Fang Chiang added a comment - - edited

          Here is a write-up of the Qserv ingest at NCSA hardware. It's not vey elaborate but it summarizes how the steps are currently. Please take a look.  

          https://dmtn-170.lsst.io/v/DM-27770/index.html 

           

          Show
          hchiang2 Hsin-Fang Chiang added a comment - - edited Here is a write-up of the Qserv ingest at NCSA hardware. It's not vey elaborate but it summarizes how the steps are currently. Please take a look.   https://dmtn-170.lsst.io/v/DM-27770/index.html    
          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          Fritz Mueller may you please take a look of https://dmtn-170.lsst.io/v/DM-27770/DMTN-170.pdf

          If it looks fine to you, I can present a summary of this in the SST meeting (cc/ Leanne Guy )

          Show
          hchiang2 Hsin-Fang Chiang added a comment - Fritz Mueller may you please take a look of https://dmtn-170.lsst.io/v/DM-27770/DMTN-170.pdf If it looks fine to you, I can present a summary of this in the SST meeting (cc/ Leanne Guy )
          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          Comments may be easier on the PR; then it's here: https://github.com/lsst-dm/dmtn-170/pull/2

          Show
          hchiang2 Hsin-Fang Chiang added a comment - Comments may be easier on the PR; then it's here: https://github.com/lsst-dm/dmtn-170/pull/2
          Hide
          fritzm Fritz Mueller added a comment - - edited

          Looks good to me!  One comment left on PR: might be good to add some quantitative info (input size, run time, rows ingested) to the "Examples" section.

          Show
          fritzm Fritz Mueller added a comment - - edited Looks good to me!  One comment left on PR: might be good to add some quantitative info (input size, run time, rows ingested) to the "Examples" section.
          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          Thanks for the review and the suggestion! Really good idea. Instead of listing I added a table to summarize the existing databases with those relevant info. I lost the workflow timing info of one old job, but overall I think/hope those info useful.

          Merged, and the new version is now on dmtn-170.lsst.io

          Show
          hchiang2 Hsin-Fang Chiang added a comment - Thanks for the review and the suggestion! Really good idea. Instead of listing I added a table to summarize the existing databases with those relevant info. I lost the workflow timing info of one old job, but overall I think/hope those info useful. Merged, and the new version is now on dmtn-170.lsst.io

            People

            Assignee:
            hchiang2 Hsin-Fang Chiang
            Reporter:
            hchiang2 Hsin-Fang Chiang
            Reviewers:
            Fritz Mueller
            Watchers:
            Fritz Mueller, Hsin-Fang Chiang, Leanne Guy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                CI Builds

                No builds found.