Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15073

Initial functor.yaml file for DPDD Object table

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      10
    • Epic Link:
    • Sprint:
      DRP F18-2, DRP F18-3, DRP F18-4, DRP F18-5, DRP F18-6
    • Team:
      Data Release Production

      Description

      Use framework in development on DM-14289 branch of qa_explorer, to create initial definition of DPDD-compliant Object table. 

        Attachments

          Issue Links

            Activity

            No builds found.
            yusra Yusra AlSayyad created issue -
            yusra Yusra AlSayyad made changes -
            Field Original Value New Value
            Epic Link DM-14568 [ 94449 ]
            yusra Yusra AlSayyad made changes -
            Risk Score 0
            yusra Yusra AlSayyad made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            yusra Yusra AlSayyad made changes -
            Link This issue relates to DM-14289 [ DM-14289 ]
            yusra Yusra AlSayyad made changes -
            Sprint DRP F18-2 [ 756 ] DRP F18-2, DRP F18-3 [ 756, 768 ]
            yusra Yusra AlSayyad made changes -
            Sprint DRP F18-2, DRP F18-3 [ 756, 768 ] DRP F18-2, DRP F18-3, DRP F18-4 [ 756, 768, 774 ]
            yusra Yusra AlSayyad made changes -
            Sprint DRP F18-2, DRP F18-3, DRP F18-4 [ 756, 768, 774 ] DRP F18-2, DRP F18-3, DRP F18-4, DRP F18-5 [ 756, 768, 774, 790 ]
            yusra Yusra AlSayyad made changes -
            Sprint DRP F18-2, DRP F18-3, DRP F18-4, DRP F18-5 [ 756, 768, 774, 790 ] DRP F18-2, DRP F18-3, DRP F18-4, DRP F18-5, DRP F18-6 [ 756, 768, 774, 790, 811 ]
            Hide
            yusra Yusra AlSayyad added a comment - - edited

            Lauren MacArthur and Jim Bosch If you have time, would you please comment on the draft Object.yaml file:  https://github.com/lsst/obs_subaru/pull/163

            I'm not attached to its location within obs_subaru.  A subdirectory would probably be more appropriate, so it doesn't mingle with the mappers. If the comments are too much for master, then I'd also be amenable to putting it in qa_explorer for now. It only has R-band for now, since I see  Tim Morton [X] working on a  multi-filter expander on DM-14289

            Tim Morton [X] would you take a look at the qa_explorer changes to support the Object.yaml?  https://github.com/lsst-dm/qa_explorer/pull/12  It's based on your  Oct 23th copy of DM-14289. As soon as you merge to master I'll rebase, and try out the multi-filter expander you've been adding. 

            This also required additional datasets to support the new commandline-tasks in https://github.com/lsst/obs_base/pull/121:

            To test:

            # Run `transformObjectCatalog.py` to extract, transform, rename, the columns per the yaml specification.
             # Inputs: deepCoadd_obj
             # Outputs: ObjectTable
             transformObjectCatalog.py /datasets/hsc/repo --rerun private/yusra/RC2/w_2018_42:private/your-user-name/w_2018_42 
             --id tract=9615^9697 -j 8 --no-versions
             
            #Concatenate all ObjectTables in a given tract (optional):
             
            consolidateObjectTable.py /datasets/hsc/repo --rerun private/your-user-name/w_2018_42   --id tract=9615^9697 --no-versions
            

            Show
            yusra Yusra AlSayyad added a comment - - edited Lauren MacArthur and Jim Bosch If you have time, would you please comment on the draft Object.yaml file:  https://github.com/lsst/obs_subaru/pull/163 ,  I'm not attached to its location within obs_subaru.  A subdirectory would probably be more appropriate, so it doesn't mingle with the mappers. If the comments are too much for master, then I'd also be amenable to putting it in qa_explorer for now. It only has R-band for now, since I see   Tim Morton [X]  working on a  multi-filter expander on DM-14289 .  Tim Morton [X] would you take a look at the qa_explorer changes to support the Object.yaml?  https://github.com/lsst-dm/qa_explorer/pull/12   It's based on your  Oct 23th copy of DM-14289 . As soon as you merge to master I'll rebase, and try out the multi-filter expander you've been adding.  This also required additional datasets to support the new commandline-tasks in https://github.com/lsst/obs_base/pull/121: To test: # Run `transformObjectCatalog.py` to extract, transform, rename, the columns per the yaml specification. # Inputs: deepCoadd_obj # Outputs: ObjectTable transformObjectCatalog.py /datasets/hsc/repo --rerun private/yusra/RC2/w_2018_42:private/your-user-name/w_2018_42 --id tract=9615^9697 -j 8 --no-versions   #Concatenate all ObjectTables in a given tract (optional):   consolidateObjectTable.py /datasets/hsc/repo --rerun private/your-user-name/w_2018_42 --id tract=9615^9697 --no-versions
            yusra Yusra AlSayyad made changes -
            Reviewers Jim Bosch, Tim Morton [ jbosch, tmorton ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            yusra Yusra AlSayyad made changes -
            Resolution Done [ 10000 ]
            Status In Review [ 10004 ] Done [ 10002 ]
            yusra Yusra AlSayyad made changes -
            Story Points 4 10

              People

              Assignee:
              yusra Yusra AlSayyad
              Reporter:
              yusra Yusra AlSayyad
              Reviewers:
              Jim Bosch, Tim Morton [X] (Inactive)
              Watchers:
              Colin Slater, Jim Bosch, Tim Morton [X] (Inactive), Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.