Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15073

Initial functor.yaml file for DPDD Object table

    XMLWordPrintable

Details

    • Story
    • Status: Done
    • Resolution: Done
    • None
    • None
    • None
    • 10
    • DRP F18-2, DRP F18-3, DRP F18-4, DRP F18-5, DRP F18-6
    • Data Release Production

    Description

      Use framework in development on DM-14289 branch of qa_explorer, to create initial definition of DPDD-compliant Object table. 

      Attachments

        Issue Links

          Activity

            yusra Yusra AlSayyad added a comment - - edited

            lauren and jbosch If you have time, would you please comment on the draft Object.yaml file:  https://github.com/lsst/obs_subaru/pull/163

            I'm not attached to its location within obs_subaru.  A subdirectory would probably be more appropriate, so it doesn't mingle with the mappers. If the comments are too much for master, then I'd also be amenable to putting it in qa_explorer for now. It only has R-band for now, since I see  tmorton working on a  multi-filter expander on DM-14289

            tmorton would you take a look at the qa_explorer changes to support the Object.yaml?  https://github.com/lsst-dm/qa_explorer/pull/12  It's based on your  Oct 23th copy of DM-14289. As soon as you merge to master I'll rebase, and try out the multi-filter expander you've been adding. 

            This also required additional datasets to support the new commandline-tasks in https://github.com/lsst/obs_base/pull/121:

            To test:

            # Run `transformObjectCatalog.py` to extract, transform, rename, the columns per the yaml specification.
             # Inputs: deepCoadd_obj
             # Outputs: ObjectTable
             transformObjectCatalog.py /datasets/hsc/repo --rerun private/yusra/RC2/w_2018_42:private/your-user-name/w_2018_42 
             --id tract=9615^9697 -j 8 --no-versions
             
            #Concatenate all ObjectTables in a given tract (optional):
             
            consolidateObjectTable.py /datasets/hsc/repo --rerun private/your-user-name/w_2018_42   --id tract=9615^9697 --no-versions
            

            yusra Yusra AlSayyad added a comment - - edited lauren and jbosch If you have time, would you please comment on the draft Object.yaml file:  https://github.com/lsst/obs_subaru/pull/163 ,  I'm not attached to its location within obs_subaru.  A subdirectory would probably be more appropriate, so it doesn't mingle with the mappers. If the comments are too much for master, then I'd also be amenable to putting it in qa_explorer for now. It only has R-band for now, since I see   tmorton  working on a  multi-filter expander on DM-14289 .  tmorton would you take a look at the qa_explorer changes to support the Object.yaml?  https://github.com/lsst-dm/qa_explorer/pull/12   It's based on your  Oct 23th copy of DM-14289 . As soon as you merge to master I'll rebase, and try out the multi-filter expander you've been adding.  This also required additional datasets to support the new commandline-tasks in https://github.com/lsst/obs_base/pull/121: To test: # Run `transformObjectCatalog.py` to extract, transform, rename, the columns per the yaml specification. # Inputs: deepCoadd_obj # Outputs: ObjectTable transformObjectCatalog.py /datasets/hsc/repo --rerun private/yusra/RC2/w_2018_42:private/your-user-name/w_2018_42 --id tract=9615^9697 -j 8 --no-versions   #Concatenate all ObjectTables in a given tract (optional):   consolidateObjectTable.py /datasets/hsc/repo --rerun private/your-user-name/w_2018_42 --id tract=9615^9697 --no-versions

            People

              yusra Yusra AlSayyad
              yusra Yusra AlSayyad
              Jim Bosch, Tim Morton [X] (Inactive)
              Colin Slater, Jim Bosch, Tim Morton [X] (Inactive), Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.