Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32321

Copy Gen3 refcats to summit and ingest

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      2
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

        Attachments

          Issue Links

            Activity

            Hide
            mfisherlevine Merlin Fisher-Levine added a comment -

            After rsyncing the data to the summit and putting in copy in /project/shared/refcats I did the following:

            butler register-dataset-type /repo/LATISS gaia_dr2_20200414 SimpleCatalog htm7
            butler register-dataset-type /repo/LSSTComCam gaia_dr2_20200414 SimpleCatalog htm7
             
            butler register-dataset-type /repo/LATISS ps1_pv3_3pi_20170110 SimpleCatalog htm7
            butler register-dataset-type /repo/LSSTComCam ps1_pv3_3pi_20170110 SimpleCatalog htm7
             
            butler register-dataset-type /repo/LATISS sdss_dr9_fink_v5b SimpleCatalog htm7
            butler register-dataset-type /repo/LSSTComCam sdss_dr9_fink_v5b SimpleCatalog htm7
             
            --------
             
            butler ingest-files -t copy /repo/LATISS sdss_dr9_fink_v5b refcats ./sdss_dr9_fink_v5b.ecsv
            butler ingest-files -t copy /repo/LSSTComCam sdss_dr9_fink_v5b refcats ./sdss_dr9_fink_v5b.ecsv
             
            butler ingest-files -t copy /repo/LATISS gaia_dr2_20200414 refcats ./gaia_dr2_20200414.ecsv
            butler ingest-files -t copy /repo/LSSTComCam gaia_dr2_20200414 refcats ./gaia_dr2_20200414.ecsv
             
            butler ingest-files -t copy /repo/LATISS ps1_pv3_3pi_20170110 refcats ./ps1_pv3_3pi_20170110.ecsv
            butler ingest-files -t copy /repo/LSSTComCam ps1_pv3_3pi_20170110 refcats ./ps1_pv3_3pi_20170110.ecsv
            
            

            ecsv files were copied from lsst-devl refcats, end edited to reflect the summit paths.

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - After rsyncing the data to the summit and putting in copy in /project/shared/refcats I did the following: butler register-dataset-type /repo/LATISS gaia_dr2_20200414 SimpleCatalog htm7 butler register-dataset-type /repo/LSSTComCam gaia_dr2_20200414 SimpleCatalog htm7   butler register-dataset-type /repo/LATISS ps1_pv3_3pi_20170110 SimpleCatalog htm7 butler register-dataset-type /repo/LSSTComCam ps1_pv3_3pi_20170110 SimpleCatalog htm7   butler register-dataset-type /repo/LATISS sdss_dr9_fink_v5b SimpleCatalog htm7 butler register-dataset-type /repo/LSSTComCam sdss_dr9_fink_v5b SimpleCatalog htm7   --------   butler ingest-files -t copy /repo/LATISS sdss_dr9_fink_v5b refcats ./sdss_dr9_fink_v5b.ecsv butler ingest-files -t copy /repo/LSSTComCam sdss_dr9_fink_v5b refcats ./sdss_dr9_fink_v5b.ecsv   butler ingest-files -t copy /repo/LATISS gaia_dr2_20200414 refcats ./gaia_dr2_20200414.ecsv butler ingest-files -t copy /repo/LSSTComCam gaia_dr2_20200414 refcats ./gaia_dr2_20200414.ecsv   butler ingest-files -t copy /repo/LATISS ps1_pv3_3pi_20170110 refcats ./ps1_pv3_3pi_20170110.ecsv butler ingest-files -t copy /repo/LSSTComCam ps1_pv3_3pi_20170110 refcats ./ps1_pv3_3pi_20170110.ecsv ecsv files were copied from lsst-devl refcats, end edited to reflect the summit paths.
            Hide
            mfisherlevine Merlin Fisher-Levine added a comment -

            Tiago confirmed OOB that this is all working well.

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - Tiago confirmed OOB that this is all working well.

              People

              Assignee:
              mfisherlevine Merlin Fisher-Levine
              Reporter:
              mfisherlevine Merlin Fisher-Levine
              Reviewers:
              Tiago Ribeiro
              Watchers:
              Merlin Fisher-Levine, Tiago Ribeiro
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.