Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-2518

Add a CFHT-based post-build integration test to the sandbox build

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: QA
    • Labels:
      None

      Description

      From Dominique Boutigny

      I have installed some simple stack validation tools working on CFHT data in /lsst8/boutigny/valid_cfht

      Here is the content of the README file :

      ------------------------------------------------------------------------------------------------------------------------
      This directory contains a set of utilities to validate a stack release with CFHT data

      At the moment, only validation plots for the astrometry are produced

      Directories :
      -------------
      rawDownload : contain raw CFHT images (flat, dark, bias, fringe,... corrected)
      reference_plots : contain reference plots corresponding to the best results obtain so far.

      Files :
      -------
      setup.cfht : stack environment setup
      valid_cfht.sh : run processCcd taks on the cfht images
      valid_cfht.sh init : create the input/ouput directories, ingest raw images and run processCcd
      valid_cfht.sh : without the "init" argument, runs processCcd assuming that the directory structure exists and that the raw images have been ingested.
      valid_cfht.py : run some analysis on the output data produced by valid_cfht.sh
      processConfig.py : configuration parameters for processCcd
      run.list : list of vistits / ccd to be processed by processCcd

      Requirements :
      --------------
      obs_cfht : tickets/DM-1593
      astrometry_net_data : SDSS_DR9 reference catalog corresponding for CFHT Deep Field #3
      ------------------------------------------------------------------------------------------------------------------------

      Basically it produces a set of plots stored in a png image that can be compared to a reference plot corresponding to the best results obtained so far with stack_v10_0

      I hope that this is useful. Just be careful that I wrote these scripts with my own "fat hand full of fingers" and that it is just basic code from a non expert. If it is useful, I can certainly add more plots to validate the psf determination, photometry, etc.

      Comments, suggestions and criticisms are very welcome.

        Attachments

          Issue Links

            Activity

            frossie Frossie Economou created issue -
            frossie Frossie Economou made changes -
            Field Original Value New Value
            Epic Link DM-2050 [ 16188 ]
            tjenness Tim Jenness made changes -
            Watchers Frossie Economou, Tim Jenness [ Frossie Economou, Tim Jenness ] Dominique Boutigny, Frossie Economou, Tim Jenness [ Dominique Boutigny, Frossie Economou, Tim Jenness ]
            frossie Frossie Economou made changes -
            Assignee Joshua Hoblitt [ jhoblitt ] David Nidever [ nidever ]
            tjenness Tim Jenness made changes -
            Team SQuaRE [ 10302 ]
            Description

            From [~boutigny]

            I have installed some simple stack validation tools working on CFHT data in /lsst8/boutigny/valid_cfht

            Here is the content of the README file :

            ------------------------------------------------------------------------------------------------------------------------
            This directory contains a set of utilities to validate a stack release with CFHT data

            At the moment, only validation plots for the astrometry are produced

            Directories :
            -------------
            rawDownload : contain raw CFHT images (flat, dark, bias, fringe,... corrected)
            reference_plots : contain reference plots corresponding to the best results obtain so far.

            Files :
            -------
            setup.cfht : stack environment setup
            valid_cfht.sh : run processCcd taks on the cfht images
               valid_cfht.sh init : create the input/ouput directories, ingest raw images and run processCcd
               valid_cfht.sh : without the "init" argument, runs processCcd assuming that the directory structure exists and that the raw images have been ingested.
            valid_cfht.py : run some analysis on the output data produced by valid_cfht.sh
            processConfig.py : configuration parameters for processCcd
            run.list : list of vistits / ccd to be processed by processCcd

            Requirements :
            --------------
            obs_cfht : tickets/DM-1593
            astrometry_net_data : SDSS_DR9 reference catalog corresponding for CFHT Deep Field #3
            ------------------------------------------------------------------------------------------------------------------------

            Basically it produces a set of plots stored in a png image that can be compared to a reference plot corresponding to the best results obtained so far with stack_v10_0

            I hope that this is useful. Just be careful that I wrote these scripts with my own "fat hand full of fingers" and that it is just basic code from a non expert. If it is useful, I can certainly add more plots to validate the psf determination, photometry, etc.

            Comments, suggestions and criticisms are very welcome.

            From [~boutigny]

            I have installed some simple stack validation tools working on CFHT data in /lsst8/boutigny/valid_cfht

            Here is the content of the README file :

            ------------------------------------------------------------------------------------------------------------------------
            This directory contains a set of utilities to validate a stack release with CFHT data

            At the moment, only validation plots for the astrometry are produced

            Directories :
            -------------
            rawDownload : contain raw CFHT images (flat, dark, bias, fringe,... corrected)
            reference_plots : contain reference plots corresponding to the best results obtain so far.

            Files :
            -------
            setup.cfht : stack environment setup
            valid_cfht.sh : run processCcd taks on the cfht images
               valid_cfht.sh init : create the input/ouput directories, ingest raw images and run processCcd
               valid_cfht.sh : without the "init" argument, runs processCcd assuming that the directory structure exists and that the raw images have been ingested.
            valid_cfht.py : run some analysis on the output data produced by valid_cfht.sh
            processConfig.py : configuration parameters for processCcd
            run.list : list of vistits / ccd to be processed by processCcd

            Requirements :
            --------------
            obs_cfht : tickets/DM-1593
            astrometry_net_data : SDSS_DR9 reference catalog corresponding for CFHT Deep Field #3
            ------------------------------------------------------------------------------------------------------------------------

            Basically it produces a set of plots stored in a png image that can be compared to a reference plot corresponding to the best results obtained so far with stack_v10_0

            I hope that this is useful. Just be careful that I wrote these scripts with my own "fat hand full of fingers" and that it is just basic code from a non expert. If it is useful, I can certainly add more plots to validate the psf determination, photometry, etc.

            Comments, suggestions and criticisms are very welcome.
            tjenness Tim Jenness made changes -
            Description
            From [~boutigny]

            I have installed some simple stack validation tools working on CFHT data in /lsst8/boutigny/valid_cfht

            Here is the content of the README file :

            ------------------------------------------------------------------------------------------------------------------------
            This directory contains a set of utilities to validate a stack release with CFHT data

            At the moment, only validation plots for the astrometry are produced

            Directories :
            -------------
            rawDownload : contain raw CFHT images (flat, dark, bias, fringe,... corrected)
            reference_plots : contain reference plots corresponding to the best results obtain so far.

            Files :
            -------
            setup.cfht : stack environment setup
            valid_cfht.sh : run processCcd taks on the cfht images
               valid_cfht.sh init : create the input/ouput directories, ingest raw images and run processCcd
               valid_cfht.sh : without the "init" argument, runs processCcd assuming that the directory structure exists and that the raw images have been ingested.
            valid_cfht.py : run some analysis on the output data produced by valid_cfht.sh
            processConfig.py : configuration parameters for processCcd
            run.list : list of vistits / ccd to be processed by processCcd

            Requirements :
            --------------
            obs_cfht : tickets/DM-1593
            astrometry_net_data : SDSS_DR9 reference catalog corresponding for CFHT Deep Field #3
            ------------------------------------------------------------------------------------------------------------------------

            Basically it produces a set of plots stored in a png image that can be compared to a reference plot corresponding to the best results obtained so far with stack_v10_0

            I hope that this is useful. Just be careful that I wrote these scripts with my own "fat hand full of fingers" and that it is just basic code from a non expert. If it is useful, I can certainly add more plots to validate the psf determination, photometry, etc.

            Comments, suggestions and criticisms are very welcome.
            From [~boutigny]

            I have installed some simple stack validation tools working on CFHT data in {{/lsst8/boutigny/valid_cfht}}

            Here is the content of the README file :

            ------------------------------------------------------------------------------------------------------------------------
            This directory contains a set of utilities to validate a stack release with CFHT data

            At the moment, only validation plots for the astrometry are produced

            Directories :
            -------------
            rawDownload : contain raw CFHT images (flat, dark, bias, fringe,... corrected)
            reference_plots : contain reference plots corresponding to the best results obtain so far.

            Files :
            -------
            setup.cfht : stack environment setup
            valid_cfht.sh : run processCcd taks on the cfht images
               valid_cfht.sh init : create the input/ouput directories, ingest raw images and run processCcd
               valid_cfht.sh : without the "init" argument, runs processCcd assuming that the directory structure exists and that the raw images have been ingested.
            valid_cfht.py : run some analysis on the output data produced by valid_cfht.sh
            processConfig.py : configuration parameters for processCcd
            run.list : list of vistits / ccd to be processed by processCcd

            Requirements :
            --------------
            obs_cfht : tickets/DM-1593
            astrometry_net_data : SDSS_DR9 reference catalog corresponding for CFHT Deep Field #3
            ------------------------------------------------------------------------------------------------------------------------

            Basically it produces a set of plots stored in a png image that can be compared to a reference plot corresponding to the best results obtained so far with stack_v10_0

            I hope that this is useful. Just be careful that I wrote these scripts with my own "fat hand full of fingers" and that it is just basic code from a non expert. If it is useful, I can certainly add more plots to validate the psf determination, photometry, etc.

            Comments, suggestions and criticisms are very welcome.
            wmwood-vasey Michael Wood-Vasey made changes -
            Link This issue is blocked by DM-4706 [ DM-4706 ]
            wmwood-vasey Michael Wood-Vasey made changes -
            Link This issue is blocked by DM-4708 [ DM-4708 ]
            wmwood-vasey Michael Wood-Vasey made changes -
            Link This issue is blocked by DM-4709 [ DM-4709 ]
            wmwood-vasey Michael Wood-Vasey made changes -
            Assignee David Nidever [ nidever ] Michael Wood-Vasey [ wmwood-vasey ]
            wmwood-vasey Michael Wood-Vasey made changes -
            Watchers Dominique Boutigny, Frossie Economou, Michael Wood-Vasey, Tim Jenness [ Dominique Boutigny, Frossie Economou, Michael Wood-Vasey, Tim Jenness ] David Nidever, Dominique Boutigny, Frossie Economou, Michael Wood-Vasey, Tim Jenness [ David Nidever, Dominique Boutigny, Frossie Economou, Michael Wood-Vasey, Tim Jenness ]
            wmwood-vasey Michael Wood-Vasey made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            wmwood-vasey Michael Wood-Vasey made changes -
            Link This issue is blocked by DM-4957 [ DM-4957 ]
            wmwood-vasey Michael Wood-Vasey made changes -
            Story Points 1
            wmwood-vasey Michael Wood-Vasey made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Done [ 10002 ]

              People

              Assignee:
              wmwood-vasey Michael Wood-Vasey
              Reporter:
              frossie Frossie Economou
              Watchers:
              David Nidever [X] (Inactive), Dominique Boutigny, Frossie Economou, Michael Wood-Vasey, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.