Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14793

Define procedures for training/validating photometric redshifts in DRP



    • Type: Story
    • Status: Invalid
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: DM Subsystem Science
    • Labels:
    • Team:
      DM Science


      In trying to define a test script for LVV-T16, I was reminded that we may not be able to "just run" an externally-developed photometric redshift code during DRP; many modern photometric redshift codes require some kind of training step, which typically requires as input both photometry from the survey for which redshifts are being estimated and a sample of spectroscopic or otherwise more secure redshift estimates for a subset of the catalog.  Furthermore, there are frequently multiple cycles of training, estimation, and validation before the release of any particular photometric redshift catalog.

      The work of collecting, curating, and standardizing spectroscopic training data is (to my understanding) beyond the scope of DM, but DM outputs are also needed inputs to this training step.  At some level, I believe that train/estimate/validate iteration is also outside DM scope; all I think we've signed up for is a final "estimation" step, which cannot be done in isolation.

      The only way I see to resolve this without increasing DM scope or delaying the release of photometric redshifts until well after each main DR would be to define a procedure that involves the external scientists responsible for photometric redshift estimation directly in the data release process itself.

      Note: I don't recall any mention of this in DMTN-049, but I should read again to check.


          Issue Links


            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Risk Score 0
            jbosch Jim Bosch made changes -
            Link This issue duplicates DM-6367 [ DM-6367 ]
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status To Do [ 10001 ] Invalid [ 11005 ]


              Unassigned Unassigned
              jbosch Jim Bosch
              Jim Bosch, Leanne Guy, Melissa Graham, Robert Lupton, Zeljko Ivezic
              0 Vote for this issue
              5 Start watching this issue