Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-30055

There is still a tiny Gen2 vs Gen3 AP COSMOS CI difference

    XMLWordPrintable

Details

    • Story
    • Status: Won't Fix
    • Resolution: Done
    • None
    • ap_verify

    Description

      Turning on doScaleDiffimVariance across the board fixed HiTS. Making sure doBrighterFatter is the same for Gen2 and Gen3 fixed most - but not quite all - of HSC/COSMOS. Both of those things happened in DM-29344. However, chronograf shows the ratio of DIA to direct sources is still ever-so-slightly different.

      The ratio is 4.81 for Gen2 and 4.75 for Gen3 (visit 59160, detector 51)

      The ratio is 7.29 for Gen2 and 7.20 for Gen3 (visit 59150, detector 50)

      Whyyy.

      Attachments

        Issue Links

          Activity

            Thanks Lauren. Those are indeed the only two visit+detector combos in the CI dataset, and what you found jives with what I expected. What do you think ebellm - is this "close enough to identical" or in need of further examination?

            mrawls Meredith Rawls added a comment - Thanks Lauren. Those are indeed the only two visit+detector combos in the CI dataset, and what you found jives with what I expected. What do you think ebellm - is this "close enough to identical" or in need of further examination?
            ebellm Eric Bellm added a comment -

            cmorrison indicated he saw floating-point differences when reading the raws--if he can isolate that let's spawn a new middleware ticket and close this one.

            ebellm Eric Bellm added a comment - cmorrison indicated he saw floating-point differences when reading the raws--if he can isolate that let's spawn a new middleware ticket and close this one.
            sullivan Ian Sullivan added a comment -

            Could this be due to the issue resolved in DM-30030?

            sullivan Ian Sullivan added a comment - Could this be due to the issue resolved in DM-30030 ?
            lauren Lauren MacArthur added a comment - - edited

            When I did the comparison noted above, it included:

            • calexp image arrays (image, variance, mask planes)
            • calexp photoCalib objects
            • calexp PSFs
            • calexp WCSs
            • every column in the source tables

            which, modulo the deblend_peakId caveat, were all identical.  As such, I don’t think  either of the previous conjectures could be at play.

            lauren Lauren MacArthur added a comment - - edited When I did the comparison noted above, it included: calexp image arrays (image, variance, mask planes) calexp photoCalib objects calexp PSFs calexp WCSs every column in the source tables which, modulo the  deblend_peakId caveat, were all identical.  As such, I don’t  think   either of the previous conjectures could be at play.

            Gen 2 CI for AP has been turned off, so we are no longer planning to track down this difference.

            sullivan Ian Sullivan added a comment - Gen 2 CI for AP has been turned off, so we are no longer planning to track down this difference.

            People

              Unassigned Unassigned
              mrawls Meredith Rawls
              Eric Bellm, Ian Sullivan, Krzysztof Findeisen, Lauren MacArthur, Meredith Rawls
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.