datasetIngest-gen3 INFO: Ingesting raw images... datasetIngest-gen3.ingester INFO: Successfully extracted metadata from 2 files with 0 failures datasetIngest-gen3.ingester INFO: Exposure HSC:HSCA05916000 ingested successfully datasetIngest-gen3.ingester INFO: Exposure HSC:HSCA05915000 ingested successfully datasetIngest-gen3.ingester INFO: Successfully processed data from 2 exposures with 0 failures from exposure registration and 0 failures from file ingest. datasetIngest-gen3.ingester INFO: Ingested 2 distinct Butler datasets datasetIngest-gen3 INFO: Images are now ingested in /project/yusra/party/ap_verify/ap_verify_ci/repo datasetIngest-gen3 INFO: Defining visits... datasetIngest-gen3.visitDefiner INFO: Preprocessing data IDs. datasetIngest-gen3.visitDefiner INFO: Registering visit_system 0: one-to-one. datasetIngest-gen3.visitDefiner INFO: Grouping 2 exposure(s) into visits. datasetIngest-gen3.visitDefiner INFO: Computing regions and other metadata for 2 visit(s). datasetIngest-gen3 INFO: Storing data-specific configs... datasetIngest-gen3 INFO: Configs are now stored in /project/yusra/party/ap_verify/ap_verify_ci/config ap.verify.ingestion.ingestDataset INFO: Data ingested ap.verify.ap_verify.main INFO: Running pipeline... ctrl.mpexec.cmdLineFwk INFO: QuantumGraph contains 57 quanta for 29 tasks, graph ID: '1618442505.029387-649849' conda.common.io INFO: overtaking stderr and stdout conda.common.io INFO: stderr and stdout yielding back Error cleaning LFS object: open /project/shared/data/test_data/testdata_ci_hsc/.git/lfs/tmp/264910847: permission denied error: external filter 'git-lfs filter-process' failed fatal: jointcal/jointcal_photoCalibCatalog-0903334.fits: clean filter 'lfs' failed isr WARN: Constructing linearizer from cameraGeom information. isr INFO: Converting exposure to floating point values. isr INFO: Assembling CCD from amplifiers. isr INFO: Applying bias correction. isr INFO: Applying linearizer. isr INFO: Applying crosstalk correction. isr.crosstalk INFO: Applying crosstalk correction. isr INFO: Masking defects. isr INFO: Masking non-finite (NAN, inf) value pixels. isr INFO: Widening saturation trails. isr INFO: Applying brighter-fatter correction using kernel type / gains . isr INFO: Finished brighter-fatter correction in 3 iterations. isr INFO: Ensuring image edges are masked as EDGE to the brighter-fatter kernel size. isr INFO: Growing masks to account for brighter-fatter kernel convolution. isr INFO: Applying dark correction. isr INFO: Applying flat correction. isr INFO: Applying fringe correction after flat. isr.fringe INFO: Filter not found in FringeTaskConfig.filters. Skipping fringe correction. isr INFO: Constructing Vignette polygon. isr INFO: Adding transmission curves. isr INFO: Set 347022 BAD pixels to 766.337524. isr INFO: Interpolating masked pixels. isr WARN: No rough magnitude zero point set for filter FilterLabel(band="g", physical="HSC-G"). isr INFO: Setting rough magnitude zero point: 34.192803 isr INFO: Measuring background level. isr INFO: Flattened sky level: 766.312927 +/- 13.553717. isr INFO: Measuring sky levels in 8x16 grids: 765.690789. isr INFO: Sky flatness in 8x16 grids - pp: 0.021951 rms: 0.003070. ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'isr' on quantum {instrument: 'HSC', detector: 50, exposure: 59150, ...} took 21.747 seconds ctrl.mpexec.mpGraphExecutor INFO: Executed 1 quanta, 56 remain out of total 57 quanta. ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'timing_isr' on quantum {instrument: 'HSC', detector: 50, exposure: 59150, ...} took 0.072 seconds ctrl.mpexec.mpGraphExecutor INFO: Executed 2 quanta, 55 remain out of total 57 quanta. characterizeImage WARN: Source catalog detected and measured with placeholder or default PSF characterizeImage.repair INFO: Identified 609 cosmic rays. characterizeImage.detection INFO: Detected 1274 positive peaks in 373 footprints and 0 negative peaks in 0 footprints to 50 sigma characterizeImage.detection INFO: Resubtracting the background after object detection characterizeImage.measurement INFO: Measuring 373 sources (373 parents, 0 children) characterizeImage.measurePsf INFO: Measuring PSF characterizeImage.measurePsf INFO: PSF star selector found 69 candidates characterizeImage.measurePsf.reserve INFO: Reserved 14/69 sources characterizeImage.measurePsf INFO: Sending 55 candidates to PSF determiner characterizeImage.measurePsf.psfDeterminer WARN: NOT scaling kernelSize by stellar quadrupole moment, but using absolute value characterizeImage.measurePsf INFO: PSF determination using 53/55 stars. characterizeImage INFO: iter 1; PSF sigma=1.95, dimensions=(41, 41); median background=765.46 characterizeImage WARN: Source catalog detected and measured with placeholder or default PSF characterizeImage.repair INFO: Identified 529 cosmic rays. characterizeImage.detection INFO: Detected 1015 positive peaks in 332 footprints and 0 negative peaks in 0 footprints to 50 sigma characterizeImage.detection INFO: Resubtracting the background after object detection characterizeImage.measurement INFO: Measuring 332 sources (332 parents, 0 children) characterizeImage.measurePsf INFO: Measuring PSF characterizeImage.measurePsf INFO: PSF star selector found 66 candidates characterizeImage.measurePsf.reserve INFO: Reserved 13/66 sources characterizeImage.measurePsf INFO: Sending 53 candidates to PSF determiner characterizeImage.measurePsf.psfDeterminer WARN: NOT scaling kernelSize by stellar quadrupole moment, but using absolute value characterizeImage.measurePsf INFO: PSF determination using 51/53 stars. characterizeImage INFO: iter 2; PSF sigma=1.95, dimensions=(41, 41); median background=765.40 characterizeImage.repair INFO: Identified 566 cosmic rays. characterizeImage.measurement INFO: Measuring 332 sources (332 parents, 0 children) characterizeImage.measureApCorr INFO: Measuring aperture corrections for 23 flux fields characterizeImage.measureApCorr.sourceSelector INFO: Selected 26/332 sources characterizeImage.measureApCorr INFO: Aperture correction for base_GaussianFlux: RMS 0.015163 from 26 characterizeImage.measureApCorr INFO: Aperture correction for base_PsfFlux: RMS 0.016973 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_0_3_3: RMS 0.030310 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_0_4_5: RMS 0.020088 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_0_6_0: RMS 0.015078 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_0_kron: RMS 0.004237 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_1_3_3: RMS 0.032163 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_1_4_5: RMS 0.020807 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_1_6_0: RMS 0.015124 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_1_kron: RMS 0.003851 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_2_3_3: RMS 0.042245 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_2_4_5: RMS 0.023819 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_2_6_0: RMS 0.016085 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_2_kron: RMS 0.001624 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_3_3_3: RMS 0.054572 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_3_4_5: RMS 0.027253 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_3_6_0: RMS 0.017252 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_convolved_ConvolvedFlux_3_kron: RMS 0.006200 from 26 characterizeImage.measureApCorr INFO: Aperture correction for ext_photometryKron_KronFlux: RMS 0.004237 from 26 characterizeImage.measureApCorr INFO: Aperture correction for modelfit_CModel: RMS 0.014388 from 26 characterizeImage.measureApCorr INFO: Aperture correction for modelfit_CModel_dev: RMS 0.014221 from 26 characterizeImage.measureApCorr INFO: Aperture correction for modelfit_CModel_exp: RMS 0.014833 from 26 characterizeImage.measureApCorr INFO: Aperture correction for modelfit_CModel_initial: RMS 0.013554 from 26 characterizeImage.applyApCorr INFO: Applying aperture corrections to 23 instFlux fields characterizeImage.computeSummaryStats INFO: Measuring exposure statistics ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'characterizeImage' on quantum {instrument: 'HSC', detector: 50, visit: 59150, ...} took 92.156 seconds ctrl.mpexec.mpGraphExecutor INFO: Executed 3 quanta, 54 remain out of total 57 quanta. ctrl.mpexec.singleQuantumExecutor INFO: Execution of task 'timing_characterizeImage' on quantum {instrument: 'HSC', detector: 50, visit: 59150, ...} took 0.387 seconds ctrl.mpexec.mpGraphExecutor INFO: Executed 4 quanta, 53 remain out of total 57 quanta. calibrate.detection INFO: Detected 3825 positive peaks in 2487 footprints and 18 negative peaks in 17 footprints to 5 sigma calibrate.detection INFO: Resubtracting the background after object detection calibrate.skySources INFO: Added 100 of 100 requested sky sources (100%) calibrate.deblend INFO: Deblending 2587 sources calibrate.deblend WARN: Parent 25404838930022452: skipping masked footprint (area: 209) calibrate.deblend WARN: Parent 25404838930022568: skipping masked footprint (area: 637) calibrate.deblend WARN: Parent 25404838930022584: skipping large footprint (area: 11591) calibrate.deblend WARN: Parent 25404838930022598: skipping masked footprint (area: 307) calibrate.deblend WARN: Parent 25404838930022599: skipping masked footprint (area: 903) calibrate.deblend WARN: Parent 25404838930022663: skipping masked footprint (area: 898) calibrate.deblend WARN: Parent 25404838930022742: skipping masked footprint (area: 408) calibrate.deblend WARN: Parent 25404838930022753: skipping masked footprint (area: 4286) calibrate.deblend WARN: Parent 25404838930022805: skipping masked footprint (area: 510) calibrate.deblend WARN: Parent 25404838930022815: skipping masked footprint (area: 648) calibrate.deblend WARN: Parent 25404838930022849: skipping masked footprint (area: 181) calibrate.deblend WARN: Parent 25404838930022863: skipping large footprint (area: 43595) calibrate.deblend WARN: Parent 25404838930022907: skipping masked footprint (area: 850) calibrate.deblend WARN: Parent 25404838930022936: skipping masked footprint (area: 454) calibrate.deblend WARN: Parent 25404838930022978: skipping masked footprint (area: 670) calibrate.deblend WARN: Parent 25404838930023061: skipping large footprint (area: 15067) calibrate.deblend WARN: Parent 25404838930023072: skipping large footprint (area: 29033) calibrate.deblend WARN: Parent 25404838930023128: skipping masked footprint (area: 1367) calibrate.deblend WARN: Parent 25404838930023194: skipping masked footprint (area: 274) calibrate.deblend WARN: Parent 25404838930023255: skipping masked footprint (area: 451) calibrate.deblend WARN: Parent 25404838930023261: skipping masked footprint (area: 235) calibrate.deblend WARN: Parent 25404838930023302: skipping masked footprint (area: 425) calibrate.deblend WARN: Parent 25404838930023438: skipping masked footprint (area: 537) calibrate.deblend WARN: Parent 25404838930023511: skipping large footprint (area: 34870) calibrate.deblend WARN: Parent 25404838930023554: skipping masked footprint (area: 260) calibrate.deblend WARN: Parent 25404838930023555: skipping masked footprint (area: 308) calibrate.deblend WARN: Parent 25404838930023586: skipping masked footprint (area: 847) calibrate.deblend WARN: Parent 25404838930023626: skipping masked footprint (area: 972) calibrate.deblend WARN: Parent 25404838930023711: skipping masked footprint (area: 628) calibrate.deblend WARN: Parent 25404838930023748: skipping masked footprint (area: 415) calibrate.deblend WARN: Parent 25404838930023804: skipping masked footprint (area: 513) calibrate.deblend WARN: Parent 25404838930023826: skipping masked footprint (area: 186) calibrate.deblend WARN: Parent 25404838930023888: skipping large footprint (area: 14174) calibrate.deblend WARN: Parent 25404838930023897: skipping masked footprint (area: 518) calibrate.deblend WARN: Parent 25404838930023907: skipping masked footprint (area: 1398) calibrate.deblend WARN: Parent 25404838930023930: skipping masked footprint (area: 3156) calibrate.deblend WARN: Parent 25404838930024038: skipping masked footprint (area: 632) calibrate.deblend WARN: Parent 25404838930024061: skipping masked footprint (area: 486) calibrate.deblend WARN: Parent 25404838930024092: skipping masked footprint (area: 540) calibrate.deblend WARN: Parent 25404838930024148: skipping masked footprint (area: 573) calibrate.deblend WARN: Parent 25404838930024277: skipping masked footprint (area: 668) calibrate.deblend WARN: Parent 25404838930024656: skipping large footprint (area: 13207) calibrate.deblend WARN: Parent 25404838930024806: skipping masked footprint (area: 269) calibrate.deblend WARN: Parent 25404838930024884: skipping masked footprint (area: 532) calibrate.deblend INFO: Deblended: of 2587 sources, 494 were deblended, creating 1283 children, total 3870 sources calibrate.measurement INFO: Measuring 3870 sources (2587 parents, 1283 children) calibrate.applyApCorr INFO: Applying aperture corrections to 3 instFlux fields calibrate INFO: Copying flags from icSourceCat to sourceCat for 236 sources calibrate.astrometry INFO: Purged 3515 sources, leaving 355 good sources calibrate INFO: Loading reference objects from region bounded by [149.74223657, 149.97408401], [2.15373028, 2.28660942] RA Dec calibrate INFO: Loaded 107 reference objects calibrate INFO: Correcting reference catalog for proper motion to