Details
-
Type:
Improvement
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Labels:None
-
Story Points:2
-
Epic Link:
-
Sprint:AP F19-6 (November)
-
Team:Alert Production
Description
Chris Morrison [X] asked to get time stamps for the start and end of an ap_verify job (excluding metric calculation, if possible). Find a way to do so; probably the StartUtc and EndUtc values logged by pipe.base.timeMethod.
Attachments
Issue Links
- relates to
-
DM-22479 SQuaSH being spammed with timestamps
- Done
While the StartUtc and EndUtc metadata do the job (format looks like 2019-11-13T19:24:16.151550), they can't be turned into metrics because metrics need to be Astropy quantities, and therefore floating-point scalars.
One option is to add the end time as metadata to the measurements themselves. This is flexible, but will read a bit awkwardly in inspect_job.py:
ap_pipe.ApPipeTime = 69.0439 s ({'estimator': 'pipe.base.timeMethod', 'end': '2019-11-13T19:24:16.151550'})
pipe_tasks.ProcessCcdTime = 18.4718 s ({'estimator': 'pipe.base.timeMethod', 'end': '2019-11-13T19:24:10.052496'})
Depending on what you need the time stamps for, it might be easier to read them directly from the Butler (i.e., get("apPipe_metadata", dataId)). Does this option work better for you, or does the info need to be inside the .json files?