Details
-
Type:
Story
-
Status: To Do
-
Resolution: Unresolved
-
Fix Version/s: None
-
Component/s: jointcal
-
Story Points:4
-
Epic Link:
-
Sprint:AP S19-6, AP F19-1
-
Team:Alert Production
-
Urgent?:No
Description
In order to inform future improvements in jointcal's performance, we need to do some profiling on 10, 50, and 100 visits, to see how the performance of the different components (e.g. outlier rejection, matrix construction, solving) scale with the number of visits. In addition to the general profiling code in the stack, jointcal has a task-specific profiling option that separates the algorithm profiling from the data reading portion.
Hsin-Fang Chiang: do you know if there is a tract of data on lsst-dev that has roughly 100 visits in it? If we do not have 100 visits available on lsst-dev, we can use whatever tract has the largest number.
John Parejko as far as I know for HSC one of the largest numbers would be UD_COSMOS tract=9813 filter=HSC-Y which has 52 visits; see this table here
Or, the simulated LSST data from DC2 (at /datasets/DC2/repo/) has some tracts with >100 overlapping visits. For example, any filter of tract=4849. Some of those require really large memory to run.