Just write down the model carefully, identifying free parameters, labeled cameraGeom systems, and FITS WCS frames like "intermediate world coordinates". Then take derivatives w.r.t. our desired parameters. Is the model linear? Can we make it linear via some transformation, or by fitting for sky-to-pixels instead of pixels-to-sky first? This may be useful for
DM-19734 and DM-19735 as well.