Michelle Gower added a comment - 13/Oct/21 5:48 PM I didn't notice this with the (no bps) htcondor only tests I did for the previous transfer ticket because the executable didn't modify the sqlite file. So in the previous tests, it didn't bring back the sqlite file. After adding a "touch" to the script, the test did bring back the sqlite file. I double checked that Brock's jobs aren't bringing back the butler.yaml file which makes sense because that file isn't being modified by pipetask.

Michelle Gower added a comment - 13/Oct/21 5:54 PM From the HTCondor manual: To restrict the output files or permit entire directory contents to be transferred, specify the exact list with transfer_output_files . Delimit the list of file names, directory names, or paths with commas. When this list is defined, and any of the files or directories do not exist as the job exits, HTCondor considers this an error, and places the job on hold. Setting transfer_output_files to the empty string (“”) means no files are to be transferred. Tested the empty string with my updated (no bps) htcondor only test and that brings back the stdout/stderr but not the sqlite file.

Mikolaj Kowalik added a comment - 13/Oct/21 9:09 PM Changes approved, can be merged to the main branch.

Yusra AlSayyad added a comment - 27/Oct/21 7:48 PM Your backport request has been approved. See my longer comment on DM-32217 for more info on backporting