Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14277

Fix dataset names in squash and add ability to ignore a particular dataset

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Attachments

        Issue Links

          Activity

          Hide
          afausti Angelo Fausti added a comment - - edited

          Queries applied in SQuaSH demo and production databases:

           

           
          angelofausti@plasma-geode-127520:~$ gcloud sql connect squash-db-demo --user=proxyuser
          MySQL [(none)]> use squash
           
          # Update old jobs with the proper dataset name
          MySQL [squash]> update job set ci_dataset='validation_data_cfht' where ci_dataset='cfht';
          MySQL [squash]> update job set ci_dataset='validation_data_hsc' where ci_dataset='hsc';
           
          # Recover one job that was uploaded to SQuaSH with ci_dataset='unkown' 
          MySQL [squash]> update job set ci_dataset='validation_data_hsc' where ci_dataset='unknown';
          MySQL [squash]> update job set ci_dataset='validation_data_cfht' where job.id=1240;
           
          # These are jobs from a test Jenkins instance that should be removed 
          MySQL [squash]> update job set ci_dataset='unknown' where job.id=1140;
          MySQL [squash]> update job set ci_dataset='unknown' where job.id=1142;
          MySQL [squash]> update job set ci_dataset='unknown' where job.id=1138;
          

           

          Show
          afausti Angelo Fausti added a comment - - edited Queries applied in SQuaSH demo  and production databases:     angelofausti@plasma-geode-127520:~$ gcloud sql connect squash-db-demo --user=proxyuser MySQL [(none)]> use squash   # Update old jobs with the proper dataset name MySQL [squash]> update job set ci_dataset='validation_data_cfht' where ci_dataset='cfht'; MySQL [squash]> update job set ci_dataset='validation_data_hsc' where ci_dataset='hsc';   # Recover one job that was uploaded to SQuaSH with ci_dataset='unkown' MySQL [squash]> update job set ci_dataset='validation_data_hsc' where ci_dataset='unknown'; MySQL [squash]> update job set ci_dataset='validation_data_cfht' where job.id=1240;   # These are jobs from a test Jenkins instance that should be removed MySQL [squash]> update job set ci_dataset='unknown' where job.id=1140; MySQL [squash]> update job set ci_dataset='unknown' where job.id=1142; MySQL [squash]> update job set ci_dataset='unknown' where job.id=1138;  
          Hide
          afausti Angelo Fausti added a comment - - edited

          Change in api_helper.py method:

                  # Datasets
                  self.datasets = self.get_datasets(default="validation_data_cfht",
                                                    ignore=["decam", "unknown"])
          

          Show
          afausti Angelo Fausti added a comment - - edited Change in api_helper.py method: # Datasets self.datasets = self.get_datasets(default="validation_data_cfht", ignore=["decam", "unknown"])
          Hide
          afausti Angelo Fausti added a comment -

          Production instance was updated and display the datasets correctly https://squash.lsst.codes/

          Show
          afausti Angelo Fausti added a comment - Production instance was updated and display the datasets correctly https://squash.lsst.codes/

            People

            • Assignee:
              afausti Angelo Fausti
              Reporter:
              afausti Angelo Fausti
              Watchers:
              Angelo Fausti
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel