Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-1898

Consistency checking for table data CSS

    XMLWordPrintable

Details

    • Story
    • Status: Invalid
    • Resolution: Done
    • None
    • Qserv
    • None

    Description

      CSS data on tables/chunks/nodes is supposed to be consistent at all times. Would be nice to have a tool that verifies consistency, probably including checking actual worker state.

      Attachments

        Issue Links

          Activity

            The information about chunk location is stored by the new data loader, but the new data loader is not yet integrated with the integration tests (it will be through DM-2175). Also, we are still debating how the data distribution / replication system will store its information. So, implementing consistency checking feels a bit premature, I am removing this from Apr sprint.

            jbecla Jacek Becla (Inactive) added a comment - The information about chunk location is stored by the new data loader, but the new data loader is not yet integrated with the integration tests (it will be through DM-2175 ). Also, we are still debating how the data distribution / replication system will store its information. So, implementing consistency checking feels a bit premature, I am removing this from Apr sprint.

            fritzm  is this now obsolete with the loader work ?

            womullan Wil O'Mullane added a comment - fritzm   is this now obsolete with the loader work ?
            tjenness Tim Jenness added a comment -

            fritzm is this now obsolete? (question asked back in 2019).

            tjenness Tim Jenness added a comment - fritzm is this now obsolete? (question asked back in 2019).

            Yes, now obsolete. The new data loader (ingest system) is fully integrated, covered in integration tests, and does its own ongoing consistency checks on this information.

            fritzm Fritz Mueller added a comment - Yes, now obsolete. The new data loader (ingest system) is fully integrated, covered in integration tests, and does its own ongoing consistency checks on this information.

            People

              Unassigned Unassigned
              salnikov Andy Salnikov
              Andy Salnikov, Fritz Mueller, Jacek Becla (Inactive), Tim Jenness, Wil O'Mullane
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.