Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17171

MySQL TIER tests using separate table spaces

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ts_middleware
    • Labels:

      Description

      Try to use table spaces to allocate tables in different disks for TIER purposes. This seems to be a better solution than having multiple instances (one for each TIER).

      This test will be performed in a virtualized environment.

        Attachments

          Activity

          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          It seems that the use of tablespaces doesn't store everything in the tablespace directory and will complicate management during operation as the size and amount of the data files needs to be pre-defined. Having multiple instances seems to be a good solution and recommended when having standard mysql (https://dev.mysql.com/doc/refman/8.0/en/multiple-data-directories.html ), I couldn't find a good reference for this point for the ndb cluster. 

           

          Show
          aanania Andres Anania [X] (Inactive) added a comment - It seems that the use of tablespaces doesn't store everything in the tablespace directory and will complicate management during operation as the size and amount of the data files needs to be pre-defined. Having multiple instances seems to be a good solution and recommended when having standard mysql ( https://dev.mysql.com/doc/refman/8.0/en/multiple-data-directories.html  ), I couldn't find a good reference for this point for the ndb cluster.   
          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          Added comments and added configurations in: https://confluence.lsstcorp.org/display/LTS/MySQL+cluster+setup

          Currently reviewing with Andres Villalobos [X] for puppet deployment

          Show
          aanania Andres Anania [X] (Inactive) added a comment - Added comments and added configurations in: https://confluence.lsstcorp.org/display/LTS/MySQL+cluster+setup Currently reviewing with Andres Villalobos [X] for puppet deployment
          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          To test ssh to 139.229.236.200 then do the following commands:

          cd lsst_devops/nodes/

          vagrant ssh ts-efd-data-01

          sudo su -

          cd /home/vagrant/

          du -h --max-depth=1 /mnt

          You will see the directory sizes, now you can fill each instance with data and see how they increase in size depending on the port:

          python fillTables.py 3308 > NULL  # For TIER1

          du -h --max-depth=1 /mnt**

          python fillTables.py 3309 > NULL  # For TIER2**

          du -h --max-depth=1 /mnt**

          Show
          aanania Andres Anania [X] (Inactive) added a comment - To test ssh to 139.229.236.200 then do the following commands: cd lsst_devops/nodes/ vagrant ssh ts-efd-data-01 sudo su - cd /home/vagrant/ du -h --max-depth=1 /mnt You will see the directory sizes, now you can fill each instance with data and see how they increase in size depending on the port: python fillTables.py 3308 > NULL  # For TIER1 du -h --max-depth=1 /mnt ** python fillTables.py 3309 > NULL  # For TIER2 ** du -h --max-depth=1 /mnt **
          Hide
          dmills Dave Mills added a comment -

          IP is 139.229.136.200

          Show
          dmills Dave Mills added a comment - IP is 139.229.136.200
          Hide
          dmills Dave Mills added a comment -

          Tested with suggested commands. Tier storage reports increased as expected

          Show
          dmills Dave Mills added a comment - Tested with suggested commands. Tier storage reports increased as expected
          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          Done

          Show
          aanania Andres Anania [X] (Inactive) added a comment - Done
          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          done

          Show
          aanania Andres Anania [X] (Inactive) added a comment - done

            People

            Assignee:
            aanania Andres Anania [X] (Inactive)
            Reporter:
            aanania Andres Anania [X] (Inactive)
            Reviewers:
            Dave Mills
            Watchers:
            Andres Anania [X] (Inactive), Andres Villalobos [X] (Inactive), Dave Mills, Michael Reuter
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Start date:
              End date:

                Jenkins

                No builds found.