Details

    • Type: Technical task
    • Status: Invalid
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Team:
      Data Access and Database

      Description

      We are preparing to release the new lsst-dev-db.ncsa.illinois.edu database server to replace the current lsst-db. This ticket is to ask recommendations of configuration and possible changes to the new server. I’m targeting either our Dec 14 or Jan 18 planned maintenance for this release.

      lsst-dev-db can be accessed via SSH from any LSST server at NCSA. It is running the latest version of MariaDB 10.1 available from MariaDB's yum repositories. Currently it has no specific configuration tuning or optimizations in place.

      The new server is named lsst-dev-db.ncsa.illinois.edu to better reflect it’s intended purpose. Once this server is ready to go live, we’ll redirect the hostnames lsst-db & lsst10 to point to the new server.

      Can you or someone on your team help vet and optimize this new server? It currently has a copy of lsst-db data from November 15, 2017.

      Could you help with recommending the following?

      • Any MariaDB 10.1 tuning & optimizations that would make sense.
      • If MySQLdb / MySQL-Python needs to be installed.
      • If the scisql tools need to be installed/updated.
      • If any other UDFs need to be installed/updated.

      Also, I’d like to start addressing the following issues:

      • 5.7/10.1 requires updated user password formats (currently disabling secure_auth option to allow existing passwords). We need a plan for users to upgrade their passwords.
      • Can we push forward with SSL encrypted sessions?
      • And/or can we switch authentication over to NCSA/LSST LDAP?

        Attachments

          Issue Links

            Activity

            Hide
            gapon Igor Gaponenko added a comment -

            Works for me. I could see my data, create databases, tables, insert, delete, etc.

            Show
            gapon Igor Gaponenko added a comment - Works for me. I could see my data, create databases, tables, insert, delete, etc.
            Hide
            bglick Bill Glick [X] (Inactive) added a comment -

            All testing of the new lsst-dev-db.ncsa.illinois.edu MySQL server has gone well. No problems have been reported.

            We plan to swap in this new server to replace the current one during the scheduled December 14, 2017 PM window. The new server will remain called lsst-dev-db.ncsa.illinois.edu, while lsst10.ncsa.illinois.edu and lsst-db.ncsa.illinois.edu will be CNAMEs to the same host. During the December PM, the following will happen:

            1. MySQL on the current lsst10.ncsa.illinois.edu will be shut down
            2. Data will be synced over to the new lsst-dev-db.ncsa.illinois.edu
            3. Rename and turn off lsst10.ncsa.illinois.edu
            4. Databases imported into MariaDB 10.0 on lsst-dev-db.ncsa.illinois.edu
            5. Upgrade to MariaDB10.1
            6. Upgrade to MariaDB10.2
            7. Install sciSQL
            8. Test the installation
            9. Update lsst-db.ncsa.illinois.edu & lsst10.ncsa.illinois.edu to be CNAMEs to lsst-dev-db.ncsa.illinois.edu

            Let me know if you want to test anything more before this switch over, or if you foresee any issues.

            Show
            bglick Bill Glick [X] (Inactive) added a comment - All testing of the new lsst-dev-db.ncsa.illinois.edu MySQL server has gone well. No problems have been reported. We plan to swap in this new server to replace the current one during the scheduled December 14, 2017 PM window. The new server will remain called lsst-dev-db.ncsa.illinois.edu , while lsst10.ncsa.illinois.edu and lsst-db.ncsa.illinois.edu will be CNAMEs to the same host. During the December PM, the following will happen: MySQL on the current lsst10.ncsa.illinois.edu will be shut down Data will be synced over to the new lsst-dev-db.ncsa.illinois.edu Rename and turn off lsst10.ncsa.illinois.edu Databases imported into MariaDB 10.0 on lsst-dev-db.ncsa.illinois.edu Upgrade to MariaDB10.1 Upgrade to MariaDB10.2 Install sciSQL Test the installation Update lsst-db.ncsa.illinois.edu & lsst10.ncsa.illinois.edu to be CNAMEs to lsst-dev-db.ncsa.illinois.edu Let me know if you want to test anything more before this switch over, or if you foresee any issues.
            Hide
            bglick Bill Glick [X] (Inactive) added a comment -

            lsst-db has now been migrated to the new lsst-dev-db.ncsa.illinois.edu server.

            Show
            bglick Bill Glick [X] (Inactive) added a comment - lsst-db has now been migrated to the new lsst-dev-db.ncsa.illinois.edu server.
            Hide
            tjenness Tim Jenness added a comment -

            Fritz Mueller can I assume that this ticket is now done or irrelevant?

            Show
            tjenness Tim Jenness added a comment - Fritz Mueller can I assume that this ticket is now done or irrelevant?
            Hide
            bglick Bill Glick [X] (Inactive) added a comment -

            fyi... lsst-dev-db.ncsa.illinois.edu was turned off on October 1, 2020. 

            So, I assume this ticket is now irrelevant.

            Show
            bglick Bill Glick [X] (Inactive) added a comment - fyi... lsst-dev-db.ncsa.illinois.edu was turned off on October 1, 2020.  So, I assume this ticket is now irrelevant.

              People

              Assignee:
              fritzm Fritz Mueller
              Reporter:
              bglick Bill Glick [X] (Inactive)
              Watchers:
              Andy Salnikov, Bill Glick [X] (Inactive), Brian Van Klaveren, Fritz Mueller, Greg Daues, Igor Gaponenko, James Basney, Kian-Tat Lim, Steve Pietrowicz, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.