Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-35779

Document the M2 Python EUI

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ts_main_telescope
    • Labels:

      Description

      Document the M2 Python EUI and publish to lsst.io.

        Attachments

          Issue Links

            Activity

            Hide
            ttsai Te-Wei Tsai added a comment - - edited

            I did the documentation and published to ts-m2gui.lsst.io by the Jenkinsfile.

            In the local docker container, all unit tests work well.

            I tried to do the unit test in Jenkins instance but I could not make it work by Xvfb. I setup a Jenkins instance on my linux desktop and did some experiment. However, I always got the error in the test.

            I could not test the Python script that is unrelated to the Qt as well.

            Failed message:

            + pytest tests/nongui/ --cov-report html --cov=lsst.ts.m2gui --junitxml=jenkinsReport/report.xml
            ============================= test session starts ==============================
            platform linux -- Python 3.10.5, pytest-7.1.2, pluggy-1.0.0
            PySide2 5.13.2 -- Qt runtime 5.12.9 -- Qt compiled 5.12.9
            rootdir: /home/jenkins/workspace/d-Site_ts_m2gui_tickets_DM-35779, configfile: setup.cfg
            plugins: asdf-2.10.1, hypothesis-6.47.1, arraydiff-0.3, astropy-0.10.0, astropy-header-0.1.2, cov-3.0.0, doctestplus-0.12.0, filter-subpackage-0.1.1, flake8-1.1.1, forked-1.4.0, mock-3.8.2, openfiles-0.5.0, remotedata-0.3.3, session2file-0.1.11, subtests-0.8.0, xdist-2.5.0, qt-4.1.0, anyio-3.6.1, asyncio-0.18.3, black-0.3.12, mypy-0.8.0, tornasync-0.6.0.post2
            asyncio: mode=legacy
            collected 62 items
             
            tests/nongui/test_fault_manager.py ..Fatal Python error: Aborted
             
            Current thread 0x00007fb9f3782740 (most recent call first):
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pytestqt/plugin.py", line 66 in qapp
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 890 in call_fixture_func
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 1111 in pytest_fixture_setup
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 1057 in execute
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 659 in _compute_fixture_value
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 573 in _get_active_fixturedef
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 554 in getfixturevalue
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 541 in _fillfixtures
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/python.py", line 1764 in setup
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 491 in setup
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 154 in pytest_runtest_setup
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 259 in <lambda>
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 338 in from_call
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 258 in call_runtest_hook
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 219 in call_and_report
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 124 in runtestprotocol
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 111 in pytest_runtest_protocol
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 347 in pytest_runtestloop
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 322 in _main
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 268 in wrap_session
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 315 in pytest_cmdline_main
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/config/__init__.py", line 164 in main
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/config/__init__.py", line 187 in console_main
              File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/bin/pytest", line 11 in <module>
             
            Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg.lapack_lite, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, yaml._yaml, erfa.ufunc, mypy, mypy.api, tornado.speedups, shiboken2.shiboken2, PySide2.QtCore, PySide2.QtGui, PySide2.QtWidgets, PySide2.QtTest, PySide2.QtCharts (total: 25)
            /home/jenkins/workspace/d-Site_ts_m2gui_tickets_DM-35779@tmp/durable-e7a0e7f6/script.sh: line 9:   599 Aborted                 (core dumped) pytest tests/nongui/ --cov-report 
            

            Show
            ttsai Te-Wei Tsai added a comment - - edited I did the documentation and published to ts-m2gui.lsst.io by the Jenkinsfile . In the local docker container, all unit tests work well. I tried to do the unit test in Jenkins instance but I could not make it work by Xvfb . I setup a Jenkins instance on my linux desktop and did some experiment. However, I always got the error in the test. I could not test the Python script that is unrelated to the Qt as well. Failed message: + pytest tests/nongui/ --cov-report html --cov=lsst.ts.m2gui --junitxml=jenkinsReport/report.xml ============================= test session starts ============================== platform linux -- Python 3.10.5, pytest-7.1.2, pluggy-1.0.0 PySide2 5.13.2 -- Qt runtime 5.12.9 -- Qt compiled 5.12.9 rootdir: /home/jenkins/workspace/d-Site_ts_m2gui_tickets_DM-35779, configfile: setup.cfg plugins: asdf-2.10.1, hypothesis-6.47.1, arraydiff-0.3, astropy-0.10.0, astropy-header-0.1.2, cov-3.0.0, doctestplus-0.12.0, filter-subpackage-0.1.1, flake8-1.1.1, forked-1.4.0, mock-3.8.2, openfiles-0.5.0, remotedata-0.3.3, session2file-0.1.11, subtests-0.8.0, xdist-2.5.0, qt-4.1.0, anyio-3.6.1, asyncio-0.18.3, black-0.3.12, mypy-0.8.0, tornasync-0.6.0.post2 asyncio: mode=legacy collected 62 items   tests/nongui/test_fault_manager.py ..Fatal Python error: Aborted   Current thread 0x00007fb9f3782740 (most recent call first): File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pytestqt/plugin.py", line 66 in qapp File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 890 in call_fixture_func File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 1111 in pytest_fixture_setup File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__ File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 1057 in execute File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 659 in _compute_fixture_value File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 573 in _get_active_fixturedef File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 554 in getfixturevalue File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/fixtures.py", line 541 in _fillfixtures File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/python.py", line 1764 in setup File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 491 in setup File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 154 in pytest_runtest_setup File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__ File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 259 in <lambda> File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 338 in from_call File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 258 in call_runtest_hook File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 219 in call_and_report File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 124 in runtestprotocol File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/runner.py", line 111 in pytest_runtest_protocol File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__ File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 347 in pytest_runtestloop File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__ File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 322 in _main File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 268 in wrap_session File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/main.py", line 315 in pytest_cmdline_main File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_callers.py", line 39 in _multicall File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_manager.py", line 80 in _hookexec File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/pluggy/_hooks.py", line 265 in __call__ File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/config/__init__.py", line 164 in main File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/lib/python3.10/site-packages/_pytest/config/__init__.py", line 187 in console_main File "/opt/lsst/software/stack/conda/envs/lsst-scipipe-4.1.0/bin/pytest", line 11 in <module>   Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg.lapack_lite, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, yaml._yaml, erfa.ufunc, mypy, mypy.api, tornado.speedups, shiboken2.shiboken2, PySide2.QtCore, PySide2.QtGui, PySide2.QtWidgets, PySide2.QtTest, PySide2.QtCharts (total: 25) /home/jenkins/workspace/d-Site_ts_m2gui_tickets_DM-35779@tmp/durable-e7a0e7f6/script.sh: line 9: 599 Aborted (core dumped) pytest tests/nongui/ --cov-report
            Hide
            ttsai Te-Wei Tsai added a comment -

            After the tests, I created the DM-35876 for the support of unit test.

            Show
            ttsai Te-Wei Tsai added a comment - After the tests, I created the DM-35876 for the support of unit test.
            Hide
            ttsai Te-Wei Tsai added a comment -

            Please help to review the PR:
            https://github.com/lsst-ts/ts_m2gui/pull/16

            Thanks!

            Show
            ttsai Te-Wei Tsai added a comment - Please help to review the PR: https://github.com/lsst-ts/ts_m2gui/pull/16 Thanks!
            Hide
            ecoughlin Eric Coughlin added a comment -

            Reviewed in GitHub.

            Show
            ecoughlin Eric Coughlin added a comment - Reviewed in GitHub.

              People

              Assignee:
              ttsai Te-Wei Tsai
              Reporter:
              ttsai Te-Wei Tsai
              Reviewers:
              Eric Coughlin
              Watchers:
              Eric Coughlin, Te-Wei Tsai
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.