Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18388

Learn script queue

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Sprint:
      TSSW Sprint - Mar 18 - Mar 30
    • Team:
      Telescope and Site

      Description

        Attachments

          Activity

          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          Read LSE-836, got the main idea and purpose of the script queue. Still need to test to complete this task.

          Show
          aanania Andres Anania [X] (Inactive) added a comment - Read LSE-836, got the main idea and purpose of the script queue. Still need to test to complete this task.
          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          I run the queue container with the examples from: 

          https://confluence.lsstcorp.org/display/LTS/Running+the+script+queue+with+containers

           

          I was able to run the queue + also run the request_script.py -vvv 1 for testing....

          I got some support from Tiago because the results you get are not exactly the same you find in confluence and it seems that everything worked fine.

           

          Show
          aanania Andres Anania [X] (Inactive) added a comment - I run the queue container with the examples from:  https://confluence.lsstcorp.org/display/LTS/Running+the+script+queue+with+containers   I was able to run the queue + also run the  request_script.py  -vvv  1 for testing.... I got some support from Tiago because the results you get are not exactly the same you find in confluence and it seems that everything worked fine.  
          Hide
          aanania Andres Anania [X] (Inactive) added a comment -

          Tiago Ribeiro [5:39 PM]
          ok… after `docker run`, can you verify that you can run `run_script_queue.py -h`?

          Andres Anania [5:39 PM]

           

          ```[saluser@4a285f41aeb0 ~]$ run_script_queue.py -h
          Could not import lsstcppimport; please ensure the base package has been built (not just setup).
          usage: Start the ScriptQueue [-h] [--verbose] index standardpath externalpath
          positional arguments:
           index ScriptQueue CSC index: 1 for Main, 2 for AuxTel
           standardpath Path to standard SAL scripts
           externalpath Path to external SAL scripts
          optional arguments:
           -h, --help show this help message and exit
           --verbose Print diagnostic information to stdout```
          (edited)
          

           

          Tiago Ribeiro [5:39 PM]
          ok….
          and `run_script_queue.py 1 ~/repos/ts_scriptqueue/tests/data/standard/ ~/repos/ts_scriptqueue/tests/data/external/`?

          Andres Anania [5:40 PM]

          ```[saluser@4a285f41aeb0 ~]$ run_script_queue.py 1 ~/repos/ts_scriptqueue/tests/data/standard/ ~/repos/ts_scriptqueue/tests/data/external/
          Could not import lsstcppimport; please ensure the base package has been built (not just setup).```
          (edited)

           

          Tiago Ribeiro [5:40 PM]
          ok… can you start the next container?

          Andres Anania [5:41 PM]
          `sudo docker run -it -e LSST_DDS_DOMAIN="my_test" --name script lsst/queue:latest` (edited)

          Tiago Ribeiro [5:41 PM]
          yeap

          Andres Anania [5:41 PM]
          done

          Tiago Ribeiro [5:41 PM]
          and the output of `request_script.py -h`?

          Andres Anania [5:42 PM]

           

          ```[saluser@104c2f8b0d2e ~]$ request_script.py -h
          Could not import lsstcppimport; please ensure the base package has been built (not just setup).
          usage: request_script.py [options]
          Utility to interact with the script queue.
          positional arguments:
           index ScriptQueue CSC index: 1 for Main, 2 for AuxTel
          optional arguments:
           -h, --help show this help message and exit
           --version show program's version number and exit
           -v, --verbose Set the verbosity for the console logging. (default:
           0)
           -c CONSOLE_FORMAT, --console-format CONSOLE_FORMAT
           Override the console format. (default:
           [%(levelname)s]:%(message)s)```

           

          Tiago Ribeiro [5:42 PM]
          and `request_script.py -vvv 1`?

          Andres Anania [5:42 PM]

          ```[saluser@104c2f8b0d2e ~]$ request_script.py -vvv 1
          Could not import lsstcppimport; please ensure the base package has been built (not just setup).
          [DEBUG]:Using selector: EpollSelector
          [WARNING]:Could not get state of the queue.
          [ERROR]:msg='Command failed with ack code -302', cmd_id=1553632953, ack=(ack=-302, error=1, result='Failed: showQueue not allowed in state <State.STANDBY: 5>')
          Traceback (most recent call last):
           File "/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py", line 303, in query_queue_state
           self.run(self.queue.cmd_showQueue.start(timeout=self.cmd_timeout))
           File "/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py", line 271, in run
           return self.evt_loop.run_until_complete(coro)
           File "/opt/lsst/software/stack/python/miniconda3-4.5.4/envs/lsst-scipipe-fcd27eb/lib/python3.6/asyncio/base_events.py", line 468, in run_until_complete
           return future.result()
          lsst.ts.salobj.base.AckError: msg='Command failed with ack code -302', cmd_id=1553632953, ack=(ack=-302, error=1, result='Failed: showQueue not allowed in state <State.STANDBY: 5>')
          [WARNING]:Could not get state of the queue. Make sure queue is running and is in enabled state.
          Welcome to the Request Script shell. This script is designed to
           operate with the LSST script queue.
          Type help or ? to list commands.
          *** -vvv is not a recognized command, alias, or macro
          *** 1 is not a recognized command, alias, or macro```

          Tiago Ribeiro [5:44 PM]
          ok… outside your container can you do `docker images | grep lsst/queue`?
          and paste the results here

          Andres Anania [5:44 PM]
          `lsst/queue latest f3eecc7991cf 2 weeks ago 8.6GB`

          Tiago Ribeiro [5:45 PM]
          yes… that’s the correct one…
          1 sec
          are you seeing the `(cmd):` at the end?

          Andres Anania [5:48 PM]
          yes
          I can do a "?"

          Tiago Ribeiro [5:48 PM]
          this is what mine looks like:

           

           

          `[saluser@7ba70182cadf ts_atspectrograph]$ request_script.py -vvv 1
          Could not import lsstcppimport; please ensure the base package has been built (not just setup).
          [DEBUG]:Using selector: EpollSelector
          [WARNING]:Could not get state of the queue.
          [ERROR]:msg=‘Command failed with ack code -302’, cmd_id=1553633245, ack=(ack=-302, error=1, result=‘Failed: showQueue not allowed in state <State.STANDBY: 5>’)
          Traceback (most recent call last):
           File “/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py”, line 303, in query_queue_state
           self.run(self.queue.cmd_showQueue.start(timeout=self.cmd_timeout))
           File “/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py”, line 271, in run
           return self.evt_loop.run_until_complete(coro)
           File “/opt/lsst/software/stack/python/miniconda3-4.5.4/envs/lsst-scipipe-fcd27eb/lib/python3.6/asyncio/base_events.py”, line 468, in run_until_complete
           return future.result()
          lsst.ts.salobj.base.AckError: msg=‘Command failed with ack code -302’, cmd_id=1553633245, ack=(ack=-302, error=1, result=‘Failed: showQueue not allowed in state <State.STANDBY: 5>’)
          [WARNING]:Could not get state of the queue. Make sure queue is running and is in enabled state.
          Welcome to the Request Script shell. This script is designed to
           operate with the LSST script queue.
          Type help or ? to list commands.
          *** -vvv is not a recognized command, alias, or macro
          *** 1 is not a recognized command, alias, or macro
          (cmd):`
          

           

          Andres Anania [5:48 PM]
          same to me

          Tiago Ribeiro [5:48 PM]
          ok.. so you should be good to go

          Show
          aanania Andres Anania [X] (Inactive) added a comment - Tiago Ribeiro [5:39 PM] ok… after `docker run`, can you verify that you can run `run_script_queue.py -h`? Andres Anania [5:39 PM]   ```[saluser @4a285f41aeb0 ~]$ run_script_queue.py -h Could not import lsstcppimport; please ensure the base package has been built (not just setup). usage: Start the ScriptQueue [-h] [--verbose] index standardpath externalpath positional arguments: index ScriptQueue CSC index: 1 for Main, 2 for AuxTel standardpath Path to standard SAL scripts externalpath Path to external SAL scripts optional arguments: -h, --help show this help message and exit --verbose Print diagnostic information to stdout``` (edited)   Tiago Ribeiro [5:39 PM] ok…. and `run_script_queue.py 1 ~/repos/ts_scriptqueue/tests/data/standard/ ~/repos/ts_scriptqueue/tests/data/external/`? Andres Anania [5:40 PM] ```[saluser @4a285f41aeb0 ~]$ run_script_queue.py 1 ~/repos/ts_scriptqueue/tests/data/standard/ ~/repos/ts_scriptqueue/tests/data/external/ Could not import lsstcppimport; please ensure the base package has been built (not just setup).``` (edited)   Tiago Ribeiro [5:40 PM] ok… can you start the next container? Andres Anania [5:41 PM] `sudo docker run -it -e LSST_DDS_DOMAIN="my_test" --name script lsst/queue:latest` (edited) Tiago Ribeiro [5:41 PM] yeap Andres Anania [5:41 PM] done Tiago Ribeiro [5:41 PM] and the output of `request_script.py -h`? Andres Anania [5:42 PM]   ```[saluser @104c2f8b0d2e ~]$ request_script.py -h Could not import lsstcppimport; please ensure the base package has been built (not just setup). usage: request_script.py [options] Utility to interact with the script queue. positional arguments: index ScriptQueue CSC index: 1 for Main, 2 for AuxTel optional arguments: -h, --help show this help message and exit --version show program's version number and exit -v, --verbose Set the verbosity for the console logging. ( default : 0 ) -c CONSOLE_FORMAT, --console-format CONSOLE_FORMAT Override the console format. ( default : [%(levelname)s]:%(message)s)```   Tiago Ribeiro [5:42 PM] and `request_script.py -vvv 1`? Andres Anania [5:42 PM] ```[saluser @104c2f8b0d2e ~]$ request_script.py -vvv 1 Could not import lsstcppimport; please ensure the base package has been built (not just setup). [DEBUG]:Using selector: EpollSelector [WARNING]:Could not get state of the queue. [ERROR]:msg= 'Command failed with ack code -302' , cmd_id= 1553632953 , ack=(ack=- 302 , error= 1 , result= 'Failed: showQueue not allowed in state <State.STANDBY: 5>' ) Traceback (most recent call last): File "/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py" , line 303 , in query_queue_state self.run(self.queue.cmd_showQueue.start(timeout=self.cmd_timeout)) File "/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py" , line 271 , in run return self.evt_loop.run_until_complete(coro) File "/opt/lsst/software/stack/python/miniconda3-4.5.4/envs/lsst-scipipe-fcd27eb/lib/python3.6/asyncio/base_events.py" , line 468 , in run_until_complete return future.result() lsst.ts.salobj.base.AckError: msg= 'Command failed with ack code -302' , cmd_id= 1553632953 , ack=(ack=- 302 , error= 1 , result= 'Failed: showQueue not allowed in state <State.STANDBY: 5>' ) [WARNING]:Could not get state of the queue. Make sure queue is running and is in enabled state. Welcome to the Request Script shell. This script is designed to operate with the LSST script queue. Type help or ? to list commands. *** -vvv is not a recognized command, alias, or macro *** 1 is not a recognized command, alias, or macro``` Tiago Ribeiro [5:44 PM] ok… outside your container can you do `docker images | grep lsst/queue`? and paste the results here Andres Anania [5:44 PM] `lsst/queue latest f3eecc7991cf 2 weeks ago 8.6GB` Tiago Ribeiro [5:45 PM] yes… that’s the correct one… 1 sec are you seeing the `(cmd):` at the end? Andres Anania [5:48 PM] yes I can do a "?" Tiago Ribeiro [5:48 PM] this is what mine looks like:     `[saluser @7ba70182cadf ts_atspectrograph]$ request_script.py -vvv 1 Could not import lsstcppimport; please ensure the base package has been built (not just setup). [DEBUG]:Using selector: EpollSelector [WARNING]:Could not get state of the queue. [ERROR]:msg=‘Command failed with ack code - 302 ’, cmd_id= 1553633245 , ack=(ack=- 302 , error= 1 , result=‘Failed: showQueue not allowed in state <State.STANDBY: 5 >’) Traceback (most recent call last): File “/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py”, line 303 , in query_queue_state self.run(self.queue.cmd_showQueue.start(timeout=self.cmd_timeout)) File “/home/saluser/repos/ts_scriptqueue/python/lsst/ts/scriptqueue/ui/request_model.py”, line 271 , in run return self.evt_loop.run_until_complete(coro) File “/opt/lsst/software/stack/python/miniconda3- 4.5 . 4 /envs/lsst-scipipe-fcd27eb/lib/python3. 6 /asyncio/base_events.py”, line 468 , in run_until_complete return future.result() lsst.ts.salobj.base.AckError: msg=‘Command failed with ack code - 302 ’, cmd_id= 1553633245 , ack=(ack=- 302 , error= 1 , result=‘Failed: showQueue not allowed in state <State.STANDBY: 5 >’) [WARNING]:Could not get state of the queue. Make sure queue is running and is in enabled state. Welcome to the Request Script shell. This script is designed to operate with the LSST script queue. Type help or ? to list commands. *** -vvv is not a recognized command, alias, or macro *** 1 is not a recognized command, alias, or macro (cmd):`   Andres Anania [5:48 PM] same to me Tiago Ribeiro [5:48 PM] ok.. so you should be good to go
          Hide
          tribeiro Tiago Ribeiro added a comment -

          I helped Andres spin up with the script queue.

          Show
          tribeiro Tiago Ribeiro added a comment - I helped Andres spin up with the script queue.

            People

            Assignee:
            aanania Andres Anania [X] (Inactive)
            Reporter:
            aanania Andres Anania [X] (Inactive)
            Reviewers:
            Tiago Ribeiro
            Watchers:
            Andres Anania [X] (Inactive), Tiago Ribeiro
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.