Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16729

Test quotas for DASK workers

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: JupyterLab
    • Labels:
      None

      Description

      JupyterLab allows creating dask clusters. Putting users in their own namespace allows for putting limits on the size of those clusters. Test whether this works from the LSP at LDF.

        Attachments

          Activity

          krughoff Simon Krughoff created issue -
          krughoff Simon Krughoff made changes -
          Field Original Value New Value
          Epic Link DM-16251 [ 229546 ]
          krughoff Simon Krughoff made changes -
          Assignee Simon Krughoff [ krughoff ]
          Hide
          krughoff Simon Krughoff added a comment -

          I have verified that the quota system raises an error in the notebook when a cluster larger than allowed (in cores or aggregate memory) is requested. I've also verified that a cluster within quota limits is successfully created.

          I will note that though an exception is raised, there is apparently a race condition that means a portion of the cluster is spawned. It does not spawn the maximum but stops spawning somewhere before the maximum is reached.

          Show
          krughoff Simon Krughoff added a comment - I have verified that the quota system raises an error in the notebook when a cluster larger than allowed (in cores or aggregate memory) is requested. I've also verified that a cluster within quota limits is successfully created. I will note that though an exception is raised, there is apparently a race condition that means a portion of the cluster is spawned. It does not spawn the maximum but stops spawning somewhere before the maximum is reached.
          krughoff Simon Krughoff made changes -
          Resolution Done [ 10000 ]
          Status To Do [ 10001 ] Done [ 10002 ]

            People

            • Assignee:
              krughoff Simon Krughoff
              Reporter:
              krughoff Simon Krughoff
              Watchers:
              Simon Krughoff
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel