Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16729

Test quotas for DASK workers

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: JupyterLab
    • Labels:
      None

      Description

      JupyterLab allows creating dask clusters. Putting users in their own namespace allows for putting limits on the size of those clusters. Test whether this works from the LSP at LDF.

        Attachments

          Activity

          Hide
          krughoff Simon Krughoff added a comment -

          I have verified that the quota system raises an error in the notebook when a cluster larger than allowed (in cores or aggregate memory) is requested. I've also verified that a cluster within quota limits is successfully created.

          I will note that though an exception is raised, there is apparently a race condition that means a portion of the cluster is spawned. It does not spawn the maximum but stops spawning somewhere before the maximum is reached.

          Show
          krughoff Simon Krughoff added a comment - I have verified that the quota system raises an error in the notebook when a cluster larger than allowed (in cores or aggregate memory) is requested. I've also verified that a cluster within quota limits is successfully created. I will note that though an exception is raised, there is apparently a race condition that means a portion of the cluster is spawned. It does not spawn the maximum but stops spawning somewhere before the maximum is reached.

            People

            • Assignee:
              krughoff Simon Krughoff
              Reporter:
              krughoff Simon Krughoff
              Watchers:
              Simon Krughoff
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel