Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16393

Dask investigations

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: QA
    • Labels:
      None

      Description

      Investigate dask as an option for doing distributed analysis. Ideally this would lead to a proof of concept visualization that is only possible with this kind of system.

        Attachments

          Activity

          Hide
          krughoff Simon Krughoff added a comment -

          This included converting Gaia DR2 to parquet files. Once that was down I was able to experiment with dask as a tool for doing large scale visualizations. See notebooks here for examples of how this can be used.

          Show
          krughoff Simon Krughoff added a comment - This included converting Gaia DR2 to parquet files. Once that was down I was able to experiment with dask as a tool for doing large scale visualizations. See notebooks here for examples of how this can be used.

            People

            • Assignee:
              krughoff Simon Krughoff
              Reporter:
              krughoff Simon Krughoff
              Watchers:
              Simon Krughoff
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel