Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-1795

Use anonymous NCSA rsync server to distribute large test datafiles.

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Qserv
    • Labels:
      None
    • Story Points:
      4
    • Team:
      Data Access and Database

      Description

      DM-1755 has been done before this feature was available. It uses rsync over ssh which require use to have an ssh-key on lsst-dev.

      NSCA rsync server can now be accessed with next syntax:

      rsync -av lsst-rsync.ncsa.illinois.edu::qserv/qserv_testdata/datasets/case04/data/DeepSource.csv.gz .
      		 
      # LIST FILES AVAILABLE IN THE MODULE NAMED "qserv"
      		 
      rsync lsst-rsync.ncsa.illinois.edu::qserv
      		 
       
      		 
      # To add content to this module/group, you can copy files into the following path:
      		 
        /lsst/rsync/qserv/

      rsync over ssh feature should be kept, in order to distribute private data are distributed.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-1755 Create an integration test case with GB-sized data

          • Done
          mentioned in

          Page Loading...

            Activity

            Hide
            Permalink
            fritzm Fritz Mueller added a comment -

            This seems fine as is, requiring ssh key to access.

            Show
            fritzm Fritz Mueller added a comment - This seems fine as is, requiring ssh key to access.

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              jammes Fabrice Jammes
              Watchers:
              Bill Glick [X] (Inactive), Fabrice Jammes, Fritz Mueller, Jacek Becla
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.