Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4390

lfs pull breaks with valid github credentials

    Details

    • Templates:
    • Team:
      SQuaRE

      Description

      It appears that s3.lsst.codes is not properly handle http credentials. A blank username/password is able to download lfs objects but supplying valid github username/password credentials fails. Eg.

       
      $ git clone -c lfs.batch=false -c filter.lfs.require -c filter.lfs.smudge='git-lfs smudge %f' -c filter.lfs.clean='git-lfs clean %f'  https://github.com/lsst/afwdata.git afwdata2
      Cloning into 'afwdata2'...
      remote: Counting objects: 1784, done.
      remote: Total 1784 (delta 0), reused 0 (delta 0), pack-reused 1784
      Receiving objects: 100% (1784/1784), 232.26 KiB | 0 bytes/s, done.
      Resolving deltas: 100% (471/471), done.
      Checking connectivity... done.
      Downloading CFHT/D2/sdss.dat (110.68 KB)
      Username for 'https://git-lfs.lsst.codes': jhoblitt
      Password for 'https://jhoblitt@git-lfs.lsst.codes': 
      Username for 'https://s3.lsst.codes': jhoblitt
      Password for 'https://jhoblitt@s3.lsst.codes': 
      Error accessing media: CFHT/D2/sdss.dat (711e334cd5a247721d4603a7876e3166c58b77307e65102ea769cb0788633bb2)
       
      Errors logged to .git/lfs/objects/logs/20151120T092457.812846521.log
      Use `git lfs logs last` to view the log.
      error: external filter git-lfs smudge %f failed 2
      error: external filter git-lfs smudge %f failed
      fatal: CFHT/D2/sdss.dat: smudge filter lfs failed
      warning: Clone succeeded, but checkout failed.
      You can inspect what was checked out with 'git status'
      and retry the checkout with 'git checkout -f HEAD'
       
      $ cat afwdata2/.git/lfs/objects/logs/20151120T092457.812846521.log
      git-lfs/1.0.2 (GitHub; linux amd64; go 1.5.1; git 0566698)
      git version 2.4.3
       
      $ git-lfs smudge CFHT/D2/sdss.dat
      Error accessing media: CFHT/D2/sdss.dat (711e334cd5a247721d4603a7876e3166c58b77307e65102ea769cb0788633bb2)
       
      Client error: https://s3.lsst.codes/lsst-sqre-prod-git-lfs/data/711e334cd5a247721d4603a7876e3166c58b77307e65102ea769cb0788633bb2?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=XIGV9O00257RB4BM5EQ3%2F20151120%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20151120T162452Z&X-Amz-Expires=900&X-Amz-SignedHeaders=host&X-Amz-Signature=4504341d987915a4890ebc5ae83e767df8e9e9e6c7563966e7f3429be8d69053
      goroutine 1 [running]:
      github.com/github/git-lfs/lfs.Stack(0x0, 0x0, 0x0)
      	/Users/rick/go/src/github.com/github/git-lfs/lfs/errors.go:557 +0x80
      github.com/github/git-lfs/commands.logPanicToWriter(0x7f6cd90321e8, 0xc8200341d8, 0x7f6cd9032da8, 0xc8204783b0)
      	/Users/rick/go/src/github.com/github/git-lfs/commands/commands.go:184 +0xf7f
      github.com/github/git-lfs/commands.logPanic(0x7f6cd9032da8, 0xc8204783b0, 0x0, 0x0)
      	/Users/rick/go/src/github.com/github/git-lfs/commands/commands.go:148 +0x421
      github.com/github/git-lfs/commands.handlePanic(0x7f6cd9032da8, 0xc8204783b0, 0x0, 0x0)
      	/Users/rick/go/src/github.com/github/git-lfs/commands/commands.go:123 +0x4e
      github.com/github/git-lfs/commands.LoggedError(0x7f6cd9032da8, 0xc8204783b0, 0x8e24c0, 0x1e, 0xc82014dc98, 0x2, 0x2)
      	/Users/rick/go/src/github.com/github/git-lfs/commands/commands.go:73 +0x82
      github.com/github/git-lfs/commands.smudgeCommand(0xab9e60, 0xc820011930, 0x1, 0x1)
      	/Users/rick/go/src/github.com/github/git-lfs/commands/command_smudge.go:80 +0xd89
      github.com/github/git-lfs/vendor/_nuts/github.com/spf13/cobra.(*Command).execute(0xab9e60, 0xc820011880, 0x1, 0x1, 0x0, 0x0)
      	/Users/rick/go/src/github.com/github/git-lfs/vendor/_nuts/github.com/spf13/cobra/command.go:477 +0x403
      github.com/github/git-lfs/vendor/_nuts/github.com/spf13/cobra.(*Command).Execute(0xabab60, 0x0, 0x0)
      	/Users/rick/go/src/github.com/github/git-lfs/vendor/_nuts/github.com/spf13/cobra/command.go:551 +0x46a
      github.com/github/git-lfs/commands.Run()
      	/Users/rick/go/src/github.com/github/git-lfs/commands/commands.go:88 +0x23
      main.main()
      	/Users/rick/go/src/github.com/github/git-lfs/git-lfs.go:34 +0x12e
       
      ENV:
      LocalWorkingDir=/home/jhoblitt/tmp/afwdata2
      LocalGitDir=.git
      LocalGitStorageDir=.git
      LocalMediaDir=.git/lfs/objects
      TempDir=.git/lfs/tmp
      ConcurrentTransfers=3
      BatchTransfer=false
      GIT_DIR=.git
      $ git-lfs version
      git-lfs/1.0.2 (GitHub; linux amd64; go 1.5.1; git 0566698)
      

        Attachments

          Activity

            People

            • Assignee:
              jmatt J Matt Peterson [X] (Inactive)
              Reporter:
              jhoblitt Joshua Hoblitt
              Watchers:
              Frossie Economou, J Matt Peterson [X] (Inactive), Joshua Hoblitt, Paul Price
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel