Data Transfer Using scp
Use scp
and SFTP
to transfer data to/from Aurora.
Transferring files from Aurora (Flare) to Sunspot (Gila)
From an Aurora login-node, you can transfer files to Sunspot's gila
file-system using the scp
command.
But first, you need to create an SSH keypair on Aurora and copy the public key
(*.pub
) to the ~/.ssh/authorized_keys
file on Sunspot.
-
Create SSH keys on the laptop/desktop/remote machine.
See Creating SSH Keys. -
Copy the public key (
\*.pub
) from~/.ssh
folder on Aurora to~/.ssh/authorized_keys
file on Sunspot (sunspot.alcf.anl.gov
) -
Run the
scp
command on Aurora to transfer files to Sunspot -
Copy the contents of the public key file (
*.pub
) located in the~/.ssh/
folder on Aurora, and append it to the~/.ssh/authorized_keys
file on Sunspot (sunspot.alcf.anl.gov
) -
Run the
scp
command on Aurora to transfer files to Sunspotsrc="test_file" dst="/lus/gila/projects/Aurora_deployment/username" scp test_file [email protected]:$dst
Transferring files to Aurora (Flare)
With the bastion pass-through nodes currently used to access both Sunspot and
Aurora, users will find it helpful to modify their .ssh/config
files
on Aurora appropriately to facilitate transfers to Aurora from other ALCF
systems.
These changes are similar to what Sunspot users may have already implemented.
From an Aurora login-node, this readily enables one to transfer files from
Sunspot's gila
filesystem or one of the production filesystems at ALCF
(home
and eagle
) mounted on an ALCF system's login node.
With the use of ProxyJump
below, entering the MobilePass+ or Cryptocard
passcode twice will be needed (once for bastion and once for the other
resource).
username@aurora-uan-0009:~> cat .ssh/config
Host bastion.alcf.anl.gov
User username
Host polaris.alcf.anl.gov
ProxyJump bastion.alcf.anl.gov
DynamicForward 3142
user username
username@aurora-uan-0009:~> scp [email protected]:/eagle/catalyst/proj-shared/username/test.txt ./
---------------------------------------------------------------------------
Notice to Users
...
[Password:
---------------------------------------------------------------------------
Notice to Users
...
[Password:
username@aurora-uan-0009:~> cat test.txt
from_polaris eagle
scp
: Examples1
-
Copy a local file to a remote host:
-
Use a specific port when connecting to the remote host:
-
Copy a file from a remote host to a local directory:
-
Recursively copy the contents of a directory from a remote host to a local directory:
-
Copy a file between two remote hosts transferring through the local host:
-
Use a specific username when connecting to the remote host:
-
Use a specific SSH private key for authentication with the remote host:
-
Use a specific proxy when connecting to the remote host: