SCP
Data Transfer
Use scp and SFTP to transfer data to/from Aurora.
Transferring files from Aurora (Flare) to Sunspot (Gila)
From an Aurora login-node, you can transfer files to Sunspot's gila
filesystem using the scp
command. But first, you need to create an SSH keypair on Aurora and copy the public key (*.pub
) to the ~/.ssh/authorized_keys
file on Sunspot.
1. Create SSH keys on the laptop/desktop/remote machine. See "Creating SSH Keys" section on this page.
2. Copy the public key (*.pub) from ~/.ssh folder on Aurora to ~/.ssh/authorized_keys file on Sunspot (sunspot.alcf.anl.gov)
3. Run the scp command on Aurora to transfer files to Sunspot
2. Copy the contents of the public key file (*.pub
) located in the ~/.ssh/
folder on Aurora, and append it to the ~/.ssh/authorized_keys
file on Sunspot (sunspot.alcf.anl.gov
)
3. Run the scp
command on Aurora to transfer files to Sunspot
username@aurora-uan-0010:~> scp test_file [email protected]://lus/gila/projects/Aurora_deployment/username
...
username@uan-0001:/gila/Aurora_deployment/username> cat test_file
this is a test file
Transferring files to Aurora (Flare)
With the bastion pass-through nodes currently used to access both Sunspot and Aurora, users will find it helpful to modify their .ssh/config
files on Aurora appropriately to facilitate transfers to Aurora from other ALCF systems. These changes are similar to what Sunspot users may have already implemented. From an Aurora login-node, this readily enables one to transfer files from Sunspot's gila
filesystem or one of the production filesystems at ALCF (home
and eagle
) mounted on an ALCF system's login node. With the use of ProxyJump
below, entering the MobilePass+ or Cryptocard passcode twice will be needed (once for bastion and once for the other resource). A simple example shows the .ssh/config
entries for Polaris and the scp
command for transferring from Polaris:
$ cat .ssh/config
username@aurora-uan-0009:~> cat .ssh/config
Host bastion.alcf.anl.gov
User username
Host polaris.alcf.anl.gov
ProxyJump bastion.alcf.anl.gov
DynamicForward 3142
user username
username@aurora-uan-0009:~> scp [email protected]:/eagle/catalyst/proj-shared/username/test.txt ./
---------------------------------------------------------------------------
Notice to Users
...
[Password:
---------------------------------------------------------------------------
Notice to Users
...
[Password:
username@aurora-uan-0009:~> cat test.txt
from_polaris eagle