Globus online is a simple and reliable way to transfer files to or from your desktop or between HPC systems. It is the preferred transfer option for large files. Even if your connection is altered, the data is not lost and transfer will continue from where it left once the connection is re-established. This is unlike scp or rsync.
Each computer is defined as an 'endpoint', and you connect two endpoints in the browser. Most HPC centers (e.g. CSC, the national supercomputing centers, etc.) have endpoints predefined - and you just login with the username and password that you login to your accounts with (i.e. your Knot username and password).
One endpoint can be your local computer (i.e. your Desktop or Laptop) which needs you to install Globus Connect Personal and for you to configure it. The other one, in case of Knot or pod, is ucsb#CSC
To get started (the first time)
- From a web browser, login into globus (note You no longer need to set up a Globus account - you can login with your UCSB NetID, just search for Santa Barbara!!)
- Then, go to the Globus Connect Personal page to install it on your computer. It will first take you to a page to create an endpoint, and create a key. Give it some name that you'll understand, e.g. 'home-laptop'. Copy the key as you'll need it in the next step.
- Here's the detailed steps, otherwise, if you've done this continue below.
- Click the Generate Setup Key button and copy/paste that into the window that pops up when doing the install.
- Then choose your local operating system and install on your computer. You will need the setup key you have generated.
How to transfer data (after you have it installed on your computer)
Once you've done this, login to the globus website, and pick the endpoints to connect (see picture below). For Knot or pod, just type in UCSB in one of the windows and you'll see UCSB#CSC. It will complain it can't see a directory - in the 'path' window type in /csc/knot/paul (but youre username), or /csc/central/paul, or /csc/pod/paul. It will pop up a window that you type in your login information into:
You then have an interface where you click to select files, and can click to transfer entire directories. Globus will take care of making sure the transfer completes, even if it gets interrupted.
Choose the files on the left hand side (your local endpoint), and transfer by clicking on > and vice versa by <.
There is one annoyance in that it will send e-mail notifications of transfers - they can be disabled, but not entirely trivial to do.