How to transfer data - Revision history

Dmitri: /* How to get added to the Globus Plus service */

2026-03-18T16:05:32Z

How to get added to the Globus Plus service

← Older revision		Revision as of 16:05, 18 March 2026
Line 181:		Line 181:
	:(If you are a Principal Investigator yourself, please respond accordingly).		:(If you are a Principal Investigator yourself, please respond accordingly).

	* Why do you think you need to be added to the UofC Globus subscription?		* '''Why do you think''' you need to be added to the '''UofC Globus subscription'''?
	:(Please make sure that you have reviewed the use cases mentioned above).		:(Please make sure that you have reviewed the use cases mentioned above).

Dmitri: /* How to get added to the Globus Plus service */

2026-03-18T16:05:00Z

How to get added to the Globus Plus service

@@ Line 166: / Line 166: @@
 === How to get added to the Globus Plus service ===
-To get your account '''added to the Globus Plus service''', please
+To get your account '''added to the Globus Plus service''',
-# Email support@hpc.ucalgary.ca to request that your ucalgary account be added to the campus Globus Plus subscription.
+Please '''copy the questions below''' in your email message and provide answers in the text.
-# Check your email client for a 'Welcome to Globus' message with current information to federate your @ucalgary identity with Globus services.
 == Use Globus Web Application to transfer files ==

Dmitri: /* How to get started */

2026-03-18T15:45:58Z

How to get started

← Older revision		Revision as of 15:45, 18 March 2026
Line 164:		Line 164:
	* '''Share data''' with other researchers using your '''personal Globus end point'''.		* '''Share data''' with other researchers using your '''personal Globus end point'''.

			=== How to get added to the Globus Plus service ===

	To get your account '''added to the Globus Plus service''', please		To get your account '''added to the Globus Plus service''', please

Dmitri: /* Tansferring files from your Personal Computer */

2025-12-17T20:38:52Z

Tansferring files from your Personal Computer

← Older revision		Revision as of 20:38, 17 December 2025
Line 188:		Line 188:
	* Select the file to be transferred from collection 1' and initiate the transfer process.		* Select the file to be transferred from collection 1' and initiate the transfer process.

	== Tansferring files from your Personal Computer ==		== Tansferring files from or to your Personal Computer ==

	* Download and install '''Globus Connect Personal''' application:		* Download and install '''Globus Connect Personal''' application:

Dmitri: /* Use Globus Web Application to transfer files */

2025-02-12T17:22:06Z

Use Globus Web Application to transfer files

← Older revision		Revision as of 17:22, 12 February 2025
Line 187:		Line 187:

	* Select the file to be transferred from collection 1' and initiate the transfer process.		* Select the file to be transferred from collection 1' and initiate the transfer process.

			== Tansferring files from your Personal Computer ==

			* Download and install '''Globus Connect Personal''' application:
			: https://www.globus.org/globus-connect-personal

			* Documentation on Globus Connect Personal
			: https://docs.globus.org/globus-connect-personal/

	== Use Globus Web Application to Share Files ==		== Use Globus Web Application to Share Files ==

Dmitri: /* Use Globus Web Application to transfer files */

2025-02-12T17:18:56Z

Use Globus Web Application to transfer files

← Older revision		Revision as of 17:18, 12 February 2025
Line 172:		Line 172:
	== Use Globus Web Application to transfer files ==		== Use Globus Web Application to transfer files ==

	* To initiate data transfers using the Globus Web Application~~, navigate~~ to https://app.globus.org and log into with your UCalgary account.		To initiate data transfers using the Globus Web Application

			* Navigate to https://app.globus.org and log into with '''your UCalgary account'''.
	: If you have your own '''personal GlobusID''' you can login here: https://globusid.org/ .		: If you have your own '''personal GlobusID''' you can login here: https://globusid.org/ .

Dmitri: /* Transferring Large Datasets */

2024-04-10T21:01:33Z

Transferring Large Datasets

← Older revision		Revision as of 21:01, 10 April 2024
Line 224:		Line 224:
	For large transfers, please use the <code>arc-dtn.ucalgary.ca</code> data transfer login node instead.		For large transfers, please use the <code>arc-dtn.ucalgary.ca</code> data transfer login node instead.

	To overcome this one can run the '''rsync''' transfer inside a '''screen''' virtual session on ARC / ARC-DTN. '''screen''' creates ~~an SSH~~ session local to ARC and allows for ~~reconnection~~ from SSH sessions from your workstation.		To overcome this one can run the '''rsync''' transfer inside a '''screen''' virtual session on ARC / ARC-DTN. '''screen''' creates a terminal session local to ARC and allows for re-connection from SSH sessions from your workstation.

	To begin, login to ARC-DTN and start <code>screen</code> with the screen command:		To begin, login to ARC-DTN and start <code>screen</code> with the screen command:

Dmitri: /* Transferring Large Datasets */

2024-04-10T20:53:37Z

Transferring Large Datasets

← Older revision		Revision as of 20:53, 10 April 2024
Line 224:		Line 224:
	For large transfers, please use the <code>arc-dtn.ucalgary.ca</code> data transfer login node instead.		For large transfers, please use the <code>arc-dtn.ucalgary.ca</code> data transfer login node instead.

	To overcome this one can run the '''rsync''' transfer inside a '''screen''' virtual session on ARC. '''screen''' creates an SSH session local to ARC and allows for reconnection from SSH sessions from your workstation.		To overcome this one can run the '''rsync''' transfer inside a '''screen''' virtual session on ARC / ARC-DTN. '''screen''' creates an SSH session local to ARC and allows for reconnection from SSH sessions from your workstation.

	To begin, login to ARC and start <code>screen</code> with the screen command:		To begin, login to ARC-DTN and start <code>screen</code> with the screen command:
	<source lang=bash>		<source lang=bash>
	# Login to ARC-DTN		# Login to ARC-DTN

Dmitri: /* Very large files */

2024-04-10T20:39:43Z

Very large files

← Older revision		Revision as of 20:39, 10 April 2024
Line 261:		Line 261:
	The solution may be to split the large file into smaller chunks, transfer them using rsync and then join them on the remote system (ARC for example):		The solution may be to split the large file into smaller chunks, transfer them using rsync and then join them on the remote system (ARC for example):

	<~~pre~~>		<source lang=bash>
	# Large file is 506MB in this example.		# Large file is 506MB in this example.
	$ ls -l t.bin		$ ls -l t.bin
Line 280:		Line 280:
	# Transfer the files:		# Transfer the files:
	$ rsync -axv t.bin_chunks.* username@arc-dtn.ucalgary.ca:		$ rsync -axv t.bin_chunks.* username@arc-dtn.ucalgary.ca:
	</~~pre~~>		</source>

	Then login to ARC and join the files:		Then login to ARC and join the files:
	<~~pre~~>		<source lang=bash>
	$ cat t.bin_chunk.* > t.bin		$ cat t.bin_chunk.* > t.bin

	$ ls -l		$ ls -l
	-rw-r--r-- 1 username username 530308481 Jun 8 11:06 t.bin		-rw-r--r-- 1 username username 530308481 Jun 8 11:06 t.bin
	</~~pre~~>		</source>
	Success.		Success.

Dmitri: /* Using screen and rsync */

2024-04-10T20:39:09Z

Using screen and rsync

← Older revision		Revision as of 20:39, 10 April 2024
Line 227:		Line 227:

	To begin, login to ARC and start <code>screen</code> with the screen command:		To begin, login to ARC and start <code>screen</code> with the screen command:
	<~~pre~~>		<source lang=bash>
	# Login to ARC-DTN		# Login to ARC-DTN
	$ ssh username@arc-dtn.ucalgary.ca		$ ssh username@arc-dtn.ucalgary.ca
Line 239:		Line 239:
	# Disconnect from the screen session with the hotkey 'Ctrl-a d'		# Disconnect from the screen session with the hotkey 'Ctrl-a d'
	# You may now disconnect from ARC or close the lid of you laptop or turn off the computer.		# You may now disconnect from ARC or close the lid of you laptop or turn off the computer.
	</~~pre~~>		</source>

	To check if the transfer has been finished.		To check if the transfer has been finished.
	<~~pre~~>		<source lang=bash>
	# Login to ARC-DTN		# Login to ARC-DTN
	$ ssh username@arc-dtn.ucalgary.ca		$ ssh username@arc-dtn.ucalgary.ca
Line 253:		Line 253:

	# If the transfer is still running, disconnect from the screen session with the hotkey 'Ctrl-a d'		# If the transfer is still running, disconnect from the screen session with the hotkey 'Ctrl-a d'
	</~~pre~~>		</source>

	=== Very large files ===		=== Very large files ===