Storage Options - Revision history

Dmitri: /* ARC Cluster Storage */

2026-04-02T16:15:54Z

ARC Cluster Storage

← Older revision		Revision as of 16:15, 2 April 2026
Line 173:		Line 173:
	=== ARC /work and /bulk Group Allocation ===		=== ARC /work and /bulk Group Allocation ===
	Any group member who wants to use the shared storage, should send an email to the support@hpc.ucalgary.ca to be added to the access group and CC the PI/ data owner. '''This will confirm that the PI approves the group member's request access to the shared storage.''' Please note that the access permissions inside the directory are expected to be managed by the data owners.		Any group member who wants to use the shared storage, should send an email to the support@hpc.ucalgary.ca to be added to the access group and CC the PI/ data owner. '''This will confirm that the PI approves the group member's request access to the shared storage.''' Please note that the access permissions inside the directory are expected to be managed by the data owners.


			Storage allocations on ARC are provided for '''active research data'''.
			The '''master data have to be stored elsewhere''' and only the '''part of the data that is going to be processed''' should be transferred to ARC.
			Once it has been processed the data are '''expected to be deleted''' and the results moved elsewhere.
			With this approach you may need much less space that it may appear initially.
			The processing can also be done in chunks, which are smaller than the entire dataset.

			Future '''extensions of the storage are possible'''.
			However, the allocation '''cannot grow indefinitely and uncontrollably'''.
			There must be a '''plan for data management on ARC''', how and how much data are uploaded to ARC,
			how much space is needed for comfortable processing,
			as well as when the data and results are moved off ARC and where.

Dmitri: /* ARC /work and /bulk Group Allocation */

2026-03-18T20:42:18Z

ARC /work and /bulk Group Allocation

← Older revision		Revision as of 20:42, 18 March 2026
Line 204:		Line 204:


	* Please note, that storage allocations also have '''file count number limits'''.		* The storage on ARC is relatively '''expensive resource'''. It is offered as a '''work space''' to use ARC's compute resources.
			: Once the data have been processed what is the plan to '''move it off ARC'''?


			* '''Please note''', that storage allocations also have '''file count number limits'''.
	: For example, a '''5TB allocation''' will be limited to '''1 million files''' in it.		: For example, a '''5TB allocation''' will be limited to '''1 million files''' in it.

Dmitri: /* ARC /work and /bulk Group Allocation */

2026-03-04T22:31:08Z

ARC /work and /bulk Group Allocation

← Older revision		Revision as of 22:31, 4 March 2026
Line 202:		Line 202:
	: A '''rationale for a request''' can be a formal data management plan or something more informal like a rough estimate to the primary dataset used for a project and a rough estimate to the size of outputs expected from your computations that are planned to run on ARC over the '''next year.'''		: A '''rationale for a request''' can be a formal data management plan or something more informal like a rough estimate to the primary dataset used for a project and a rough estimate to the size of outputs expected from your computations that are planned to run on ARC over the '''next year.'''
	: Please provide a brief '''numerical estimate''' of the required storage space based on '''projects''' that will use the allocation and their storage '''requirements''' . These estimate '''should sum up to the amount''' of storage you are requesting.		: Please provide a brief '''numerical estimate''' of the required storage space based on '''projects''' that will use the allocation and their storage '''requirements''' . These estimate '''should sum up to the amount''' of storage you are requesting.


			* Please note, that storage allocations also have '''file count number limits'''.
			: For example, a '''5TB allocation''' will be limited to '''1 million files''' in it.

	==== Examples ====		==== Examples ====

Pemartin: /* OneDrive for Business */

2025-12-19T18:52:19Z

OneDrive for Business

← Older revision		Revision as of 18:52, 19 December 2025
Line 66:		Line 66:
	\|-		\|-
	! Learn more		! Learn more
	\| [https://ucalgary.service-now.com/it?id=kb_article&sys_id=60994170db2da7487cab5068dc961900 OneDrive for Business]		\| Visit [https://ucalgary.service-now.com/it?id=kb_article&sys_id=60994170db2da7487cab5068dc961900 OneDrive for Business]
	\|-		\|-
	! Classification		! Classification

Pemartin: /* OneDrive for Business */

2025-12-19T18:51:49Z

OneDrive for Business

← Older revision		Revision as of 18:51, 19 December 2025
Line 63:		Line 63:
	{\| class="wikitable"		{\| class="wikitable"
	! Capacity		! Capacity
	\| 250 GB with quota increases [https://ucalgary.service-now.com/it?id=~~sc_cat_item~~&~~sys_id~~=~~438e6d8313896a0053f2d7b2e144b0b9~~ available on request].		\| 250 GB with quota increases [https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0032351&sysparm_rank=1&sysparm_tsqueryId=49740a3447307e500e17a009536d438d available on request].
			\|-
			! Learn more
			\| [https://ucalgary.service-now.com/it?id=kb_article&sys_id=60994170db2da7487cab5068dc961900 OneDrive for Business]
	\|-		\|-
	! Classification		! Classification
Line 92:		Line 95:
	For more information on OneDrive for Business:		For more information on OneDrive for Business:
	* Operating Level of Agreement KB0032404 (https://ucalgary.service-now.com/it?id=kb_article&sys_id=7f57bddcdb56a3047cab5068dc9619b6)		* Operating Level of Agreement KB0032404 (https://ucalgary.service-now.com/it?id=kb_article&sys_id=7f57bddcdb56a3047cab5068dc9619b6)
	*OneDrive for Business Getting Started KB0032351 (https://ucalgary.service-now.com/it?id=kb_article&sys_id=60994170db2da7487cab5068dc961900)
	*If you are above 90% of your OneDrive quota, you can request an increase here: ( https://ucalgary.service-now.com/it?id=sc_cat_item&sys_id=438e6d8313896a0053f2d7b2e144b0b9) PLEASE NOTE: Microsoft will only increase an allocation while the Cloud Storage is more than 90% full. Please log into your O365 cloud account to review before making your request.		*If you are above 90% of your OneDrive quota, you can request an increase here: ( https://ucalgary.service-now.com/it?id=sc_cat_item&sys_id=438e6d8313896a0053f2d7b2e144b0b9) PLEASE NOTE: Microsoft will only increase an allocation while the Cloud Storage is more than 90% full. Please log into your O365 cloud account to review before making your request.

Pemartin: /* OneDrive for Business */

2025-12-19T18:46:39Z

OneDrive for Business

← Older revision		Revision as of 18:46, 19 December 2025
Line 63:		Line 63:
	{\| class="wikitable"		{\| class="wikitable"
	! Capacity		! Capacity
	\| ~~5 TB~~ with quota increases [https://ucalgary.service-now.com/it?id=sc_cat_item&sys_id=438e6d8313896a0053f2d7b2e144b0b9 available on request].		\| 250 GB with quota increases [https://ucalgary.service-now.com/it?id=sc_cat_item&sys_id=438e6d8313896a0053f2d7b2e144b0b9 available on request].
	\|-		\|-
	! Classification		! Classification

Dmitri: /* ARC /work and /bulk Group Allocation */

2025-12-19T18:15:23Z

ARC /work and /bulk Group Allocation

← Older revision		Revision as of 18:15, 19 December 2025
Line 188:		Line 188:


	* What ~~is the requested~~ '''allocation ~~name~~'''?		* What '''name''' would you like for '''the allocation'''?
	: The preferred form would be <PI name>_lab, <code>smith_lab</code>, for example.		: The preferred form would be <PI name>_lab, <code>smith_lab</code>, for example.
	: It is short, descriptive and matches the general pattern of other allocations.		: It is short, descriptive and matches the general pattern of other allocations.
Line 195:		Line 195:
	* Which other '''group members''' who currently '''have ARC accounts''' should be able to '''access the allocation'''?		* Which other '''group members''' who currently '''have ARC accounts''' should be able to '''access the allocation'''?
	:(Full Name and UCalgary Email address for active ARC users)		:(Full Name and UCalgary Email address for active ARC users)


	* '''How much storage''' is requested and '''why is that the amount''' that you need?		* '''How much storage''' is requested and '''why is that the amount''' that you need?

Dmitri: /* ARC /work and /bulk Group Allocation */

2025-12-19T18:11:10Z

ARC /work and /bulk Group Allocation

← Older revision		Revision as of 18:11, 19 December 2025
Line 175:		Line 175:
	All requests should answer the following questions:		All requests should answer the following questions:

			* The '''owner''' of the allocation.
			: (Full Name and UCalgary Email address, typically the requesting PI.)
			: This is an administrative role for the purpose of access approval and decisions about data ownership in the shared space.
			: The owner does not need to have an ARC account.

	* What is the '''faculty''' of the allocation owner?		* What is the '''faculty''' of the allocation owner?


	* Please provide a '''short description of the lab'''.		* Please provide a '''short description of the lab'''.


	* What is the ~~requested~~ '''~~allocation name~~'''?		* What is the '''data classification''' using [https://ucalgary.ca/legal-services/sites/default/files/teams/1/Standards-Legal-Information-Security-Classification-Standard.pdf the University of Calgary data security classification system]?
	: ~~(The preferred form would be <PI name>_lab, <code>smith_lab<~~/~~code>, for example~~. ~~It is short, descriptive and matches~~ the ~~general pattern~~ of ~~other allocations.)~~


	* What is the '''~~data classification~~''' ~~using the University of Calgary data security classification system~~?		* What is the requested '''allocation name'''?
			: The preferred form would be <PI name>_lab, <code>smith_lab</code>, for example.
			: It is short, descriptive and matches the general pattern of other allocations.
	* The ~~'''owner''' of the allocation.~~
	~~: (Full Name and UCalgary Email address~~, ~~typically the requesting PI~~.)
	: ~~This~~ is ~~an administrative role for~~ the ~~purpose~~ of ~~access approval and decisions about data ownership in the shared space.~~
	~~: The owner does not need to have an ARC account~~.

Dmitri: /* ARC /work and /bulk Group Allocation */

2025-12-19T18:07:58Z

ARC /work and /bulk Group Allocation

← Older revision		Revision as of 18:07, 19 December 2025
Line 176:		Line 176:


	* '''~~How much storage~~''' ~~is requested and '''why is that~~ the ~~amount~~''' ~~that you need?~~		* What is the '''faculty''' of the allocation owner?
	~~A rationale for a request can be a formal data management plan or something more informal like a rough estimate to the primary dataset used for a project and a rough estimate to the size~~ of ~~outputs expected from your computations that are planned to run on ARC over~~ the '''~~next year~~.~~'''~~

			* Please provide a '''short description of the lab'''.


Line 187:		Line 189:


	* ~~Which user would be the~~ '''owner''' of the allocation?		* The '''owner''' of the allocation.
	: (Full Name and UCalgary Email address, typically the requesting PI.)		: (Full Name and UCalgary Email address, typically the requesting PI.)
			: This is an administrative role for the purpose of access approval and decisions about data ownership in the shared space.
			: The owner does not need to have an ARC account.


Line 194:		Line 198:
	:(Full Name and UCalgary Email address for active ARC users)		:(Full Name and UCalgary Email address for active ARC users)

			* '''How much storage''' is requested and '''why is that the amount''' that you need?
			: A '''rationale for a request''' can be a formal data management plan or something more informal like a rough estimate to the primary dataset used for a project and a rough estimate to the size of outputs expected from your computations that are planned to run on ARC over the '''next year.'''
			: Please provide a brief '''numerical estimate''' of the required storage space based on '''projects''' that will use the allocation and their storage '''requirements''' . These estimate '''should sum up to the amount''' of storage you are requesting.

	* What is the '''faculty''' of the allocation owner?		==== Examples ====


	* Please provide a '''short description of the lab'''.


	* Please provide a brief '''numerical estimate''' of the required storage space based on '''projects''' that will use the allocation and their storage '''requirements''' .


	'''Example 1''': "We will be processing a 1T dataset by performing 100 experimental runs.		'''Example 1''': "We will be processing a 1T dataset by performing 100 experimental runs.

Dmitri: /* ARC /work and /bulk Group Allocation */

2025-12-17T17:31:39Z

ARC /work and /bulk Group Allocation

← Older revision		Revision as of 17:31, 17 December 2025
Line 174:		Line 174:

	All requests should answer the following questions:		All requests should answer the following questions:


	* '''How much storage''' is requested and '''why is that the amount''' that you need?		* '''How much storage''' is requested and '''why is that the amount''' that you need?