Connecting to RCS HPC Systems: Difference between revisions

From RCSWiki
Jump to navigation Jump to search
(15 intermediate revisions by 3 users not shown)
Line 1: Line 1:
RCS maintains and operates various systems and clusters which can be connected to from within the University of Calgary campus network or via the University of Calgary IT General VPN.
Research computing services operates and maintains various clusters and services which can only be connected to from within the University of Calgary campus network or via the University of Calgary IT General VPN.


== Service Overview ==
RCS operates the following clusters and services. Most services can only be accessed from the campus network or through the IT General VPN.
{| class="wikitable"
{| class="wikitable"
! Cluster
! Cluster
!Service
! Accessible by
!Protocol
! Hostname
! Hostname
! Access
! VPN/Campus
! Accessible by
!Citrix
|-
|-
| ARC
| rowspan="4" | ARC
|Login Node
| rowspan="4" | All ARC users
|SSH
| arc.ucalgary.ca
| arc.ucalgary.ca
| SSH
| Required
| All ARC users
|Not required
|-
|[[Jupyter Notebooks|JupyterHub]]
|HTTPS
| https://jupyter.ucalgary.ca/
| Required
|Not required
|-
|-
| ARC DTN
|[[Open OnDemand]]
|HTTPS
|https://ood-arc.rcs.ucalgary.ca/
|Not required
|Not required
|-
|[[How to transfer data|Data Transfer Node]]
|SSH
| arc-dtn.ucalgary.ca
| arc-dtn.ucalgary.ca
| SSH
| Required
| All ARC users
|Not required
|-
|-
| TALC
| rowspan="2" | TALC
|Login Node
| rowspan="2" | All TALC users
|SSH
| talc.ucalgary.ca
| talc.ucalgary.ca
| SSH
| Required
| All TALC users
|Not required
|-
|-
| [[MARC_Cluster_Guide|MARC]]
|[[Jupyter Notebooks|JupyterHub]]
|HTTPS
|https://talc.ucalgary.ca/
|Required
|Not required
|-
|[[MARC_Cluster_Guide|MARC]]
|Login Node
| All MARC users
|SSH
| marc.ucalgary.ca
| marc.ucalgary.ca
| Citrix
| N/A
| MARC users
|Required
|}
|}


== Connecting to the University VPN ==
== Connecting to the University IT General VPN ==
All connections made to our infrastructure must be made from the University of Calgary campus network or via the University of Calgary IT General VPN.  
Connections to certain services must be accessed from the University of Calgary campus network or via the University of Calgary IT General VPN. You may only connect to one of our login nodes via SSH or the Citrix service from either the campus network or after you have connected to the IT General VPN.  


For additional help, refer to:
=== Connecting using FortiClient VPN ===
* [https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0033044 The General VPN knowledge base article] for help on setting up your General VPN connection on your computer.
You may install the FortiClient VPN program to connect your computer to the IT General VPN.
* [https://ucalgary.service-now.com/it?id=kb_article&sys_id=880e71071381ae006f3afbb2e144b05c The VPN software knowledge base article] for information on where to obtain FortiClient.


After connecting to the General VPN, you will then be able to connect via SSH or Citrix to our compute infrastructure.
Refer to the following pages based on your operating system:
{| class="wikitable"
!Operating System
!Documentation
|-
|Windows
|https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0033671
|-
|MacOS
|https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0033673
|-
|Linux
|https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0030086
|}
Once you are connected to the VPN, you may access any web services with your web browser or connect to login nodes via SSH using a SSH client of your choice.


=== Getting the FortiClient VPN ===


The '''FortiClient VPN''' software can be downloaded for free from the '''FortiClient''' web site.
If you have '''difficulties connecting''' the FortiClient VPN to University's network, first please make sure that you have the latest
version of the client.


Once you have downloaded the client you will need to configure it.
You can download and install it from the University software distribution centre:
: https://iac01.ucalgary.ca/SDSWeb/LandingPage.aspx?ReturnUrl=%2fSDSWeb%2fdefault.aspx


Before you do that, you should test if you have VPN access.  The best
For '''further assistance with connecting''' to the IT General VPN,
way to do this is to login to the VPN using your web browser:
please contact the '''University IT team''' through [https://ucalgary.ca/it UService].
: https://gpvpn2.ucalgary.ca:10443/


If you can login there, you can then install the VPN client and configure it with following information:
===Connecting using Fortinet Web Portal===
The Fortinet web portal allows VPN access through your web browser. This option is available for users that prefer not to use the FortiClient program or cannot install the FortiClient VPN program.
{| class="wikitable"
!VPN
!Notes
!URL
|-
|IT General VPN
|To log-in, click on 'Single Sign-On'.
|https://generalconnect.ucalgary.ca:10443/remote/login
|}
Once connected, you may use the 'Quick Connection' option to connect to a website or SSH to a login node.


* '''Host''':  gpvpn2.ucalgary.ca
====Connecting to a web site ====
* '''Port''':  10443
* Click 'Quick Connection'
* '''User''':  your_uofc_user.name
* Click HTTP/HTTPS
* Enter the URL that you want to go to i.e. jupyter.ucalgary.ca or talc.ucalgary.ca
* The website will open in a new browser tab and you may proceed normally.
====Connecting via SSH====
* Click 'Quick Connection'
* Click SSH
* Fill out the "Host" box with <code>username@hostname</code>. For example, <code>uofcusername@arc.ucalgary.ca</code>
* A new browser tab will open with a prompt for your SSH username and password. If connecting to a login node, enter your UC credentials.
* The SSH terminal will open in a new tab and you can proceed typing commands into the terminal normally.


If you cannot login, then you will have to raise a ticket with the help desk at
==Connecting with Citrix==
:https://ucalgary.service-now.com/it
Citrix Workspace app is only required for users connecting to the secured compute cluster MARC.
 
Obtain the [https://www.citrix.com/downloads/workspace-app/ Citrix Workspace App] and then navigate to https://myappmf.ucalgary.ca/. You may access the Citrix Workspace without first connecting to the IT General VPN.
 
== Connecting with Open OnDemand ==
[[Open OnDemand]] is accessible both on and off campus without a VPN connection. You may access nodes via SSH using a browser-based SSH client and web services through a virtual desktop.


== Connecting with SSH ==
== Connecting with SSH ==
Line 62: Line 132:
  ssh username@arc.ucalgary.ca
  ssh username@arc.ucalgary.ca


For work requiring X11 forwarding, pass in the -X flag.
For work requiring X11 forwarding, pass in the <code>-X</code> flag.
  ssh -X username@arc.ucalgary.ca
  ssh -X username@arc.ucalgary.ca


Line 68: Line 138:
* PuTTY
* PuTTY
* MobaXterm
* MobaXterm
= Connecting from Compute Canada systems =
'''Compute Canada clusters''' are allowed to connect to ARC (arc.ucalgary.ca) and ARC-DTN (arc-dtn.ucalgary.ca) directly, '''without VPN''' client, using an SSH client.
The main purposes is to simplify data transfer between ARC and Compute Canada systems with either <code>scp</code> or <code>rsync</code>.
Hence, if you are having difficulties connecting to ARC using FortiClient VPN and you have a Compute Canada account, you can connect to either '''Cedar''', '''Graham''', or '''Beluga''' clusters
and ssh to ARC from there.
= External Collaborators =
The main requirement for a researcher to have an account on ARC, or any other compute cluster at UofC is
that the researcher must have a '''UofC IT account''' and have a corresponding '''UofC e-mail address'''.
This is because access to the clusters is controlled by the central authentication system as to the rest of the electronic services on campus.
Thus, external collaborators cannot get an account on ARC unless they have a UofC IT account.
To address this issue and to facilitate a collaborative environment there is
a hiring template for '''External Research Collaborators''' who need to remotely access the secure compute and
High Performance Compute (HPC) resources at the University of Calgary.
This new designation allows you to request '''General Associate (GA)''' access for external research collaborators,
that are not University of Calgary employees or associated with AHS, to our HPC and Secure Compute services in an expedited manner.
Researchers in this category require a '''Principal Investigator (PI)''' or a PI delegate to submit a '''Template Based Hire (TBH)'''
with the new GA template.
Please note that AHS external researchers have their own GA template available for them and they don’t need to use this new GA template.
Principal Investigators or their delegates can request the creation of a new General Associate External Collaborator
following the Template Base Hire form process in PeopleSoft and selecting the template
“'''UC_CWR_EXT_RES_CL – Gen Associate – External Research Collaborator'''”.
These requests will need to be approved by Research Computing Services, who is managing HPC.
Once the transaction is approved, it will go to HR to complete the hiring process and the new account will be ready for your associate.


<!--
Actions Required
== Connecting with Citrix ==
* For new External Research Collaborators, please follow the '''Template Base Hire''' described above.
Citrix Workspace app must be used to connect to connect to MARC. Obtain the [https://www.citrix.com/downloads/workspace-app/ Citrix Workspace App], connect to the General VPN, then navigate to https://myappmf.ucalgary.ca/.
* If you currently have '''External Collaborators''' under a '''different template''' but fits into the new category, please let us know their names and email addresses and we will transfer them to the proper template.
-->

Revision as of 17:10, 16 February 2022

Research computing services operates and maintains various clusters and services which can only be connected to from within the University of Calgary campus network or via the University of Calgary IT General VPN.

Service Overview

RCS operates the following clusters and services. Most services can only be accessed from the campus network or through the IT General VPN.

Cluster Service Accessible by Protocol Hostname VPN/Campus Citrix
ARC Login Node All ARC users SSH arc.ucalgary.ca Required Not required
JupyterHub HTTPS https://jupyter.ucalgary.ca/ Required Not required
Open OnDemand HTTPS https://ood-arc.rcs.ucalgary.ca/ Not required Not required
Data Transfer Node SSH arc-dtn.ucalgary.ca Required Not required
TALC Login Node All TALC users SSH talc.ucalgary.ca Required Not required
JupyterHub HTTPS https://talc.ucalgary.ca/ Required Not required
MARC Login Node All MARC users SSH marc.ucalgary.ca N/A Required

Connecting to the University IT General VPN

Connections to certain services must be accessed from the University of Calgary campus network or via the University of Calgary IT General VPN. You may only connect to one of our login nodes via SSH or the Citrix service from either the campus network or after you have connected to the IT General VPN.

Connecting using FortiClient VPN

You may install the FortiClient VPN program to connect your computer to the IT General VPN.

Refer to the following pages based on your operating system:

Operating System Documentation
Windows https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0033671
MacOS https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0033673
Linux https://ucalgary.service-now.com/kb_view.do?sysparm_article=KB0030086

Once you are connected to the VPN, you may access any web services with your web browser or connect to login nodes via SSH using a SSH client of your choice.


If you have difficulties connecting the FortiClient VPN to University's network, first please make sure that you have the latest version of the client.

You can download and install it from the University software distribution centre:

https://iac01.ucalgary.ca/SDSWeb/LandingPage.aspx?ReturnUrl=%2fSDSWeb%2fdefault.aspx

For further assistance with connecting to the IT General VPN, please contact the University IT team through UService.

Connecting using Fortinet Web Portal

The Fortinet web portal allows VPN access through your web browser. This option is available for users that prefer not to use the FortiClient program or cannot install the FortiClient VPN program.

VPN Notes URL
IT General VPN To log-in, click on 'Single Sign-On'. https://generalconnect.ucalgary.ca:10443/remote/login

Once connected, you may use the 'Quick Connection' option to connect to a website or SSH to a login node.

Connecting to a web site

  • Click 'Quick Connection'
  • Click HTTP/HTTPS
  • Enter the URL that you want to go to i.e. jupyter.ucalgary.ca or talc.ucalgary.ca
  • The website will open in a new browser tab and you may proceed normally.

Connecting via SSH

  • Click 'Quick Connection'
  • Click SSH
  • Fill out the "Host" box with username@hostname. For example, uofcusername@arc.ucalgary.ca
  • A new browser tab will open with a prompt for your SSH username and password. If connecting to a login node, enter your UC credentials.
  • The SSH terminal will open in a new tab and you can proceed typing commands into the terminal normally.

Connecting with Citrix

Citrix Workspace app is only required for users connecting to the secured compute cluster MARC.

Obtain the Citrix Workspace App and then navigate to https://myappmf.ucalgary.ca/. You may access the Citrix Workspace without first connecting to the IT General VPN.

Connecting with Open OnDemand

Open OnDemand is accessible both on and off campus without a VPN connection. You may access nodes via SSH using a browser-based SSH client and web services through a virtual desktop.

Connecting with SSH

Secure Shell (SSH) is an encrypted network protocol that allows secure communication between your computer and a server.

On Linux or MacOS computers, SSH is most likely installed and can be used by opening a terminal and running:

ssh username@arc.ucalgary.ca

For work requiring X11 forwarding, pass in the -X flag.

ssh -X username@arc.ucalgary.ca

On Windows, there are various clients that can be used to connect to our cluster including:

  • PuTTY
  • MobaXterm

Connecting from Compute Canada systems

Compute Canada clusters are allowed to connect to ARC (arc.ucalgary.ca) and ARC-DTN (arc-dtn.ucalgary.ca) directly, without VPN client, using an SSH client. The main purposes is to simplify data transfer between ARC and Compute Canada systems with either scp or rsync. Hence, if you are having difficulties connecting to ARC using FortiClient VPN and you have a Compute Canada account, you can connect to either Cedar, Graham, or Beluga clusters and ssh to ARC from there.

External Collaborators

The main requirement for a researcher to have an account on ARC, or any other compute cluster at UofC is that the researcher must have a UofC IT account and have a corresponding UofC e-mail address. This is because access to the clusters is controlled by the central authentication system as to the rest of the electronic services on campus. Thus, external collaborators cannot get an account on ARC unless they have a UofC IT account.


To address this issue and to facilitate a collaborative environment there is a hiring template for External Research Collaborators who need to remotely access the secure compute and High Performance Compute (HPC) resources at the University of Calgary.


This new designation allows you to request General Associate (GA) access for external research collaborators, that are not University of Calgary employees or associated with AHS, to our HPC and Secure Compute services in an expedited manner. Researchers in this category require a Principal Investigator (PI) or a PI delegate to submit a Template Based Hire (TBH) with the new GA template. Please note that AHS external researchers have their own GA template available for them and they don’t need to use this new GA template.


Principal Investigators or their delegates can request the creation of a new General Associate External Collaborator following the Template Base Hire form process in PeopleSoft and selecting the template “UC_CWR_EXT_RES_CL – Gen Associate – External Research Collaborator”. These requests will need to be approved by Research Computing Services, who is managing HPC. Once the transaction is approved, it will go to HR to complete the hiring process and the new account will be ready for your associate.


Actions Required

  • For new External Research Collaborators, please follow the Template Base Hire described above.
  • If you currently have External Collaborators under a different template but fits into the new category, please let us know their names and email addresses and we will transfer them to the proper template.