RCSWiki - User contributions [en]

Altis Login Node Status

2026-06-23T21:37:06Z

Cemagata:

{{ARC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = Systems Operating Normally
| date = 2024/09/03
| message =
The ARC Cluster and the Altis login node is operational. No upcoming upgrades are planned.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/27
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). Some Altis GPU nodes will be affected during this maintenance window. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = wdfgpu[1-12] System Update Reboots
| date = 2024/12/02
| message = wdfgpu[1-12] will be updated today for a short reboot to install important system updates and will return shortly.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = ⚠️ Scheduled Maintenance and OS Update
| date = 2025/01/15
| message = The ARC cluster will be down for maintenance and upgrades starting 9AM Monday, January 20, 2025 through Wednesday, January 22, 2025.

For the duration of the upgrade window:
* Scheduling will be paused and new jobs will be queued. Any queued jobs will start scheduling only after the upgrade is complete.
* Access to files via the login node and arc-dtn will generally be available but intermittent. File transfers on the DTN node, including Globus file transfers, may be interrupted during this window.

Please make sure to save your work prior to this outage window to avoid any loss of work.

During this time the following changes will happen:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer will be replaced. Access to /bulk will be unavailable on Wednesday, January 22, 2025.

3. The compute node operating system will be updated to Rocky Linux 8.10.

4. The Slurm scheduling system will be upgraded.

5. The Open OnDemand web portal will be upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

⚠️⚠️⚠️⚠️⚠️
Update Jan 18, 2025

Around 10AM Altis experienced an electrical power brownout. Some percentage (how many is unknown at this time) of the nodes lost electrical power during this time causing a loss
of a number of running jobs.

Sorry for the inconvenience.

Since Altis is shutting down for maintenance on Monday Jan 20, replacement jobs will likely not start unless they request a timelimit less than the time until 8AM Monday.
⚠️⚠️⚠️⚠️⚠️
}}

{{Message of the day item
| title = Maintenance Complete
| date = 2025/01/22
| message = The ARC/Altis cluster upgrade is complete

During this time the following changes happened:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer was replaced successfully.

3. The compute node operating was updated to Rocky Linux 8.10.

4. The Slurm scheduling system was upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = Trend Micro Installation
| date = 2025/04/29
| message = To increase the security posture of the Arc cluster administrators will be installing Trend Micro on cluster login nodes over the week starting Apr 30. Please report any inconsistencies to support@hpc.ucalgary.ca

}}

{{Message of the day item
| title = Update on ARC
| date = 2025/09/15
| message = ⚠️ Arc Update September 15-19

An update of the Arc cluster will begin on Sep 15. This will result in fewer resources while the compute nodes are restarted. The login node and Scheduler will be restarted on Sep 17.

}}

{{Message of the day item
| title = Update on Altis
| date = 2025/09/15
| message = ⚠️ Altis Update September 15-19

An update of the Altis (Arc) cluster will begin on Sep 15. This will result in fewer resources while the compute nodes are restarted. The login node and Scheduler will be restarted on Sep 17.

}}

{{Message of the day item
| title = Update on Altis
| date = 2025/09/15
| message = Update complete

The update of the Arc cluster is complete.

}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ⚠️ ARC Update Week of January 12

ARC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Update Complete
| date = 2026/05/07
| message = Urgent update complete

}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2026/06/22
| message =

}}

{{Message of the day item
| title = Upcoming File Server Update July 2, 2026. Starting at 9AM
| date = 2026/06/23
| message = File Server Update

We will be updating the file servers on July 2, 2026, beginning at 9AM continuing throughout the day. We do not expect any service interruptions or degradation during the process.

If you have any questions ahead of time, or experience any symptoms on the date, please contact RCS via support@hpc.ucalgary.ca
}}

[[Category:ARC]]
{{Navbox ARC}}

Think Login Node Status

2026-06-23T21:36:50Z

Cemagata:

{{ARC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = Systems Operating Normally
| date = 2024/09/03
| message =
The ARC Cluster and the Think login node is operational. No upcoming upgrades are planned.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/23
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). Some Think GPU nodes will be affected during this maintenance window. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024.

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = wdfgpu[1-12] System Update Reboots
| date = 2024/12/02
| message = wdfgpu[1-12] will be updated today for a short reboot to install important system updates and will return shortly.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = ⚠️ Scheduled Maintenance and OS Update
| date = 2025/01/15
| message = The ARC cluster will be down for maintenance and upgrades starting 9AM Monday, January 20, 2025 through Wednesday, January 22, 2025.

For the duration of the upgrade window:
* Scheduling will be paused and new jobs will be queued. Any queued jobs will start scheduling only after the upgrade is complete.
* Access to files via the login node and arc-dtn will generally be available but intermittent. File transfers on the DTN node, including Globus file transfers, may be interrupted during this window.

Please make sure to save your work prior to this outage window to avoid any loss of work.

During this time the following changes will happen:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer will be replaced. Access to /bulk will be unavailable on Wednesday, January 22, 2025.

3. The compute node operating system will be updated to Rocky Linux 8.10.

4. The Slurm scheduling system will be upgraded.

5. The Open OnDemand web portal will be upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

⚠️⚠️⚠️⚠️⚠️
Update Jan 18, 2025

Around 10AM Arc experienced an electrical power brownout. Some percentage (how many is unknown at this time) of the nodes lost electrical power during this time causing a loss
of a number of running jobs.

Sorry for the inconvenience.

Since Arc is shutting down for maintenance on Monday Jan 20, replacement jobs will likely not start unless they request a timelimit less than the time until 8AM Monday.
⚠️⚠️⚠️⚠️⚠️
}}

{{Message of the day item
| title = Maintenance Complete
| date = 2025/01/22
| message = The ARC/Think cluster upgrade is complete

During this time the following changes happened:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer was replaced successfully.

3. The compute node operating was updated to Rocky Linux 8.10.

4. The Slurm scheduling system was upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = Trend Micro Installation
| date = 2025/04/29
| message = To increase the security posture of the Arc cluster administrators will be installing Trend Micro on cluster login nodes over the week starting Apr 30. Please report any inconsistencies to support@hpc.ucalgary.ca

}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ⚠️ ARC Update Week of January 12

ARC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Update on Think
| date = 2026/05/07
| message = Update complete

The update of the Arc cluster is complete.

}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2026/06/22
| message =
}}

{{Message of the day item
| title = Upcoming File Server Update July 2, 2026. Starting at 9AM
| date = 2026/06/23
| message = File Server Update

We will be updating the file servers on July 2, 2026, beginning at 9AM continuing throughout the day. We do not expect any service interruptions or degradation during the process.

If you have any questions ahead of time, or experience any symptoms on the date, please contact RCS via support@hpc.ucalgary.ca
}}

[[Category:ARC]]
{{Navbox ARC}}

TALC Cluster Status

2026-06-23T21:36:34Z

Cemagata:

{{TALC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = ⚠️ May System Updates
| date = 2023/02/02
| message =
Beginning May 1, 2023, the TALC cluster will undergo operating system updates. The upgrade will happen after the end of term to minimize any disruption. Any existing jobs may be
temporarily held from scheduling. The upgrade is planned to be fully complete by May 5.

The TALC login node will reboot on the morning of May 1.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = May System Updates Completed
| date = 2023/05/04
| message =
TALC upgrades have been completed. If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = TALC Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2024/06/26
| message =
}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = Trend Micro Installation
| date = 2025/04/29
| message = To increase the security posture of the Arc cluster administrators will be installing Trend Micro on cluster login nodes over the week starting Apr 30. Please report any inconsistencies to support@hpc.ucalgary.ca

}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ⚠️ TALC Update Week of January 12

TALC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Talc Filesystem Returned to service, scheduling outages continue
| date = 2025/01/13
| message = ⚠️ Data access now possible ⚠️

The first stage of the maintenance is complete and the filesystems are once again available.

There is still significant work to do on the cluster so jobs will not start until this maintenance is complete but clients will be able to access data via the login node.

}}

{{Message of the day item
| title = Talc Returned to service
| date = 2025/01/13
| message = Maintenance Complete

Talc maintenance complete.

}}

{{Message of the day item
| title = Filesystem Outage Feb 23, 2026 Starting at 7AM
| date = 2026/02/17
| message = ⚠️ Filesystem Outage Affecting Arc, Marc, Talc, Cloudstack

Filesystems will be unavailable Feb 23 starting at 7AM MST. This outage is expected to end prior to 8PM. No logins or file access will be possible until the outage is complete.

Any jobs queued must request timelimits less then the remaining time until Feb 23, 7AM or they will wait until the outage is complete.

Sorry for the inconvenience.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Filesystem Outage Complete
| date = 2026/02/23
| message = ✅ Filesystem Outage Complete

All clusters are back in production.

As of Friday Feb 20, 2026 - Due to some configuration issues on the network Fluent is not available on ARC at this time.
We are working to fix the issues and the software will return as soon as possible. Please try resubmitting any affected jobs later.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Update Complete
| date = 2026/05/07
| message = Urgent update complete

}}

{{Message of the day item
| title = Upcoming File Server Update July 2, 2026. Starting at 9AM
| date = 2026/06/23
| message = File Server Update

We will be updating the file servers on July 2, 2026, beginning at 9AM continuing throughout the day. We do not expect any service interruptions or degradation during the process.

If you have any questions ahead of time, or experience any symptoms on the date, please contact RCS via support@hpc.ucalgary.ca
}}

[[Category:TALC]]
{{Navbox TALC}}

MARC Cluster Status

2026-06-23T21:36:12Z

Cemagata:

{{Cluster Status
| cluster = MARC
| status = green
| title = Cluster operational
| message = See the [[MARC Cluster Status]] page for system notices.
}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 23, 2023, the MARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The MARC login node will reboot on the morning of January 23. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 27.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on MARC Login Node
| date = 2023/06/23
| message =
Apptainer (Singularity) containers may experience an error when
running on the MARC login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.
}}besian.sejdiu

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = OS Upgrade MARC/ARC cluster
| date = 2024/09/11
| message =
MARC will be going down for OS upgrades on 2024/Sep/16. The cluster
will be unavailable temporarily to complete this work. Please contact
support@hpc.ucalgary.ca if you have any questions or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The MARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The MARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = MARC Scheduled File System Maintenance
| date = 2025/06/09
| message = Please be advised MARC will be going down for a period of approximately 2 hours starting at 10 AM June 17, 2025. Logins will not be available and no jobs will be running during this window.

Please send any questions or concerns to support@hpc.ucalgary.ca. Apologies for the inconvenience.
}}

{{Message of the day item
| title = MARC Maintenance Complete
| date = 2025/06/17
| message = Filesystem maintenance complete.

Please send any questions or concerns to support@hpc.ucalgary.ca.
}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ⚠️ MARC Update Week of January 12

MARC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Filesystem Outage Feb 23, 2026 Starting at 7AM
| date = 2026/02/17
| message = ⚠️ Filesystem Outage Affecting Arc, Marc, Talc, Cloudstack

Filesystems will be unavailable Feb 23 starting at 7AM MST. This outage is expected to end prior to 8PM. No logins or file access will be possible until the outage is complete.

Any jobs queued must request timelimits less then the remaining time until Feb 23, 7AM or they will wait until the outage is complete.

Sorry for the inconvenience.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Filesystem Outage Complete
| date = 2026/02/23
| message = ✅ Filesystem Outage Complete

All clusters are back in production.

As of Friday Feb 20, 2026 - Due to some configuration issues on the network Fluent is not available on ARC at this time.
We are working to fix the issues and the software will return as soon as possible. Please try resubmitting any affected jobs later.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2026/06/22
| message =

}}

{{Message of the day item
| title = Upcoming File Server Update July 2, 2026. Starting at 9AM
| date = 2026/06/23
| message = File Server Update

We will be updating the file servers on July 2, 2026, beginning at 9AM continuing throughout the day. We do not expect any service interruptions or degradation during the process.

If you have any questions ahead of time, or experience any symptoms on the date, please contact RCS via support@hpc.ucalgary.ca
}}

ARC Cluster Status

2026-06-23T21:35:50Z

Cemagata:

{{ARC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 16, 2023, the ARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The ARC login node will reboot on the morning of January 16. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 20.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/02/28
| message =
We are currently investigating a filesystem issue that is causing filesystem slowdowns across ARC.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/03/1
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns across ARC. Some jobs on ARC have been paused to help us find the root cause of the slowdowns.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = ARC Login node reboot
| date = 2023/03/2
| message =
The ARC login node will be rebooted this afternoon for an emergency maintenance. This downtime is needed to help mitigate the filesystem slowdowns experienced on the login node. Jobs will continue running and scheduling during this time.

All logins to the ARC login node will be terminated at 3:00PM and will remain unavailable until 4:00PM.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = ⚠️ Filesystem Issues
| date = 2023/03/2
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns on specific nodes in our MSRDC location.

We will update you with more information as it becomes available.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues Resolved
| date = 2023/03/10
| message =
We have upgraded the filesystem routers in our MSRDC location to address the performance issues.

Please let us know if you experience any issues with the filesystem performance.

Thank-you for your patience.
}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/05/01
| message =
On May 1, 2023, the ARC Open OnDemand node will be rebooted between 5PM and 6PM. Expected downtime will be approximately 15 minutes.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on ARC Login Node
| date = 2023/06/22
| message =
Apptainer (Singularity) containers may experience an error when
running on the Arc login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.

}}

{{Message of the day item
| title = Lattice, Single, cpu2013 partition changes
| date = 2023/07/13
| message =
The Lattice and Single, and cpu2013 have all been decomissioned. The Single
partition will be replaced by the nodes formerly in the cpu2013 partition but
will be called single.

}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/10/17
| message =
Open OnDemand will be rebooted on October 17, 2023 for an update. It will be down for up to 30 minutes.

}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2024/05/3
| message =
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = Arc Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Arc administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation
| date = 2024/06/03
| message = Job submissions targeted to the GPU a100 partition will be
affected by a temporary reservation on the nodes to accommodate the RCS
summer school class taking place on 2024/Jun/10. Reservation will end
shortly after. Please submit your jobs normally and the scheduler will
start them as soon as the nodes are available. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation Removed
| date = 2024/06/11
| message = GPU a100 Nodes in ARC have been returned to normal scheduling.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/23
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). All compute nodes
in cpu2019, cpu2021/2, gpu-v100 most nodes from bigmem and gpu-a100 will be
affected. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024.

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The ARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = ⚠️ Scheduled Maintenance and OS Update
| date = 2025/01/15
| message = The ARC cluster will be down for maintenance and upgrades starting 9AM Monday, January 20, 2025 through Wednesday, January 22, 2025.

For the duration of the upgrade window:
* Scheduling will be paused and new jobs will be queued. Any queued jobs will start scheduling only after the upgrade is complete.
* Access to files via the login node and arc-dtn will generally be available but intermittent. File transfers on the DTN node, including Globus file transfers, may be interrupted during this window.

Please make sure to save your work prior to this outage window to avoid any loss of work.

During this time the following changes will happen:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer will be replaced. Access to /bulk will be unavailable on Wednesday, January 22, 2025.

3. The compute node operating system will be updated to Rocky Linux 8.10.

4. The Slurm scheduling system will be upgraded.

5. The Open OnDemand web portal will be upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
Update Jan 18, 2025

Around 10AM Arc experienced an electrical power brownout. Some percentage (how many is unknown at this time) of the nodes lost electrical power during this time causing a loss of a number of running jobs.

Sorry for the inconvenience.

Since Arc is shutting down for maintenance on Monday Jan 20, replacement jobs will likely not start unless they request a timelimit less than the time until 8AM Monday.
⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
}}

{{Message of the day item
| title = Maintenance Complete
| date = 2025/01/22
| message = The ARC cluster upgrade is complete

During this time the following changes happened:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer was replaced successfully.

3. The compute node operating was updated to Rocky Linux 8.10.

4. The Slurm scheduling system was upgraded.

5. The Open OnDemand web portal was upgraded.

6. The Parallel partition was renamed to Legacy to show the lack of an interconnect for parallel MPI work and was restricted to maximum 4 node jobs.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

Jan 23, 9:08AM

Remount complete. arc is back in full service.
}}

{{Message of the day item
| title = Module Command Upgrade
| date = 2025/02/03
| message = Upgrade of the module command

On Tuesday, February 11, 2025 the module command will be upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules is not expected to change.
}}

{{Message of the day item
| title = Module Command Upgraded
| date = 2025/02/12
| message = The module command was upgraded

On Tuesday, February 12, 2025 the module command was upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules should not have changed.

}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = Interactive Job Timelimit will be Enforced
| date = 2025/04/11
| message = In order to improve the scheduling and job throughput efficiency of ARC, interactive jobs will be limited to a maximum of 5 hours of runtime. Interactive jobs that are submitted with a timelimit over 5 hours will be rejected at submission time. This change will be made on Monday, April 28, 2025.
}}

{{Message of the day item
| title = Interactive Job Timelimit Is Now Enforced
| date = 2025/04/28
| message = In order to improve the scheduling and job throughput efficiency of ARC, interactive jobs are now limited to a maximum of 5 hours of runtime. Interactive jobs that are submitted with a timelimit over 5 hours will be rejected at submission time.

Apr 29, 2025
To increase the security posture of the Arc cluster administrators will be installing Trend Micro on cluster login nodes over the week starting Apr 30. Please report any inconsistencies to support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = ⚠️ Bulk Filesystem Emergency Maintenance
| date = 2025/07/29
| message = The filer that provides the /bulk filesystem will be down for emergency repairs at 12 Noon on Thursday July 31. No access to files on /bulk will be possible for the duration of the multi-hour outage. Any jobs running that access /bulk will start and then pause when access to /bulk is attempted. Jobs should continue once service is restored. Sorry for the inconvenience.
}}

{{Message of the day item
| title = Bulk Filesystem Maintenance Complete
| date = 2025/08/01
| message = Maintenance on /bulk was completed successfully and all filesystems are back in service on Arc.
}}

{{Message of the day item
| title = GPU partition changes on ARC
| date = 2025/08/15
| message = New gpu-h100 and gpu-l40 partitions are available for general scheduling with new gpu hardware. gpu-v100 also has 6 fewer nodes. You can view more details about the node specs by running the arc.hardware script on the login node.
}}

{{Message of the day item
| title = Update and Bulk outage on ARC
| date = 2025/09/15
| message = ⚠️ Arc Update September 15-19

An update of the Arc cluster will begin on Sep 15. This will result in fewer resources while the compute nodes are restarted. The login node and Scheduler will be restarted on Sep 17.

⚠️ Bulk Filesystem Maintenance September 17
The filer that provides the /bulk filesystem will be down for emergency repairs at 9 AM on Wednesday Sep 17th. No access to files on /bulk will be possible for the duration of the multi-hour outage. Any jobs running that access /bulk will start and then pause when access to /bulk is attempted. Jobs should continue once service is restored. We apologize for any inconvenience.

}}

{{Message of the day item
| title = Update and Bulk outage on ARC
| date = 2025/09/18
| message = Arc update complete

The update to arc is complete.

}}

{{Message of the day item
| title = GPU partition changes on ARC
| date = 2025/09/23
| message = gpu-v100 has 6 more nodes. You can view more details about the node specs by running the arc.hardware script on the login node.
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2025/11/4
| message =
}}

{{Message of the day item
| title = Legacy compute nodes are being retired
| date = 2025/11/20
| message = ARC nodes cn[0513-1096] are being removed from the arc cluster. They will be removed from scheduling and removed from the cluster over the next while.
}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ⚠️ Arc Update Week of January 12

ARC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Arc Filesystem Returned to service, scheduling outages continue
| date = 2025/01/13
| message = ⚠️ Data access now possible ⚠️

The first stage of the maintenance is complete and the filesystems are once again available.

There is still significant work to do on the cluster so jobs will not start until this maintenance is complete but clients will be able to access data via the login node and DTN.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Arc Returned to service, scheduling resumed
| date = 2026/01/16
| message = Maintenance Complete

Arc has been returned to service.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = New Compute nodes added to Arc
| date = 2026/01/22
| message = cpu2025 partition is now available.

New nodes have been installed to replace the aging parallel nodes. They have 1TiB of memory and 128 cpus.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Filesystem Outage Feb 23, 2026 Starting at 7AM
| date = 2026/02/17
| message = ⚠️ Filesystem Outage Affecting Arc, Marc, Talc, Cloudstack

Filesystems will be unavailable Feb 23 starting at 7AM MST. This outage is expected to end prior to 8PM. No logins or file access will be possible until the outage is complete.

Any jobs queued must request timelimits less then the remaining time until Feb 23, 7AM or they will wait until the outage is complete.

Sorry for the inconvenience.

As of Friday Feb 20, 2026 - Due to some configuration issues on the network Fluent is not available on ARC at this time.
We are working to fix the issues and the software will return as soon as possible. Please try resubmitting any affected jobs later.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Filesystem Outage Complete
| date = 2026/02/23
| message = ✅ Filesystem Outage Complete

All clusters are back in production.

As of Friday Feb 20, 2026 - Due to some configuration issues on the network Fluent is not available on ARC at this time.
We are working to fix the issues and the software will return as soon as possible. Please try resubmitting any affected jobs later.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Arc Login and Scheduling Outage May 7, 2023, Starting at 9AM
| date = 2026/05/07
| message = ⚠️ Urgent Security Update

The Arc Support nodes (Arc login node, DTN, OOD, and scheduling system) will be unavailable starting at 9 AM on May 7 to install an urgent kernel update. You will be unable to login to Arc but queued jobs will continue to run. The compute nodes are actively being rebooted as they become idle resulting in fewer available resources for the next week or so.

Sorry for the inconvenience.

}}

{{Message of the day item
| title = Emergency Security Mitigation
| date = 2026/05/15
| message = ptrace has been disable on clusters

The ptrace system call has been temporarily disabled while we await a patch for CVE-2026-46333. This means that software such as gdb or strace will not work.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Arc Login and Scheduling Outage June 3, 2026, Starting at 9AM
| date = 2026/06/03
| message = ⚠️ Urgent Security Update

The Arc Support nodes (Arc login node, DTN, OOD, and scheduling system) will be unavailable starting at 9 AM on June 3, 2026 to install an urgent kernel update. You will be unable to login to Arc but queued jobs will continue to run. The compute nodes are actively being rebooted as they become idle resulting in fewer available resources for the next week or so.

Sorry for the inconvenience.

}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2026/06/22
| message =
}}

{{Message of the day item
| title = Upcoming File Server Update July 2, 2026. Starting at 9AM
| date = 2026/06/23
| message = File Server Update

We will be updating the file servers on July 2, 2026, beginning at 9AM continuing throughout the day. We do not expect any service interruptions or degradation during the process.

If you have any questions ahead of time, or experience any symptoms on the date, please contact RCS via support@hpc.ucalgary.ca
}}

{{Navbox ARC}}
[[Category:ARC]]

MARC Cluster Status

2026-06-22T20:15:18Z

Cemagata:

GLaDOS Cluster Status

2026-06-22T20:14:50Z

Cemagata:

{{GLaDOS Cluster Status}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 30, 2023, the GLaDOS cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The GLaDOS login node will reboot on the morning of January 30. Please save your work and log out if possible.

The upgrade is planned to be fully complete by February 3.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/31
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on GLaDOS Login Node
| date = 2023/06/23
| message =
Apptainer (Singularity) containers may experience an error when
running on the GLaDOS login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.
}}

{{Message of the day item
| title = GLaDOS Scheduled Temporary Shutdown for Move
| date = 2023/06/26
| message =
GLaDOS is scheduled to be shut down temporarily to allow for the
cluster to be physically moved beginning Tuesday September 5, 2023
The cluster is expected to be down the rest of the week and back
online on or before Monday the 11th.

Please send any questions or concerns to support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = GLaDOS Move Complete
| date = 2023/09/11
| message =
GLaDOS has been moved and jobs can be submitted for scheduling.

Please send any questions or concerns to support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = Glados Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = OS updates complete
| date = 2024/05/07
| message = Glados has been updated to Rocky Linux 8.10 and is operating normally

Please reach out with any questions or concerns to support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = Update Complete on Glados
| date = 2026/05/07
| message = Update complete

The update of the Glados cluster is complete.

}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2026/06/22
| message =

}}
[[Category:GLaDOS]]
{{Navbox GLaDOS}}

Altis Login Node Status

2026-06-22T20:14:27Z

Cemagata:

Think Login Node Status

2026-06-22T20:13:09Z

Cemagata:

ARC Cluster Status

2026-06-22T20:09:50Z

Cemagata:

ARC Cluster Status

2026-02-20T21:56:02Z

Cemagata:

ARC Cluster Status

2026-02-20T19:09:34Z

Cemagata:

{{ARC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 16, 2023, the ARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The ARC login node will reboot on the morning of January 16. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 20.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/02/28
| message =
We are currently investigating a filesystem issue that is causing filesystem slowdowns across ARC.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/03/1
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns across ARC. Some jobs on ARC have been paused to help us find the root cause of the slowdowns.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = ARC Login node reboot
| date = 2023/03/2
| message =
The ARC login node will be rebooted this afternoon for an emergency maintenance. This downtime is needed to help mitigate the filesystem slowdowns experienced on the login node. Jobs will continue running and scheduling during this time.

All logins to the ARC login node will be terminated at 3:00PM and will remain unavailable until 4:00PM.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = ⚠️ Filesystem Issues
| date = 2023/03/2
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns on specific nodes in our MSRDC location.

We will update you with more information as it becomes available.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues Resolved
| date = 2023/03/10
| message =
We have upgraded the filesystem routers in our MSRDC location to address the performance issues.

Please let us know if you experience any issues with the filesystem performance.

Thank-you for your patience.
}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/05/01
| message =
On May 1, 2023, the ARC Open OnDemand node will be rebooted between 5PM and 6PM. Expected downtime will be approximately 15 minutes.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on ARC Login Node
| date = 2023/06/22
| message =
Apptainer (Singularity) containers may experience an error when
running on the Arc login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.

}}

{{Message of the day item
| title = Lattice, Single, cpu2013 partition changes
| date = 2023/07/13
| message =
The Lattice and Single, and cpu2013 have all been decomissioned. The Single
partition will be replaced by the nodes formerly in the cpu2013 partition but
will be called single.

}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/10/17
| message =
Open OnDemand will be rebooted on October 17, 2023 for an update. It will be down for up to 30 minutes.

}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2024/05/3
| message =
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = Arc Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Arc administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation
| date = 2024/06/03
| message = Job submissions targeted to the GPU a100 partition will be
affected by a temporary reservation on the nodes to accommodate the RCS
summer school class taking place on 2024/Jun/10. Reservation will end
shortly after. Please submit your jobs normally and the scheduler will
start them as soon as the nodes are available. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation Removed
| date = 2024/06/11
| message = GPU a100 Nodes in ARC have been returned to normal scheduling.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/23
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). All compute nodes
in cpu2019, cpu2021/2, gpu-v100 most nodes from bigmem and gpu-a100 will be
affected. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024.

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The ARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = ⚠️ Scheduled Maintenance and OS Update
| date = 2025/01/15
| message = The ARC cluster will be down for maintenance and upgrades starting 9AM Monday, January 20, 2025 through Wednesday, January 22, 2025.

For the duration of the upgrade window:
* Scheduling will be paused and new jobs will be queued. Any queued jobs will start scheduling only after the upgrade is complete.
* Access to files via the login node and arc-dtn will generally be available but intermittent. File transfers on the DTN node, including Globus file transfers, may be interrupted during this window.

Please make sure to save your work prior to this outage window to avoid any loss of work.

During this time the following changes will happen:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer will be replaced. Access to /bulk will be unavailable on Wednesday, January 22, 2025.

3. The compute node operating system will be updated to Rocky Linux 8.10.

4. The Slurm scheduling system will be upgraded.

5. The Open OnDemand web portal will be upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
Update Jan 18, 2025

Around 10AM Arc experienced an electrical power brownout. Some percentage (how many is unknown at this time) of the nodes lost electrical power during this time causing a loss of a number of running jobs.

Sorry for the inconvenience.

Since Arc is shutting down for maintenance on Monday Jan 20, replacement jobs will likely not start unless they request a timelimit less than the time until 8AM Monday.
⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
}}

{{Message of the day item
| title = Maintenance Complete
| date = 2025/01/22
| message = The ARC cluster upgrade is complete

During this time the following changes happened:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer was replaced successfully.

3. The compute node operating was updated to Rocky Linux 8.10.

4. The Slurm scheduling system was upgraded.

5. The Open OnDemand web portal was upgraded.

6. The Parallel partition was renamed to Legacy to show the lack of an interconnect for parallel MPI work and was restricted to maximum 4 node jobs.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

Jan 23, 9:08AM

Remount complete. arc is back in full service.
}}

{{Message of the day item
| title = Module Command Upgrade
| date = 2025/02/03
| message = Upgrade of the module command

On Tuesday, February 11, 2025 the module command will be upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules is not expected to change.
}}

{{Message of the day item
| title = Module Command Upgraded
| date = 2025/02/12
| message = The module command was upgraded

On Tuesday, February 12, 2025 the module command was upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules should not have changed.

}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = Interactive Job Timelimit will be Enforced
| date = 2025/04/11
| message = In order to improve the scheduling and job throughput efficiency of ARC, interactive jobs will be limited to a maximum of 5 hours of runtime. Interactive jobs that are submitted with a timelimit over 5 hours will be rejected at submission time. This change will be made on Monday, April 28, 2025.
}}

{{Message of the day item
| title = Interactive Job Timelimit Is Now Enforced
| date = 2025/04/28
| message = In order to improve the scheduling and job throughput efficiency of ARC, interactive jobs are now limited to a maximum of 5 hours of runtime. Interactive jobs that are submitted with a timelimit over 5 hours will be rejected at submission time.

Apr 29, 2025
To increase the security posture of the Arc cluster administrators will be installing Trend Micro on cluster login nodes over the week starting Apr 30. Please report any inconsistencies to support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = ⚠️ Bulk Filesystem Emergency Maintenance
| date = 2025/07/29
| message = The filer that provides the /bulk filesystem will be down for emergency repairs at 12 Noon on Thursday July 31. No access to files on /bulk will be possible for the duration of the multi-hour outage. Any jobs running that access /bulk will start and then pause when access to /bulk is attempted. Jobs should continue once service is restored. Sorry for the inconvenience.
}}

{{Message of the day item
| title = Bulk Filesystem Maintenance Complete
| date = 2025/08/01
| message = Maintenance on /bulk was completed successfully and all filesystems are back in service on Arc.
}}

{{Message of the day item
| title = GPU partition changes on ARC
| date = 2025/08/15
| message = New gpu-h100 and gpu-l40 partitions are available for general scheduling with new gpu hardware. gpu-v100 also has 6 fewer nodes. You can view more details about the node specs by running the arc.hardware script on the login node.
}}

{{Message of the day item
| title = Update and Bulk outage on ARC
| date = 2025/09/15
| message = ⚠️ Arc Update September 15-19

An update of the Arc cluster will begin on Sep 15. This will result in fewer resources while the compute nodes are restarted. The login node and Scheduler will be restarted on Sep 17.

⚠️ Bulk Filesystem Maintenance September 17
The filer that provides the /bulk filesystem will be down for emergency repairs at 9 AM on Wednesday Sep 17th. No access to files on /bulk will be possible for the duration of the multi-hour outage. Any jobs running that access /bulk will start and then pause when access to /bulk is attempted. Jobs should continue once service is restored. We apologize for any inconvenience.

}}

{{Message of the day item
| title = Update and Bulk outage on ARC
| date = 2025/09/18
| message = Arc update complete

The update to arc is complete.

}}

{{Message of the day item
| title = GPU partition changes on ARC
| date = 2025/09/23
| message = gpu-v100 has 6 more nodes. You can view more details about the node specs by running the arc.hardware script on the login node.
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2025/11/4
| message =
}}

{{Message of the day item
| title = Legacy compute nodes are being retired
| date = 2025/11/20
| message = ARC nodes cn[0513-1096] are being removed from the arc cluster. They will be removed from scheduling and removed from the cluster over the next while.
}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ⚠️ Arc Update Week of January 12

ARC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Arc Filesystem Returned to service, scheduling outages continue
| date = 2025/01/13
| message = ⚠️ Data access now possible ⚠️

The first stage of the maintenance is complete and the filesystems are once again available.

There is still significant work to do on the cluster so jobs will not start until this maintenance is complete but clients will be able to access data via the login node and DTN.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Arc Returned to service, scheduling resumed
| date = 2026/01/16
| message = Maintenance Complete

Arc has been returned to service.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = New Compute nodes added to Arc
| date = 2026/01/22
| message = cpu2025 partition is now available.

New nodes have been installed to replace the aging parallel nodes. They have 1TiB of memory and 128 cpus.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Filesystem Outage Feb 23, 2026 Starting at 7AM
| date = 2026/02/17
| message = ⚠️ Filesystem Outage Affecting Arc, Marc, Talc, Cloudstack

Filesystems will be unavailable Feb 23 starting at 7AM MST. This outage is expected to end prior to 8PM. No logins or file access will be possible until the outage is complete.

Any jobs queued must request timelimits less then the remaining time until Feb 23, 7AM or they will wait until the outage is complete.

Sorry for the inconvenience.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = Ansys Fluent is currently unavailable on ARC
| date = 2026/02/17
| message = Due to some configuration issues on the network Fluent is not available on ARC at this time.
We are working to fix the issues and the software will return as soon as possible. Please try resubmitting any affected jobs later.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

{{Navbox ARC}}
[[Category:ARC]]

Altis Login Node Status

2025-12-16T19:46:34Z

Cemagata:

Think Login Node Status

2025-12-16T19:46:18Z

Cemagata:

MARC Cluster Status

2025-12-16T19:45:22Z

Cemagata:

TALC Cluster Status

2025-12-16T19:45:10Z

Cemagata:

MARC Cluster Status

2025-12-16T19:44:36Z

Cemagata:

{{Cluster Status
| cluster = MARC
| status = green
| title = Cluster operational
| message = See the [[MARC Cluster Status]] page for system notices.
}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 23, 2023, the MARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The MARC login node will reboot on the morning of January 23. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 27.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on MARC Login Node
| date = 2023/06/23
| message =
Apptainer (Singularity) containers may experience an error when
running on the MARC login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.
}}besian.sejdiu

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = OS Upgrade MARC/ARC cluster
| date = 2024/09/11
| message =
MARC will be going down for OS upgrades on 2024/Sep/16. The cluster
will be unavailable temporarily to complete this work. Please contact
support@hpc.ucalgary.ca if you have any questions or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The MARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The MARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = MARC Scheduled File System Maintenance
| date = 2025/06/09
| message = Please be advised MARC will be going down for a period of approximately 2 hours starting at 10 AM June 17, 2025. Logins will not be available and no jobs will be running during this window.

Please send any questions or concerns to support@hpc.ucalgary.ca. Apologies for the inconvenience.
}}

{{Message of the day item
| title = MARC Maintenance Complete
| date = 2025/06/17
| message = Filesystem maintenance complete.

Please send any questions or concerns to support@hpc.ucalgary.ca.
}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ⚠️ Arc Update Week of January 12

MARC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.

If you have questions or concerns, please contact support@hpc.ucalgary.ca
}}

ARC Cluster Status

2025-12-16T19:44:01Z

Cemagata:

ARC Cluster Status

2025-12-16T19:41:22Z

Cemagata:

{{ARC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 16, 2023, the ARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The ARC login node will reboot on the morning of January 16. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 20.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/02/28
| message =
We are currently investigating a filesystem issue that is causing filesystem slowdowns across ARC.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/03/1
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns across ARC. Some jobs on ARC have been paused to help us find the root cause of the slowdowns.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = ARC Login node reboot
| date = 2023/03/2
| message =
The ARC login node will be rebooted this afternoon for an emergency maintenance. This downtime is needed to help mitigate the filesystem slowdowns experienced on the login node. Jobs will continue running and scheduling during this time.

All logins to the ARC login node will be terminated at 3:00PM and will remain unavailable until 4:00PM.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = ⚠️ Filesystem Issues
| date = 2023/03/2
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns on specific nodes in our MSRDC location.

We will update you with more information as it becomes available.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues Resolved
| date = 2023/03/10
| message =
We have upgraded the filesystem routers in our MSRDC location to address the performance issues.

Please let us know if you experience any issues with the filesystem performance.

Thank-you for your patience.
}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/05/01
| message =
On May 1, 2023, the ARC Open OnDemand node will be rebooted between 5PM and 6PM. Expected downtime will be approximately 15 minutes.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on ARC Login Node
| date = 2023/06/22
| message =
Apptainer (Singularity) containers may experience an error when
running on the Arc login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.

}}

{{Message of the day item
| title = Lattice, Single, cpu2013 partition changes
| date = 2023/07/13
| message =
The Lattice and Single, and cpu2013 have all been decomissioned. The Single
partition will be replaced by the nodes formerly in the cpu2013 partition but
will be called single.

}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/10/17
| message =
Open OnDemand will be rebooted on October 17, 2023 for an update. It will be down for up to 30 minutes.

}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2024/05/3
| message =
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = Arc Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Arc administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation
| date = 2024/06/03
| message = Job submissions targeted to the GPU a100 partition will be
affected by a temporary reservation on the nodes to accommodate the RCS
summer school class taking place on 2024/Jun/10. Reservation will end
shortly after. Please submit your jobs normally and the scheduler will
start them as soon as the nodes are available. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation Removed
| date = 2024/06/11
| message = GPU a100 Nodes in ARC have been returned to normal scheduling.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/23
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). All compute nodes
in cpu2019, cpu2021/2, gpu-v100 most nodes from bigmem and gpu-a100 will be
affected. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024.

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The ARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = ⚠️ Scheduled Maintenance and OS Update
| date = 2025/01/15
| message = The ARC cluster will be down for maintenance and upgrades starting 9AM Monday, January 20, 2025 through Wednesday, January 22, 2025.

For the duration of the upgrade window:
* Scheduling will be paused and new jobs will be queued. Any queued jobs will start scheduling only after the upgrade is complete.
* Access to files via the login node and arc-dtn will generally be available but intermittent. File transfers on the DTN node, including Globus file transfers, may be interrupted during this window.

Please make sure to save your work prior to this outage window to avoid any loss of work.

During this time the following changes will happen:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer will be replaced. Access to /bulk will be unavailable on Wednesday, January 22, 2025.

3. The compute node operating system will be updated to Rocky Linux 8.10.

4. The Slurm scheduling system will be upgraded.

5. The Open OnDemand web portal will be upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
Update Jan 18, 2025

Around 10AM Arc experienced an electrical power brownout. Some percentage (how many is unknown at this time) of the nodes lost electrical power during this time causing a loss of a number of running jobs.

Sorry for the inconvenience.

Since Arc is shutting down for maintenance on Monday Jan 20, replacement jobs will likely not start unless they request a timelimit less than the time until 8AM Monday.
⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
}}

{{Message of the day item
| title = Maintenance Complete
| date = 2025/01/22
| message = The ARC cluster upgrade is complete

During this time the following changes happened:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer was replaced successfully.

3. The compute node operating was updated to Rocky Linux 8.10.

4. The Slurm scheduling system was upgraded.

5. The Open OnDemand web portal was upgraded.

6. The Parallel partition was renamed to Legacy to show the lack of an interconnect for parallel MPI work and was restricted to maximum 4 node jobs.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

Jan 23, 9:08AM

Remount complete. arc is back in full service.
}}

{{Message of the day item
| title = Module Command Upgrade
| date = 2025/02/03
| message = Upgrade of the module command

On Tuesday, February 11, 2025 the module command will be upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules is not expected to change.
}}

{{Message of the day item
| title = Module Command Upgraded
| date = 2025/02/12
| message = The module command was upgraded

On Tuesday, February 12, 2025 the module command was upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules should not have changed.

}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = Interactive Job Timelimit will be Enforced
| date = 2025/04/11
| message = In order to improve the scheduling and job throughput efficiency of ARC, interactive jobs will be limited to a maximum of 5 hours of runtime. Interactive jobs that are submitted with a timelimit over 5 hours will be rejected at submission time. This change will be made on Monday, April 28, 2025.
}}

{{Message of the day item
| title = Interactive Job Timelimit Is Now Enforced
| date = 2025/04/28
| message = In order to improve the scheduling and job throughput efficiency of ARC, interactive jobs are now limited to a maximum of 5 hours of runtime. Interactive jobs that are submitted with a timelimit over 5 hours will be rejected at submission time.

Apr 29, 2025
To increase the security posture of the Arc cluster administrators will be installing Trend Micro on cluster login nodes over the week starting Apr 30. Please report any inconsistencies to support@hpc.ucalgary.ca
}}

{{Message of the day item
| title = ⚠️ Bulk Filesystem Emergency Maintenance
| date = 2025/07/29
| message = The filer that provides the /bulk filesystem will be down for emergency repairs at 12 Noon on Thursday July 31. No access to files on /bulk will be possible for the duration of the multi-hour outage. Any jobs running that access /bulk will start and then pause when access to /bulk is attempted. Jobs should continue once service is restored. Sorry for the inconvenience.
}}

{{Message of the day item
| title = Bulk Filesystem Maintenance Complete
| date = 2025/08/01
| message = Maintenance on /bulk was completed successfully and all filesystems are back in service on Arc.
}}

{{Message of the day item
| title = GPU partition changes on ARC
| date = 2025/08/15
| message = New gpu-h100 and gpu-l40 partitions are available for general scheduling with new gpu hardware. gpu-v100 also has 6 fewer nodes. You can view more details about the node specs by running the arc.hardware script on the login node.
}}

{{Message of the day item
| title = Update and Bulk outage on ARC
| date = 2025/09/15
| message = ⚠️ Arc Update September 15-19

An update of the Arc cluster will begin on Sep 15. This will result in fewer resources while the compute nodes are restarted. The login node and Scheduler will be restarted on Sep 17.

⚠️ Bulk Filesystem Maintenance September 17
The filer that provides the /bulk filesystem will be down for emergency repairs at 9 AM on Wednesday Sep 17th. No access to files on /bulk will be possible for the duration of the multi-hour outage. Any jobs running that access /bulk will start and then pause when access to /bulk is attempted. Jobs should continue once service is restored. We apologize for any inconvenience.

}}

{{Message of the day item
| title = Update and Bulk outage on ARC
| date = 2025/09/18
| message = Arc update complete

The update to arc is complete.

}}

{{Message of the day item
| title = GPU partition changes on ARC
| date = 2025/09/23
| message = gpu-v100 has 6 more nodes. You can view more details about the node specs by running the arc.hardware script on the login node.
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2025/11/4
| message =
}}

{{Message of the day item
| title = Legacy compute nodes are being retired
| date = 2025/11/20
| message = ARC nodes cn[0513-1096] are being removed from the arc cluster. They will be removed from scheduling and removed from the cluster over the next while.
}}

{{Message of the day item
| title = Planned outage in Jan 2026
| date = 2025/12/26
| message = ARC will be going down periodically during the week of 2026/Jan/12 to allow for system maintenance. All nodes and filesystems will be unavailable for use during the outage, and filesystem performance may be variable following the upgrade for a time until the changes finish.
}}

{{Navbox ARC}}
[[Category:ARC]]

ARC Cluster Status

2025-11-20T17:29:39Z

Cemagata:

ARC Cluster Status

2025-11-04T16:43:30Z

Cemagata:

ARC Cluster Status

2025-09-23T16:01:57Z

Cemagata:

ARC Cluster Status

2025-08-15T17:38:57Z

Cemagata:

MARC Cluster Status

2025-06-09T17:57:06Z

Cemagata:

MARC Cluster Status

2025-06-09T17:55:40Z

Cemagata:

{{Cluster Status
| cluster = MARC
| status = green
| title = Cluster operational
| message = Upgrades are planned for Jan 20 2025. Please contact us if you experience system issues.
See the [[MARC Cluster Status]] page for system notices.
}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 23, 2023, the MARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The MARC login node will reboot on the morning of January 23. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 27.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on MARC Login Node
| date = 2023/06/23
| message =
Apptainer (Singularity) containers may experience an error when
running on the MARC login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.
}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = OS Upgrade MARC/ARC cluster
| date = 2024/09/11
| message =
MARC will be going down for OS upgrades on 2024/Sep/16. The cluster
will be unavailable temporarily to complete this work. Please contact
support@hpc.ucalgary.ca if you have any questions or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The MARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The MARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Message of the day item
| title = MARC Scheduled File System Maintenance
| date = 2025/06/09
| message = Please be advised MARC will be going down for a period of approximately 2 hours starting at 10 AM June 17, 2025. Logins will not be available and no jobs will be running during this window.

Please send any questions or concerns to support@hpc.ucalgary.ca. Apologies for the inconvenience.
}}

Altis Login Node Status

2025-03-10T20:50:45Z

Cemagata:

Think Login Node Status

2025-03-10T20:50:31Z

Cemagata:

TALC Cluster Status

2025-03-10T20:49:57Z

Cemagata:

GLaDOS Cluster Status

2025-03-10T20:49:35Z

Cemagata:

MARC Cluster Status

2025-03-10T20:49:19Z

Cemagata:

ARC Cluster Status

2025-03-10T20:48:55Z

Cemagata:

{{Cluster Status
| cluster = ARC
| status = green
| title = Cluster operational - Power Bump Jan 18
| message = System is operational. Updates are planned for Jan 20. Please see MOTD

See the [[ARC Cluster Status]] page for system notices.
}}

== System Messages ==
{{Message of the day item
| title = January System Updates
| date = 2023/01/01
| message =
Beginning January 16, 2023, the ARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The ARC login node will reboot on the morning of January 16. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 20.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/02/28
| message =
We are currently investigating a filesystem issue that is causing filesystem slowdowns across ARC.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/03/1
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns across ARC. Some jobs on ARC have been paused to help us find the root cause of the slowdowns.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = ARC Login node reboot
| date = 2023/03/2
| message =
The ARC login node will be rebooted this afternoon for an emergency maintenance. This downtime is needed to help mitigate the filesystem slowdowns experienced on the login node. Jobs will continue running and scheduling during this time.

All logins to the ARC login node will be terminated at 3:00PM and will remain unavailable until 4:00PM.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = ⚠️ Filesystem Issues
| date = 2023/03/2
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns on specific nodes in our MSRDC location.

We will update you with more information as it becomes available.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues Resolved
| date = 2023/03/10
| message =
We have upgraded the filesystem routers in our MSRDC location to address the performance issues.

Please let us know if you experience any issues with the filesystem performance.

Thank-you for your patience.
}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/05/01
| message =
On May 1, 2023, the ARC Open OnDemand node will be rebooted between 5PM and 6PM. Expected downtime will be approximately 15 minutes.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on ARC Login Node
| date = 2023/06/22
| message =
Apptainer (Singularity) containers may experience an error when
running on the Arc login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.

}}

{{Message of the day item
| title = Lattice, Single, cpu2013 partition changes
| date = 2023/07/13
| message =
The Lattice and Single, and cpu2013 have all been decomissioned. The Single
partition will be replaced by the nodes formerly in the cpu2013 partition but
will be called single.

}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/10/17
| message =
Open OnDemand will be rebooted on October 17, 2023 for an update. It will be down for up to 30 minutes.

}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2024/05/3
| message =
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = Arc Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Arc administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation
| date = 2024/06/03
| message = Job submissions targeted to the GPU a100 partition will be
affected by a temporary reservation on the nodes to accommodate the RCS
summer school class taking place on 2024/Jun/10. Reservation will end
shortly after. Please submit your jobs normally and the scheduler will
start them as soon as the nodes are available. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation Removed
| date = 2024/06/11
| message = GPU a100 Nodes in ARC have been returned to normal scheduling.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/23
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). All compute nodes
in cpu2019, cpu2021/2, gpu-v100 most nodes from bigmem and gpu-a100 will be
affected. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024.

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The ARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = ⚠️ Scheduled Maintenance and OS Update
| date = 2025/01/15
| message = The ARC cluster will be down for maintenance and upgrades starting 9AM Monday, January 20, 2025 through Wednesday, January 22, 2025.

For the duration of the upgrade window:
* Scheduling will be paused and new jobs will be queued. Any queued jobs will start scheduling only after the upgrade is complete.
* Access to files via the login node and arc-dtn will generally be available but intermittent. File transfers on the DTN node, including Globus file transfers, may be interrupted during this window.

Please make sure to save your work prior to this outage window to avoid any loss of work.

During this time the following changes will happen:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer will be replaced. Access to /bulk will be unavailable on Wednesday, January 22, 2025.

3. The compute node operating system will be updated to Rocky Linux 8.10.

4. The Slurm scheduling system will be upgraded.

5. The Open OnDemand web portal will be upgraded.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
Update Jan 18, 2025

Around 10AM Arc experienced an electrical power brownout. Some percentage (how many is unknown at this time) of the nodes lost electrical power during this time causing a loss of a number of running jobs.

Sorry for the inconvenience.

Since Arc is shutting down for maintenance on Monday Jan 20, replacement jobs will likely not start unless they request a timelimit less than the time until 8AM Monday.
⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️⚠️
}}

{{Message of the day item
| title = Maintenance Complete
| date = 2025/01/22
| message = The ARC cluster upgrade is complete

During this time the following changes happened:

1. Ethernet will replace the 11 year old, unsupported Infiniband on the following partitions:
* cpu2023 (temporary)
* Parallel
* Theia/Synergy/cpu2017-bf05
* Single
Any multi-node jobs (MPI) running on these partitions will have increased latency going forward. If you run multi-node jobs, make sure to run on a partition such as cpu2019, cpu2021, cpu2022.

2. A component of the NetApp filer was replaced successfully.

3. The compute node operating was updated to Rocky Linux 8.10.

4. The Slurm scheduling system was upgraded.

5. The Open OnDemand web portal was upgraded.

6. The Parallel partition was renamed to Legacy to show the lack of an interconnect for parallel MPI work and was restricted to maximum 4 node jobs.

Please reach out to support@hpc.calgary.ca with any issues or concerns.

Jan 23, 9:08AM

Remount complete. arc is back in full service.
}}

{{Message of the day item
| title = Module Command Upgrade
| date = 2025/02/03
| message = Upgrade of the module command

On Tuesday, February 11, 2025 the module command will be upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules is not expected to change.
}}

{{Message of the day item
| title = Module Command Upgraded
| date = 2025/02/12
| message = The module command was upgraded

On Tuesday, February 12, 2025 the module command was upgraded to a new verson on Arc. This should result in new capabilities and a slightly different visual experience when using the module command. Loading modules should not have changed.

}}

{{Message of the day item
| title = Support email address down
| date = 2025/03/07
| message = support@hpc.ucalgary.ca Unavailable

Please be informed that our support email address (support@hpc.ucalgary.ca) for RCS is currently not working. We are working to bring it back as soon as possible. Please keep an eye on this space for updates. The clusters are working normally, but support will not receive your messages at this time. We will begin responding as soon as we can get it back.

Apologies for the inconvenience.

}}

{{Message of the day item
| title = Support email address functional
| date = 2025/03/07
| message = support@hpc.ucalgary.ca is back

support@hpc.ucalgary.ca has been repaired and RCS can be contacted there. If you had reached out for assistance in recent days without response please follow up as we may not have received your initial email.

Apologies for the inconvenience.
}}

{{Navbox ARC}}
[[Category:ARC]]

Altis Login Node Status

2025-03-07T20:09:25Z

Cemagata:

Think Login Node Status

2025-03-07T20:09:12Z

Cemagata:

TALC Cluster Status

2025-03-07T20:08:52Z

Cemagata:

GLaDOS Cluster Status

2025-03-07T20:08:31Z

Cemagata:

MARC Cluster Status

2025-03-07T20:08:12Z

Cemagata:

ARC Cluster Status

2025-03-07T20:07:48Z

Cemagata:

GLaDOS Cluster Status

2025-01-08T21:36:28Z

Cemagata:

Think Login Node Status

2025-01-07T22:39:24Z

Cemagata:

Altis Login Node Status

2025-01-07T22:38:11Z

Cemagata:

ARC Cluster Status

2025-01-07T22:22:19Z

Cemagata:

{{Cluster Status
| cluster = ARC
| status = green
| title = Cluster operational
| message = System is operational. Updates are planned for Jan 20. Please see MOTD

See the [[ARC Cluster Status]] page for system notices.
}}

== System Messages ==
{{Message of the day item
| title = January System Updates
| date = 2023/01/01
| message =
Beginning January 16, 2023, the ARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The ARC login node will reboot on the morning of January 16. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 20.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/02/28
| message =
We are currently investigating a filesystem issue that is causing filesystem slowdowns across ARC.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/03/1
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns across ARC. Some jobs on ARC have been paused to help us find the root cause of the slowdowns.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = ARC Login node reboot
| date = 2023/03/2
| message =
The ARC login node will be rebooted this afternoon for an emergency maintenance. This downtime is needed to help mitigate the filesystem slowdowns experienced on the login node. Jobs will continue running and scheduling during this time.

All logins to the ARC login node will be terminated at 3:00PM and will remain unavailable until 4:00PM.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = ⚠️ Filesystem Issues
| date = 2023/03/2
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns on specific nodes in our MSRDC location.

We will update you with more information as it becomes available.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues Resolved
| date = 2023/03/10
| message =
We have upgraded the filesystem routers in our MSRDC location to address the performance issues.

Please let us know if you experience any issues with the filesystem performance.

Thank-you for your patience.
}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/05/01
| message =
On May 1, 2023, the ARC Open OnDemand node will be rebooted between 5PM and 6PM. Expected downtime will be approximately 15 minutes.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on ARC Login Node
| date = 2023/06/22
| message =
Apptainer (Singularity) containers may experience an error when
running on the Arc login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.

}}

{{Message of the day item
| title = Lattice, Single, cpu2013 partition changes
| date = 2023/07/13
| message =
The Lattice and Single, and cpu2013 have all been decomissioned. The Single
partition will be replaced by the nodes formerly in the cpu2013 partition but
will be called single.

}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/10/17
| message =
Open OnDemand will be rebooted on October 17, 2023 for an update. It will be down for up to 30 minutes.

}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2024/05/3
| message =
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = Arc Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Arc administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation
| date = 2024/06/03
| message = Job submissions targeted to the GPU a100 partition will be
affected by a temporary reservation on the nodes to accommodate the RCS
summer school class taking place on 2024/Jun/10. Reservation will end
shortly after. Please submit your jobs normally and the scheduler will
start them as soon as the nodes are available. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation Removed
| date = 2024/06/11
| message = GPU a100 Nodes in ARC have been returned to normal scheduling.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/23
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). All compute nodes
in cpu2019, cpu2021/2, gpu-v100 most nodes from bigmem and gpu-a100 will be
affected. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024.

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The ARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Navbox ARC}}
[[Category:ARC]]

MARC Cluster Status

2025-01-07T22:22:13Z

Cemagata:

ARC Cluster Status

2025-01-07T21:58:56Z

Cemagata:

{{ARC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = January System Updates
| date = 2023/01/01
| message =
Beginning January 16, 2023, the ARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The ARC login node will reboot on the morning of January 16. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 20.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/02/28
| message =
We are currently investigating a filesystem issue that is causing filesystem slowdowns across ARC.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues
| date = 2023/03/1
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns across ARC. Some jobs on ARC have been paused to help us find the root cause of the slowdowns.

We will update you with more information as it becomes available.

Thank you for your patience.
}}

{{Message of the day item
| title = ARC Login node reboot
| date = 2023/03/2
| message =
The ARC login node will be rebooted this afternoon for an emergency maintenance. This downtime is needed to help mitigate the filesystem slowdowns experienced on the login node. Jobs will continue running and scheduling during this time.

All logins to the ARC login node will be terminated at 3:00PM and will remain unavailable until 4:00PM.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = ⚠️ Filesystem Issues
| date = 2023/03/2
| message =
We are still currently investigating a filesystem issue that is causing filesystem slowdowns on specific nodes in our MSRDC location.

We will update you with more information as it becomes available.

We apologize for the inconvenience and thank you for your patience.
}}

{{Message of the day item
| title = Filesystem Issues Resolved
| date = 2023/03/10
| message =
We have upgraded the filesystem routers in our MSRDC location to address the performance issues.

Please let us know if you experience any issues with the filesystem performance.

Thank-you for your patience.
}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/05/01
| message =
On May 1, 2023, the ARC Open OnDemand node will be rebooted between 5PM and 6PM. Expected downtime will be approximately 15 minutes.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on ARC Login Node
| date = 2023/06/22
| message =
Apptainer (Singularity) containers may experience an error when
running on the Arc login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.

}}

{{Message of the day item
| title = Lattice, Single, cpu2013 partition changes
| date = 2023/07/13
| message =
The Lattice and Single, and cpu2013 have all been decomissioned. The Single
partition will be replaced by the nodes formerly in the cpu2013 partition but
will be called single.

}}

{{Message of the day item
| title = Open OnDemand reboot
| date = 2023/10/17
| message =
Open OnDemand will be rebooted on October 17, 2023 for an update. It will be down for up to 30 minutes.

}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = Systems Operating Normally
| date = 2024/05/3
| message =
}}

{{Message of the day item
| title = Power Interruption
| date = 2024/05/07
| message = Arc Experienced an brief power outage around 11AM May 7, 2024.
Most compute nodes have or are rebooting. Most jobs running at this time
were lost. Arc administrators are actively working on restarting compute
nodes. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation
| date = 2024/06/03
| message = Job submissions targeted to the GPU a100 partition will be
affected by a temporary reservation on the nodes to accommodate the RCS
summer school class taking place on 2024/Jun/10. Reservation will end
shortly after. Please submit your jobs normally and the scheduler will
start them as soon as the nodes are available. Sorry for the inconvenience.
}}

{{Message of the day item
| title = GPU a100 Node Reservation Removed
| date = 2024/06/11
| message = GPU a100 Nodes in ARC have been returned to normal scheduling.
}}

{{Message of the day item
| title = Notice of Upcoming Partial Outage
| date = 2024/08/23
| message = Several compute nodes from the ARC cluster will be unavailable
between Sept 23 to Sept 27 inclusive (subject to change). All compute nodes
in cpu2019, cpu2021/2, gpu-v100 most nodes from bigmem and gpu-a100 will be
affected. These nodes will return to service as soon as the work is complete.
}}

{{Message of the day item
| title = Partial Outage Update I
| date = 2024/09/25
| message = Due to hardware issues that is blocking our original maintenance window, most compute nodes that were taken offline on Monday has been brought back online today. An additional partial outage will occur again starting next Tuesday for the same nodes.

On Tuesday, October 1, 2024, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until Friday October 4, 2024.

We apologise for the inconvenience.
}}

{{Message of the day item
| title = Partial Outage Update II
| date = 2024/10/04
| message = The maintenance window will be extended until at least Monday, October 7, 2024 due to a power distribution issue in our renovated data centre.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Monday, October 7, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Partial Outage Update III
| date = 2024/10/07
| message = Due to technical issues beyond our control the maintenance window will be extended until at least Tuesday, October 15, 2024.

Currently, the compute nodes in cpu2019, cpu2021, cpu2022, gpu-v100, gpu-a100, and most nodes from bigmem will be unavailable until at least Tuesday, October 15, 2024. Affected WDF-Altis GPU nodes include: wdfgpu[1-2,6,8-12].

We apologize for the extended downtime and will update you as soon as we have additional information from our operations team.
}}

{{Message of the day item
| title = Normal Scheduling has resumed.
| date = 2024/10/08
| message = The ARC cluster has been successfully brought online and nodes are running jobs normally. We apologize for the extended downtime.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The ARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The ARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Navbox ARC}}
[[Category:ARC]]

MARC Cluster Status

2025-01-07T21:58:47Z

Cemagata:

{{MARC Cluster Status}}

== System Messages ==
{{Message of the day item
| title = ⚠️ January System Updates
| date = 2023/01/01
| message =
Beginning January 23, 2023, the MARC cluster will undergo operating system updates. We shall do our utmost to minimize disruption and allow ongoing jobs to be completed. New jobs may be temporarily held from scheduling.

The MARC login node will reboot on the morning of January 23. Please save your work and log out if possible.

The upgrade is planned to be fully complete by January 27.

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = System Updates Completed
| date = 2023/01/24
| message =
The upgrade has been completed. The following has been changed:
* OS Updated to Rocky Linux 8.7
* Slurm updated to 22.05.7
* Apptainer replaces Singularity
* Each job will have its own /tmp, /dev/shm, /run/user/$uid mounted

If you encounter any system issues, do not hesitate to let us know.

Thank you for your cooperation.
}}

{{Message of the day item
| title = Apptainer (Singularity) on MARC Login Node
| date = 2023/06/23
| message =
Apptainer (Singularity) containers may experience an error when
running on the MARC login node. If apptainer complains that a system
administrator needs to enable user namespaces, simply run your
containers inside a job.

This is a temporary measure due to security vulnerability that will be
patched soon.
}}

{{Message of the day item
| title = Storage Upgrade MARC/ARC cluster
| date = 2023/10/23
| message =
We will be performing storage upgrades on the MARC/ARC cluster on
November 16 and 17, 2023. To facilitate this, we will be throttling
down the number of jobs on both clusters while the upgrades are
performed
}}

{{Message of the day item
| title = OS Upgrade MARC/ARC cluster
| date = 2024/09/11
| message =
MARC will be going down for OS upgrades on 2024/Sep/16. The cluster
will be unavailable temporarily to complete this work. Please contact
support@hpc.ucalgary.ca if you have any questions or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance
| date = 2024/12/11
| message = The MARC login node will be rebooted on Tuesday December 17 for scheduled maintenance. It will be down for a few minutes and return shortly. Job scheduling and jobs running on the cluster will not be affected. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

{{Message of the day item
| title = Scheduled Maintenance and OS Update
| date = 2025/01/07
| message = The MARC cluster will be rebooted for OS updates on Monday January 20, 2025. Please make sure to save your work and log out before the reboot happens. Scheduling will be paused until the cluster is back, but queued jobs will remain in the queue and nodes will start scheduling when the cluster is ready. Thank you for understanding.

Please reach out to support@hpc.ucalgary.ca with any issues or concerns.
}}

MARC Cluster Status

2024-12-11T20:16:48Z

Cemagata:

ARC Cluster Status

2024-12-11T20:16:04Z

Cemagata:

Think Login Node Status

2024-12-02T20:11:47Z

Cemagata:

Altis Login Node Status

2024-12-02T20:11:18Z

Cemagata:

ARC Cluster Status

2024-10-08T19:07:52Z

Cemagata:

Think Login Node Status

2024-10-08T19:07:49Z

Cemagata: