FAS Research Computing - A cooling incident at the MGHPCC Datacenter has effected a number of systems – Details zu Vorfällen

Teilweise herabgesetzte Leistung festgestellt

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

A cooling incident at the MGHPCC Datacenter has effected a number of systems

Gelöst
Großer Ausfall
Aufgetreten am vor etwa 4 JahrenDauerte etwa 3 Stunden

Betroffen

Cannon Cluster

Großer Ausfall aus 7:13 PM zu 10:33 PM

SLURM Scheduler - Cannon

Großer Ausfall aus 7:13 PM zu 10:33 PM

Cannon Compute Cluster (Holyoke)

Großer Ausfall aus 7:13 PM zu 10:33 PM

Login Nodes

Großer Ausfall aus 7:13 PM zu 10:33 PM

login.rc.fas.harvard.edu

Großer Ausfall aus 7:13 PM zu 10:33 PM

Login Nodes - Holyoke

Großer Ausfall aus 7:13 PM zu 10:33 PM

Aktualisierung
  • Gelöst
    Gelöst

    All cooling, including the water cooling for water-cooled compute nodes, is back online. All partitions are open for jobs. Some compute nodes in various partitions may still require individual attention, so not every compute node is back online, but we will work to bring them all online in the coming hours.

  • Überprüfung
    Überprüfung

    Most storage in Holyoke is back up.

    The Slurm scheduler is back up and accepting jobs. However, most public partitions are down as the water cooling systems for those compute racks require in-person attention. RC staff are already en route to the datacenter to address this.

    The Academic Cluster is back up.

  • Analyse
    Analyse

    A cooling failure caused temperatures in the MGHPCC datacenter to exceed the safe range of operation for many systems, causing them to power down to prevent permanent damage.

    The cooling issue has been resolved and we are beginning to power systems back on. Expect outage on various systems until the issue is resolved.

  • Überprüfung
    Überprüfung

    A cooling failure caused temperatures in the MGHPCC datacenter to exceed the safe range of operation for many systems, causing them to power down to prevent permanent damage.

    The cooling issue has been resolved and we are beginning to power systems back on. Expect outage on various systems until the issue is resolved.

For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu