FAS Research Computing - A cooling incident at the MGHPCC Datacenter has effected a number of systems – Details zu Vorfällen

Alle Systeme betriebsbereit

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

A cooling incident at the MGHPCC Datacenter has effected a number of systems

Gelöst
Schwerer Ausfall
Aufgetreten am vor mehr als 4 JahrenDauerte 3 Stunden 20 Minuten

Betroffen

Cannon Cluster

Schwerer Ausfall aus 7:13 PM zu 10:33 PM

SLURM Scheduler - Cannon

Schwerer Ausfall aus 7:13 PM zu 10:33 PM

Cannon Compute Cluster (Holyoke)

Schwerer Ausfall aus 7:13 PM zu 10:33 PM

Login Nodes

Schwerer Ausfall aus 7:13 PM zu 10:33 PM

login.rc.fas.harvard.edu

Schwerer Ausfall aus 7:13 PM zu 10:33 PM

Login Nodes - Holyoke

Schwerer Ausfall aus 7:13 PM zu 10:33 PM

Aktualisierung
  • Gelöst
    UTC
    Gelöst

    All cooling, including the water cooling for water-cooled compute nodes, is back online. All partitions are open for jobs. Some compute nodes in various partitions may still require individual attention, so not every compute node is back online, but we will work to bring them all online in the coming hours.

  • Überwachung
    UTC
    Überwachung

    Most storage in Holyoke is back up.

    The Slurm scheduler is back up and accepting jobs. However, most public partitions are down as the water cooling systems for those compute racks require in-person attention. RC staff are already en route to the datacenter to address this.

    The Academic Cluster is back up.

  • Analyse
    UTC
    Analyse

    A cooling failure caused temperatures in the MGHPCC datacenter to exceed the safe range of operation for many systems, causing them to power down to prevent permanent damage.

    The cooling issue has been resolved and we are beginning to power systems back on. Expect outage on various systems until the issue is resolved.

  • Überwachung
    UTC
    Überwachung

    A cooling failure caused temperatures in the MGHPCC datacenter to exceed the safe range of operation for many systems, causing them to power down to prevent permanent damage.

    The cooling issue has been resolved and we are beginning to power systems back on. Expect outage on various systems until the issue is resolved.

For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu