FAS Research Computing - A cooling incident at the MGHPCC Datacenter has effected a number of systems – Detalhes do incidente

Todos os sistemas estão operacionais

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

A cooling incident at the MGHPCC Datacenter has effected a number of systems

Resolvido
Interrupção grave
Início há mais de 4 anosDurado 3 horas 20 minutos

Afetado

Cannon Cluster

Interrupção grave de 7:13 PM para 10:33 PM

SLURM Scheduler - Cannon

Interrupção grave de 7:13 PM para 10:33 PM

Cannon Compute Cluster (Holyoke)

Interrupção grave de 7:13 PM para 10:33 PM

Login Nodes

Interrupção grave de 7:13 PM para 10:33 PM

login.rc.fas.harvard.edu

Interrupção grave de 7:13 PM para 10:33 PM

Login Nodes - Holyoke

Interrupção grave de 7:13 PM para 10:33 PM

Atualizações
  • Resolvido
    UTC
    Resolvido

    All cooling, including the water cooling for water-cooled compute nodes, is back online. All partitions are open for jobs. Some compute nodes in various partitions may still require individual attention, so not every compute node is back online, but we will work to bring them all online in the coming hours.

  • Monitorização
    UTC
    Monitorização

    Most storage in Holyoke is back up.

    The Slurm scheduler is back up and accepting jobs. However, most public partitions are down as the water cooling systems for those compute racks require in-person attention. RC staff are already en route to the datacenter to address this.

    The Academic Cluster is back up.

  • A investigar
    UTC
    A investigar

    A cooling failure caused temperatures in the MGHPCC datacenter to exceed the safe range of operation for many systems, causing them to power down to prevent permanent damage.

    The cooling issue has been resolved and we are beginning to power systems back on. Expect outage on various systems until the issue is resolved.

  • Monitorização
    UTC
    Monitorização

    A cooling failure caused temperatures in the MGHPCC datacenter to exceed the safe range of operation for many systems, causing them to power down to prevent permanent damage.

    The cooling issue has been resolved and we are beginning to power systems back on. Expect outage on various systems until the issue is resolved.

For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu