FAS Research Computing - Status Page

HolyLFS06 (Tier 0) experiencing major outage

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours


The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

holylfs06 degraded
MonitoringMajor outage
  • MonitoringUTC

    The replacement chassis is on its way and Dell technicians have been scheduled for Thursday morning. FASRC staff will be onsite to supervise the replacement process, assist the technicians as needed, and help verify that everything is functioning properly afterward.

    Once the replacement is complete, FASRC will confirm that all drives and virtual disks are properly recognized and that the affected Lustre OSTs can be brought back online.

    Updates will be provided on Thursday following the chassis swap, including the results of the replacement and the status of the holylfs06 filesystem.

    We appreciate your continued patience.

  • UpdateUTC

    As of now we have a preliminary ship date of Wednesday Nov 18th for the replacement chassis.
    The chassis will then need to be swapped. No ETA until we have the new chassis on-hand at the datacenter.

  • UpdateUTC

    During a routine drive replacement on the Dell ME5084 (the holylfs06 system), an unexpected hardware failure caused an entire row of drives to lose connectivity.

    The issue has been identified as a hardware failure requiring replacement of the entire enclosure.

    We are coordinating with Dell on the replacement process and expect to have more information tomorrow, including the estimated arrival time for the replacement hardware and the procedure for completing the swap.

    We will provide another update once those details are confirmed.

    Thank you for your patience and cooperation.

  • UpdateUTC

    holylfs06 repairs require a full unmounting of the filesystem. It will not be available during this time.

    We are continuing to work on a fix for this incident.

  • IdentifiedUTC

    holylfs06 is in a very degraded or stuck state.

    Expect degraded to no access until the system is back up.

Operational

SLURM Scheduler - Cannon - Operational

Cannon Compute Cluster (Holyoke) - Operational

Boston Compute Nodes - Operational

GPU nodes (Holyoke) - Operational

seas_compute - Operational

Operational

SLURM Scheduler - FASSE - Operational

FASSE Compute Cluster (Holyoke) - Operational

Operational

Kempner Cluster CPU - Operational

Kempner Cluster GPU - Operational

Operational

FASSE login nodes - Operational

Operational

Cannon Open OnDemand - Operational

FASSE Open OnDemand - Operational

Major outage

Netscratch (Global Scratch) - Operational

Home Directory Storage - Boston - Operational

Tape - (Tier 3) - Operational

Holylabs - Operational

Isilon Storage Holyoke (Tier 1) - Operational

Holystore01 (Tier 0) - Operational

HolyLFS04 (Tier 0) - Operational

HolyLFS05 (Tier 0) - Operational

HolyLFS06 (Tier 0) - Major outage

Holyoke Tier 2 NFS - Operational

Holyoke Specialty Storage - Operational

holECS - Operational

Isilon Storage Boston (Tier 1) - Operational

BosLFS02 (Tier 0) - Operational

Boston Tier 2 NFS - Operational

CEPH Storage Boston (Tier 2) - Operational

Boston Specialty Storage - Operational

bosECS - Operational

Samba Cluster - Operational

Globus Data Transfer - Operational

Recent notices

Show history