FAS Research Computing - Історія сповіщень

HolyLFS06 (Tier 0): значний збій

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours


The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

Працює

SLURM Scheduler - Cannon - Працює

Cannon Compute Cluster (Holyoke) - Працює

Boston Compute Nodes - Працює

GPU nodes (Holyoke) - Працює

seas_compute - Працює

Працює

SLURM Scheduler - FASSE - Працює

FASSE Compute Cluster (Holyoke) - Працює

Працює

Kempner Cluster CPU - Працює

Kempner Cluster GPU - Працює

Працює

FASSE login nodes - Працює

Працює

Cannon Open OnDemand - Працює

FASSE Open OnDemand - Працює

Повністю недоступно

Netscratch (Global Scratch) - Працює

Home Directory Storage - Boston - Працює

Tape - (Tier 3) - Працює

Holylabs - Працює

Isilon Storage Holyoke (Tier 1) - Працює

Holystore01 (Tier 0) - Працює

HolyLFS04 (Tier 0) - Працює

HolyLFS05 (Tier 0) - Працює

HolyLFS06 (Tier 0) - Повністю недоступно

Holyoke Tier 2 NFS - Працює

Holyoke Specialty Storage - Працює

holECS - Працює

Isilon Storage Boston (Tier 1) - Працює

BosLFS02 (Tier 0) - Працює

Boston Tier 2 NFS - Працює

CEPH Storage Boston (Tier 2) - Працює

Boston Specialty Storage - Працює

bosECS - Працює

Samba Cluster - Працює

Globus Data Transfer - Працює

листоп. 2026

holylfs06 degraded
МоніторингПовністю недоступно
  • МоніторингUTC

    The replacement chassis is on its way and Dell technicians have been scheduled for Thursday morning. FASRC staff will be onsite to supervise the replacement process, assist the technicians as needed, and help verify that everything is functioning properly afterward.

    Once the replacement is complete, FASRC will confirm that all drives and virtual disks are properly recognized and that the affected Lustre OSTs can be brought back online.

    Updates will be provided on Thursday following the chassis swap, including the results of the replacement and the status of the holylfs06 filesystem.

    We appreciate your continued patience.

  • ОновленняUTC

    As of now we have a preliminary ship date of Wednesday Nov 18th for the replacement chassis.
    The chassis will then need to be swapped. No ETA until we have the new chassis on-hand at the datacenter.

  • ОновленняUTC

    During a routine drive replacement on the Dell ME5084 (the holylfs06 system), an unexpected hardware failure caused an entire row of drives to lose connectivity.

    The issue has been identified as a hardware failure requiring replacement of the entire enclosure.

    We are coordinating with Dell on the replacement process and expect to have more information tomorrow, including the estimated arrival time for the replacement hardware and the procedure for completing the swap.

    We will provide another update once those details are confirmed.

    Thank you for your patience and cooperation.

  • ОновленняUTC

    holylfs06 repairs require a full unmounting of the filesystem. It will not be available during this time.

    We are continuing to work on a fix for this incident.

  • ВизначеноUTC

    holylfs06 is in a very degraded or stuck state.

    Expect degraded to no access until the system is back up.

жовт. 2026

ЖОВТ24
Globus scheduled maintenance
ЗавершеноТехнічне обслуговування1 годину
  • Завершеножовтня 24, 2026 у 15:30UTC
    Технічне обслуговування успішно завершено
  • Триваєжовтня 24, 2026 у 14:30UTC
    Зараз триває технічне обслуговування
  • Запланованожовтня 19, 2026 у 15:30UTC

    Globus services will be unavailable for a period between 9:30am and 10:30am U.S. Central time on Saturday, October 24, 2026 due to planned maintenance (https://www.globus.org/blog/2026-10-24-maintenance) that includes database upgrades.

    Please refer to the posted link for additional information on how services and in-progress work will be impacted during this window.

верес. 2026

h-nfs11-p down
ВирішеноЧасткова недоступність144 години 33 хвилини
  • ВирішеноUTC

    The vendor has replaced the necessary hardware components, and FASRC engineers have installed updates and confirmed working status. No data was affected.

    All h-nfs11-p shares should be accessible again once more.

    If you notice any irregularities, please reach out at rchelp@rc.fas.harvard.edu

  • ОновленняUTC

    The vendor has dispatched parts. The vendor has indicated that this may not get fixed until Monday, but the storage team is pressing them to accelerate that timeline. We will update here when we know more.

    Thanks for your understanding.

  • ОновленняUTC

    After lengthy troubleshooting, h-nfs11-p is still down. The vendor is scheduling a datacenter visit for on-site repairs. We will update as we know more.

  • ВизначеноUTC

    Our engineers are diagnosing the root cause of the failure and are working with the vendor to troubleshoot further

    We are continuing to work on a fix for this incident.

  • ВивчаєтьсяUTC

    h-nfs11-p is currently down. The following shares are inaccessible on FASSE

    • ncf_cnl01

    • ncf_cnl02

    • ncf_cnl03

    • ncf_cnl04

    • ncf_gspdata

    • ncf_mri_l3

    • cnl05

    • cnl06

    • eldaief

    • ncf_apps

    • jcamprodon_lab_l3

    We are investigating this incident.

Назад

верес. 2026 до листоп. 2026

Наступна