FAS Research Computing - Istoricul notificărilor

Sistem în mentenanță

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.
În mentenanță

SLURM Scheduler - Cannon - În mentenanță

Cannon Compute Cluster (Holyoke) - În mentenanță

Boston Compute Nodes - În mentenanță

GPU nodes (Holyoke) - În mentenanță

seas_compute - În mentenanță

În mentenanță

SLURM Scheduler - FASSE - În mentenanță

FASSE Compute Cluster (Holyoke) - În mentenanță

În mentenanță

Kempner Cluster CPU - În mentenanță

Kempner Cluster GPU - În mentenanță

În mentenanță

FASSE login nodes - În mentenanță

În mentenanță

Cannon Open OnDemand - În mentenanță

FASSE Open OnDemand - În mentenanță

Întrerupere parțială

Netscratch (Global Scratch) - Operațional

Home Directory Storage - Boston - Operațional

Tape - (Tier 3) - Operațional

Holylabs - Operațional

Isilon Storage Holyoke (Tier 1) - Operațional

Holystore01 (Tier 0) - Operațional

HolyLFS04 (Tier 0) - Operațional

HolyLFS05 (Tier 0) - Operațional

HolyLFS06 (Tier 0) - Operațional

Holyoke Tier 2 NFS - Întrerupere parțială

Holyoke Specialty Storage - Operațional

holECS - Operațional

Isilon Storage Boston (Tier 1) - Operațional

BosLFS02 (Tier 0) - Operațional

Boston Tier 2 NFS - Operațional

CEPH Storage Boston (Tier 2) - Operațional

Boston Specialty Storage - Operațional

bosECS - Operațional

Samba Cluster - Operațional

Globus Data Transfer - Operațional

Istoricul notificărilor

Vezi starea actuală

ian 2022

IAN31
Tier3 Tape system maintenance/updates
FinalizatMentenanță23 ore 49 minute
  • Finalizat
    februarie 01, 2022 la 14:49UTC
    Finalizat
    februarie 01, 2022 la 14:49UTC

    Maintenance has completed successfully.

  • Planificată
    ianuarie 31, 2022 la 15:00UTC
    Planificată
    ianuarie 31, 2022 la 15:00UTC

    The NESE tape system, which is used for our Tier3 tape storage, will be under maintenance Monday January 31st from 10am - 12pm

    The Tier3 tape system will be unavailable during that period. Please plan accordingly.

Globus holyoke endpoint is not responding
Rezolvat19 minute
  • Rezolvat
    UTC
    Rezolvat

    Hung mount has been fixed and the Holyoke endpoint is accessible again.

  • În curs de investigare
    UTC
    În curs de investigare

    The Harvard FAS RC Holyoke globus endpoint is not responding.

    We are investigating

Holyoke VM issues - affects FASSE login and VDI, and Academic cluster
Rezolvat1 oră 39 minute
  • Rezolvat
    UTC
    Rezolvat

    Holyoke VM issues have been resolved.

  • Identificat
    UTC
    Identificat

    The previous issue with the Holyoke VM infrastructure has returned. We are working to resolve as quickly as possible.

VM issue affecting FASSE VDI and Tier2 storage
RezolvatÎntrerupere parțială1 oră 41 minute
  • Rezolvat
    UTC
    Rezolvat

    We have found the root issue and restored functionality. We will continue to monitor, but services are restored.

    Email rchelp@rc.fas.harvard.edu if you still have issues with FASSE VDI/login or Tier2 storage.

  • Identificat
    UTC
    Identificat

    We are still working on the underlying issue.

    A correction: This does not affect Academic VDI or vdi.rc. It primarily affects FASSE VDI and some Tier2 storage.

  • În curs de investigare
    UTC
    În curs de investigare

    There is an issue with several VMs (virtual machines) including the VDI (Open OnDemand) nodes.

    We are investigating and will update here as this issue progresses.

    Please not that this affects the Academic cluster as well as FASSE VDI, NCF VDI, and VDI.rc

IAN5
Winter maintenance - January 5th 8am-5pm
FinalizatMentenanță6 ore 56 minute
  • Finalizat
    ianuarie 05, 2022 la 19:56UTC
    Finalizat
    ianuarie 05, 2022 la 19:56UTC

    Maintenance has completed successfully.

  • Actualizare
    ianuarie 05, 2022 la 19:52UTC
    Actualizare
    ianuarie 05, 2022 la 19:52UTC

    All data center work is complete.

    Remaining tasks are:

    • rebooting login and VDI nodes
    • running scratch 90-day retention
  • În curs
    ianuarie 05, 2022 la 17:51UTC
    În curs
    ianuarie 05, 2022 la 17:51UTC

    Maintenance on-track.

    Several smaller tasks are complete, but water cooling maintenance is the larger task today and still on-going.

  • Planificată
    ianuarie 05, 2022 la 13:00UTC
    Planificată
    ianuarie 05, 2022 la 13:00UTC

    Our Winter maintenance will occur on January 5th, from 8am - 5pm. This will be an all-day event and will require that jobs will be suspended for the duration and scratch (holyscratch01) will be offline for updates.

    Storage firmware will also be updated that day, potentially in both data centers, so short storage interruptions may occur.

    This is one of the two times each year we can plan maintenance around our Boston data center and also make changes that involve maintaining, modifying, or adding to the water-cooling system in MGHPCC.

    Tasks will include:

    • Water cooling maintenance in MGHPCC row 7-C
    • Slurm 21.08.5 Upgrade (jobs paused during maintenance)
    • Firmware upgrades
    • Scratch (holyscratch01) maintenance (offline during maintenance)
    • Login and VDI node reboots
    • Scratch 90-day retention cleanup

dec 2021

Samba mounting on CEPH storage
Rezolvat292 ore 23 minute
  • Rezolvat
    UTC
    Rezolvat

    Samba mounting should be operational on all CEPH storage now. If your lab is still experiencing an issue, please send us a ticket.

  • În curs de investigare
    UTC
    În curs de investigare

    Samba mounting of CEPH lab shares is currently unavailable due to a security issue. Our engineers are working to resolve this.

    Lab shares will still be accessible from cluster nodes and through other graphical interfaces such as VDI and Filezilla.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră9 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră9 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră8 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - SPINAL (FAS Informatics) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră1 oră 12 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - SPINAL (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - SPINAL (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

noi 2021

HOLYLFS02 Instability
RezolvatÎntrerupere parțială11 minute
  • Rezolvat
    UTC
    Rezolvat

    We just resolved the issue!

  • Identificat
    UTC
    Identificat

    Holylfs02 (/n/holylfs02) is currently experiencing instability.

    We are looking into the issue and will update this incident as the situation progresses.

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră28 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră4 ore 28 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - SPINAL (FAS Informatics) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră12 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - SPINAL (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - SPINAL (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
RezolvatÎntrerupere majoră28 minute
  • Rezolvat
    UTC
    Rezolvat

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • În curs de investigare
    UTC
    În curs de investigare

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Anterior

noi 2021 către ian 2022

Următorul

For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu