FAS Research Computing - Lịch sử thông báo

Hệ thống hoạt động bình thường

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.
Đang hoạt động

SLURM Scheduler - Cannon - Đang hoạt động

Cannon Compute Cluster (Holyoke) - Đang hoạt động

Boston Compute Nodes - Đang hoạt động

GPU nodes (Holyoke) - Đang hoạt động

seas_compute - Đang hoạt động

Đang hoạt động

SLURM Scheduler - FASSE - Đang hoạt động

FASSE Compute Cluster (Holyoke) - Đang hoạt động

Đang hoạt động

Kempner Cluster CPU - Đang hoạt động

Kempner Cluster GPU - Đang hoạt động

Đang hoạt động

FASSE login nodes - Đang hoạt động

Đang hoạt động

Cannon Open OnDemand - Đang hoạt động

FASSE Open OnDemand - Đang hoạt động

Đang hoạt động

Netscratch (Global Scratch) - Đang hoạt động

Home Directory Storage - Boston - Đang hoạt động

Tape - (Tier 3) - Đang hoạt động

Holylabs - Đang hoạt động

Isilon Storage Holyoke (Tier 1) - Đang hoạt động

Holystore01 (Tier 0) - Đang hoạt động

HolyLFS04 (Tier 0) - Đang hoạt động

HolyLFS05 (Tier 0) - Đang hoạt động

HolyLFS06 (Tier 0) - Đang hoạt động

Holyoke Tier 2 NFS (new) - Đang hoạt động

Holyoke Specialty Storage - Đang hoạt động

holECS - Đang hoạt động

Isilon Storage Boston (Tier 1) - Đang hoạt động

BosLFS02 (Tier 0) - Đang hoạt động

Boston Tier 2 NFS (new) - Đang hoạt động

CEPH Storage Boston (Tier 2) - Đang hoạt động

Boston Specialty Storage - Đang hoạt động

bosECS - Đang hoạt động

Samba Cluster - Đang hoạt động

Globus Data Transfer - Đang hoạt động

Lịch sử thông báo

thg 1 2022

Tier3 Tape system maintenance/updates
  • Hoàn thành
    tháng 02 01, 2022 tại 14:49
    Hoàn thành
    tháng 02 01, 2022 tại 14:49

    Maintenance has completed successfully.

  • Chưa bắt đầu
    tháng 01 31, 2022 tại 15:00
    Chưa bắt đầu
    tháng 01 31, 2022 tại 15:00

    The NESE tape system, which is used for our Tier3 tape storage, will be under maintenance Monday January 31st from 10am - 12pm

    The Tier3 tape system will be unavailable during that period. Please plan accordingly.

Globus holyoke endpoint is not responding
  • Đã khắc phục
    Đã khắc phục

    Hung mount has been fixed and the Holyoke endpoint is accessible again.

  • Đang điều tra
    Đang điều tra

    The Harvard FAS RC Holyoke globus endpoint is not responding.

    We are investigating

Holyoke VM issues - affects FASSE login and VDI, and Academic cluster
  • Đã khắc phục
    Đã khắc phục

    Holyoke VM issues have been resolved.

  • Đã nhận diện
    Đã nhận diện

    The previous issue with the Holyoke VM infrastructure has returned. We are working to resolve as quickly as possible.

VM issue affecting FASSE VDI and Tier2 storage
  • Đã khắc phục
    Đã khắc phục

    We have found the root issue and restored functionality. We will continue to monitor, but services are restored.

    Email rchelp@rc.fas.harvard.edu if you still have issues with FASSE VDI/login or Tier2 storage.

  • Đã nhận diện
    Đã nhận diện

    We are still working on the underlying issue.

    A correction: This does not affect Academic VDI or vdi.rc. It primarily affects FASSE VDI and some Tier2 storage.

  • Đang điều tra
    Đang điều tra

    There is an issue with several VMs (virtual machines) including the VDI (Open OnDemand) nodes.

    We are investigating and will update here as this issue progresses.

    Please not that this affects the Academic cluster as well as FASSE VDI, NCF VDI, and VDI.rc

Winter maintenance - January 5th 8am-5pm
  • Hoàn thành
    tháng 01 05, 2022 tại 19:56
    Hoàn thành
    tháng 01 05, 2022 tại 19:56

    Maintenance has completed successfully.

  • Cập nhật
    tháng 01 05, 2022 tại 19:52
    Cập nhật
    tháng 01 05, 2022 tại 19:52

    All data center work is complete.

    Remaining tasks are:

    • rebooting login and VDI nodes
    • running scratch 90-day retention
  • Đang tiến hành
    tháng 01 05, 2022 tại 17:51
    Đang tiến hành
    tháng 01 05, 2022 tại 17:51

    Maintenance on-track.

    Several smaller tasks are complete, but water cooling maintenance is the larger task today and still on-going.

  • Chưa bắt đầu
    tháng 01 05, 2022 tại 13:00
    Chưa bắt đầu
    tháng 01 05, 2022 tại 13:00

    Our Winter maintenance will occur on January 5th, from 8am - 5pm. This will be an all-day event and will require that jobs will be suspended for the duration and scratch (holyscratch01) will be offline for updates.

    Storage firmware will also be updated that day, potentially in both data centers, so short storage interruptions may occur.

    This is one of the two times each year we can plan maintenance around our Boston data center and also make changes that involve maintaining, modifying, or adding to the water-cooling system in MGHPCC.

    Tasks will include:

    • Water cooling maintenance in MGHPCC row 7-C
    • Slurm 21.08.5 Upgrade (jobs paused during maintenance)
    • Firmware upgrades
    • Scratch (holyscratch01) maintenance (offline during maintenance)
    • Login and VDI node reboots
    • Scratch 90-day retention cleanup

thg 12 2021

Samba mounting on CEPH storage
  • Đã khắc phục
    Đã khắc phục

    Samba mounting should be operational on all CEPH storage now. If your lab is still experiencing an issue, please send us a ticket.

  • Đang điều tra
    Đang điều tra

    Samba mounting of CEPH lab shares is currently unavailable due to a security issue. Our engineers are working to resolve this.

    Lab shares will still be accessible from cluster nodes and through other graphical interfaces such as VDI and Filezilla.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - SPINAL (FAS Informatics) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - SPINAL (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - SPINAL (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

thg 11 2021

HOLYLFS02 Instability
  • Đã khắc phục
    Đã khắc phục

    We just resolved the issue!

  • Đã nhận diện
    Đã nhận diện

    Holylfs02 (/n/holylfs02) is currently experiencing instability.

    We are looking into the issue and will update this incident as the situation progresses.

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - SPINAL (FAS Informatics) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - SPINAL (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - SPINAL (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
  • Đã khắc phục
    Đã khắc phục

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • Đang điều tra
    Đang điều tra

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

thg 11 2021 đến thg 1 2022

Sau

For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu