FAS Research Computing - سجل الإشعارات

جميع الأنظمة تعمل بشكل طبيعي

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.
يعمل بشكل طبيعي

SLURM Scheduler - Cannon - يعمل بشكل طبيعي

Cannon Compute Cluster (Holyoke) - يعمل بشكل طبيعي

Boston Compute Nodes - يعمل بشكل طبيعي

GPU nodes (Holyoke) - يعمل بشكل طبيعي

seas_compute - يعمل بشكل طبيعي

يعمل بشكل طبيعي

SLURM Scheduler - FASSE - يعمل بشكل طبيعي

FASSE Compute Cluster (Holyoke) - يعمل بشكل طبيعي

يعمل بشكل طبيعي

Kempner Cluster CPU - يعمل بشكل طبيعي

Kempner Cluster GPU - يعمل بشكل طبيعي

يعمل بشكل طبيعي

FASSE login nodes - يعمل بشكل طبيعي

يعمل بشكل طبيعي

Cannon Open OnDemand - يعمل بشكل طبيعي

FASSE Open OnDemand - يعمل بشكل طبيعي

يعمل بشكل طبيعي

Netscratch (Global Scratch) - يعمل بشكل طبيعي

Home Directory Storage - Boston - يعمل بشكل طبيعي

Tape - (Tier 3) - يعمل بشكل طبيعي

Holylabs - يعمل بشكل طبيعي

Isilon Storage Holyoke (Tier 1) - يعمل بشكل طبيعي

Holystore01 (Tier 0) - يعمل بشكل طبيعي

HolyLFS04 (Tier 0) - يعمل بشكل طبيعي

HolyLFS05 (Tier 0) - يعمل بشكل طبيعي

HolyLFS06 (Tier 0) - يعمل بشكل طبيعي

Holyoke Tier 2 NFS - يعمل بشكل طبيعي

Holyoke Specialty Storage - يعمل بشكل طبيعي

holECS - يعمل بشكل طبيعي

Isilon Storage Boston (Tier 1) - يعمل بشكل طبيعي

BosLFS02 (Tier 0) - يعمل بشكل طبيعي

Boston Tier 2 NFS - يعمل بشكل طبيعي

CEPH Storage Boston (Tier 2) - يعمل بشكل طبيعي

Boston Specialty Storage - يعمل بشكل طبيعي

bosECS - يعمل بشكل طبيعي

Samba Cluster - يعمل بشكل طبيعي

Globus Data Transfer - يعمل بشكل طبيعي

سجل الإشعارات

عرض الحالة الحالية

فبراير 2022

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
تم الحلانقطاع كبير28 دقيقة
  • تم الحلUTC

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • قيد التحقيقUTC

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - MiniLIMs (FAS Informatics) isn't accessible at the moment (automated)
تم الحلانقطاع كبير28 دقيقة
  • تم الحلUTC

    Websites & Tools - MiniLIMs (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • قيد التحقيقUTC

    Websites & Tools - MiniLIMs (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Academic Cluster home directory storage full
تم الحلأداء متدهور34 دقيقة
  • تم الحلUTC

    This issue has been resolved.

  • تم التحديدUTC

    The home directory storage for the academic cluster has quickly filled to capacity. We are working to mitigate this issue.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
تم الحلانقطاع كبير9 دقائق
  • تم الحلUTC

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • قيد التحقيقUTC

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

holystore01 mounts on boslogin nodes
تم الحل25 ساعة 4 دقائق
  • تم الحلUTC

    This issue has been resolved and holystore01 is back to normal.

  • قيد المراقبةUTC

    boslogin nodes are up but are unable to mount holystore01 at this time. Replacement parts for holystore01 will be installed at the earliest possible time to rectify this issue.

  • تم التحديدUTC

    holystore01 may be inaccessible on some cluster nodes.

  • قيد التحقيقUTC

    holystore01 is not currently accessible from boslogin nodes. These nodes will be rebooted again at 2:30pm to fix.

    Please login to holylogin nodes if you need to access holystore01.

يناير 2022

يناير31
Tier3 Tape system maintenance/updates
مكتملصيانة23 ساعة 49 دقيقة
  • مكتملفبراير 01, 2022 في 14:49UTC

    Maintenance has completed successfully.

  • مخططيناير 31, 2022 في 15:00UTC

    The NESE tape system, which is used for our Tier3 tape storage, will be under maintenance Monday January 31st from 10am - 12pm

    The Tier3 tape system will be unavailable during that period. Please plan accordingly.

Globus holyoke endpoint is not responding
تم الحل19 دقيقة
  • تم الحلUTC

    Hung mount has been fixed and the Holyoke endpoint is accessible again.

  • قيد التحقيقUTC

    The Harvard FAS RC Holyoke globus endpoint is not responding.

    We are investigating

Holyoke VM issues - affects FASSE login and VDI, and Academic cluster
تم الحلساعة واحدة 39 دقيقة
  • تم الحلUTC

    Holyoke VM issues have been resolved.

  • تم التحديدUTC

    The previous issue with the Holyoke VM infrastructure has returned. We are working to resolve as quickly as possible.

VM issue affecting FASSE VDI and Tier2 storage
تم الحلانقطاع جزئيساعة واحدة 41 دقيقة
  • تم الحلUTC

    We have found the root issue and restored functionality. We will continue to monitor, but services are restored.

    Email rchelp@rc.fas.harvard.edu if you still have issues with FASSE VDI/login or Tier2 storage.

  • تم التحديدUTC

    We are still working on the underlying issue.

    A correction: This does not affect Academic VDI or vdi.rc. It primarily affects FASSE VDI and some Tier2 storage.

  • قيد التحقيقUTC

    There is an issue with several VMs (virtual machines) including the VDI (Open OnDemand) nodes.

    We are investigating and will update here as this issue progresses.

    Please not that this affects the Academic cluster as well as FASSE VDI, NCF VDI, and VDI.rc

يناير5
Winter maintenance - January 5th 8am-5pm
مكتملصيانة6 ساعات 56 دقيقة
  • مكتمليناير 05, 2022 في 19:56UTC

    Maintenance has completed successfully.

  • تحديثيناير 05, 2022 في 19:52UTC

    All data center work is complete.

    Remaining tasks are:

    • rebooting login and VDI nodes
    • running scratch 90-day retention
  • قيد التقدميناير 05, 2022 في 17:51UTC

    Maintenance on-track.

    Several smaller tasks are complete, but water cooling maintenance is the larger task today and still on-going.

  • مخططيناير 05, 2022 في 13:00UTC

    Our Winter maintenance will occur on January 5th, from 8am - 5pm. This will be an all-day event and will require that jobs will be suspended for the duration and scratch (holyscratch01) will be offline for updates.

    Storage firmware will also be updated that day, potentially in both data centers, so short storage interruptions may occur.

    This is one of the two times each year we can plan maintenance around our Boston data center and also make changes that involve maintaining, modifying, or adding to the water-cooling system in MGHPCC.

    Tasks will include:

    • Water cooling maintenance in MGHPCC row 7-C
    • Slurm 21.08.5 Upgrade (jobs paused during maintenance)
    • Firmware upgrades
    • Scratch (holyscratch01) maintenance (offline during maintenance)
    • Login and VDI node reboots
    • Scratch 90-day retention cleanup

ديسمبر 2021

Samba mounting on CEPH storage
تم الحل292 ساعة 23 دقيقة
  • تم الحلUTC

    Samba mounting should be operational on all CEPH storage now. If your lab is still experiencing an issue, please send us a ticket.

  • قيد التحقيقUTC

    Samba mounting of CEPH lab shares is currently unavailable due to a security issue. Our engineers are working to resolve this.

    Lab shares will still be accessible from cluster nodes and through other graphical interfaces such as VDI and Filezilla.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
تم الحلانقطاع كبير9 دقائق
  • تم الحلUTC

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • قيد التحقيقUTC

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
تم الحلانقطاع كبير9 دقائق
  • تم الحلUTC

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • قيد التحقيقUTC

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - Portal (portal.rc) isn't accessible at the moment (automated)
تم الحلانقطاع كبير8 دقائق
  • تم الحلUTC

    Websites & Tools - Portal (portal.rc) is now operational! This update was created by an automated monitoring service.

  • قيد التحقيقUTC

    Websites & Tools - Portal (portal.rc) cannot be accessed at the moment. This incident was created by an automated monitoring service.

Websites & Tools - SPINAL (FAS Informatics) isn't accessible at the moment (automated)
تم الحلانقطاع كبيرساعة واحدة 12 دقيقة
  • تم الحلUTC

    Websites & Tools - SPINAL (FAS Informatics) is now operational! This update was created by an automated monitoring service.

  • قيد التحقيقUTC

    Websites & Tools - SPINAL (FAS Informatics) cannot be accessed at the moment. This incident was created by an automated monitoring service.

السابق

ديسمبر 2021 إلى فبراير 2022

التالي

For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu