Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares - Incident details - FAS Research Computing

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE

Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
Documentation: https://docs.rc.fas.harvard.edu | Account Portal https://portal.rc.fas.harvard.edu
Email: rchelp@rc.fas.harvard.edu | Support Hours

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares

Resolved

Degraded performance

Started over 2 years agoJanuary 11, 2024Lasted about 5 hoursJanuary 11, 20247:57 AM1:22 PMUTC

Affected

OpenOnDemand/OOD

Cannon Open OnDemand

FASSE Open OnDemand

Storage

CEPH Storage Boston (Tier 2)

Virtual Machines

Updates

Resolved
January 11, 2024 at 1:22 PMUTC
Resolved
January 11, 2024 at 1:22 PMUTC
The Ceph instability has been resolved. Ceph Tier2 shares, VDI, and VMs should be back to their normal state.

If your VM, /net/fs-[labname] share, or VDI session is still impacted, please contact rchelp@rc.fas.harvard.edu
Identified
January 11, 2024 at 7:57 AMUTC
Identified
January 11, 2024 at 7:57 AMUTC
The infrastructure behind Tier2 Ceph shares and VMs is unstable.
This also affects VDI/OOD which relies on virtual machines.

/net/fs-[labname] shares, new OOD/VDI sessions, and VMs are affected and may will be inaccessible until this is resolved.

Thanks for your patience.

FAS Research Computing - Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares – Incident details

Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares