Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares - Incident details - FAS Research Computing

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE

Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
https://docs.rc.fas.harvard.edu | https://portal.rc.fas.harvard.edu | Email: rchelp@rc.fas.harvard.edu

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares

Resolved

Degraded performance

Started over 1 year agoLasted about 5 hours

Affected

VDI/OpenOnDemand

Cannon Open OnDemand/VDI

FASSE Open OnDemand/VDI

Storage

CEPH Storage Boston (Tier 2)

Virtual Machines

Updates

Resolved
January 11, 2024 at 1:22 PM
Resolved
January 11, 2024 at 1:22 PM
The Ceph instability has been resolved. Ceph Tier2 shares, VDI, and VMs should be back to their normal state.

If your VM, /net/fs-[labname] share, or VDI session is still impacted, please contact rchelp@rc.fas.harvard.edu
Identified
January 11, 2024 at 7:57 AM
Identified
January 11, 2024 at 7:57 AM
The infrastructure behind Tier2 Ceph shares and VMs is unstable.
This also affects VDI/OOD which relies on virtual machines.

/net/fs-[labname] shares, new OOD/VDI sessions, and VMs are affected and may will be inaccessible until this is resolved.

Thanks for your patience.

FAS Research Computing - Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares – Incident details

Ceph instability - Affects Boston VMs (Virtual Machines) and Tier2 Ceph shares