FAS Research Computing - holylabs - over quota message or previously deleted files showing up – Incident details

www.rc/docs.rc Offsite Hosting experiencing degraded performance

Status page for the Harvard FAS Research Computing cluster and other resources.

Cluster Utilization (VPN and FASRC login required): Cannon | FASSE


Please scroll down to see details on any Incidents or maintenance notices.
Monthly maintenance occurs on the first Monday of the month (except holidays).

GETTING HELP
https://docs.rc.fas.harvard.edu | https://portal.rc.fas.harvard.edu | Email: rchelp@rc.fas.harvard.edu

The colors shown in the bars below were chosen to increase visibility for color-blind visitors.
For higher contrast, switch to light mode at the bottom of this page if the background is dark and colors are muted.

holylabs - over quota message or previously deleted files showing up

Resolved
Degraded performance
Started about 2 months agoLasted less than a minute

Affected

Storage

Operational from 3:50 PM to 3:50 PM

Holylabs

Operational from 3:50 PM to 3:50 PM

Updates
  • Resolved
    Resolved
    During the downtime holylabs was migrated to our new Vast filesystem. During this migration data was synced from from the old system to the new and then a final sync was done at powerup while the systems were not available for use by end users. We have since found an issue for some labs that will present itself in one of two ways (or both, for some): 1 - You are able to use your holylabs lab directory but you notice files that were previously deleted 2- You cannot use your holylabs lab directory because of over quota errors Our storage team is working to resolve this issue by temporarily suspending quotas on holylabs to prevent over-quota errors and also to remove the data that should not have remained after the final sync(s) so as to get lab directories back below quota. This work has already begun but will may take several days to complete. Updates will be posted here.
For issues not shown here, please contact FASRC via
https://portal.rc.fas.harvard.edu or email rchelp@rc.fas.harvard.edu