Statut

Vérifiez l'état de nos services d'un seul coup d'œil

Titre http7 is down
ID Opération #69
État terminé
Date de début 4 nov. 2012 04:38
Date de fin 4 nov. 2012 06:54
Serveurs concernés
  • http7

Messages

4 nov. 2012 05:02

Server down, we are investigating.

4 nov. 2012 05:05

XFS: Internal error XFS_WANT_CORRUPTED_GOTO at line 1503 of file fs/xfs/xfs_alloc.c. Caller 0xffffffff8125fb28

4 nov. 2012 05:11

Filesystem recovery ongoing.

4 nov. 2012 05:18

Still recovering. We have no ETA yet.

4 nov. 2012 05:41

The recovery mount failed again with the same error. We’re now running xfs_repair -L.

4 nov. 2012 05:57

Still repairing (phase 3, agno = 21).

4 nov. 2012 06:10

xfs_repair has finished successfully. We’re now mounting the filesystem again; it’s checking quotas. It will probably take a few more minutes.

4 nov. 2012 06:26

Still calculating quotas.

4 nov. 2012 06:39

The quota calculation has frozen. We’re rebooting the server and will try to mount the filesystem with quota disabled.

4 nov. 2012 06:49

The filesystem has mounted successfully. Since the filesystem log had to be zeroed, the latest changes may have been lost, although that will probably impact few files.

We’re obviously monitoring the situation very closely.

The root cause of this corruption is, again, these disk issues we’re trying to resolve. We’ve started replacing some Seagate disks by Hitachi disks, and we will continue over the next few days. Hopefully that will solve all these issues.

All impacted customers can ask for a full refund for this month. We apologize for this situation.