Servers status
Check our services status at a glance
- ID:
- 17
- Title:
- Global slowdowns
- Status:
- completed
- Started date:
- 12/14/2011 6:37 p.m.
- End date:
- 12/15/2011 10:44 p.m.
Upgrades
18:37
We’re investigating.
19:02
A network issue is most certainly the cause of these slowdowns. Things are looking better right now, we’re still monitoring the situation.
19:09
Everything is now working as normal. We’re still monitoring.
23:03
Slowdowns are back.
1:56
The issue is due to intermittent packet loss (~3%). It seems resolved for now.
10:29
The intermittent packet loss is back again.
11:14
We’re doing everything we can to resolve this issue.
11:37
No more packet loss for now, but we’re still in contact with our provider to have this issue solved once and for all.
16:03
Packet loss is back again.
16:20
We’re still in contact with our provider about the issues. We’re also trying something that may help mitigate the packet loss.
17:05
No more packet loss for now. Our provider has trouble identifying the issue; in the meantime, we’ll deploy something new by the end of the day. We hope it will solve 90% of the problems.
Sorry again for all the trouble, we realize how painful it is, especially in this Christmas period.
18:31
Several servers will be rebooted in order to deploy the fix we discussed earlier. Expected downtime is a few minutes - usually less than 2.
20:47
The packet loss is back, we’re started rebooting a few servers. The fix is not deployed yet.
21:04
Good news: we’ve started deploying the fix, and it works well. The issue is NOT resolved yet (slowdowns are still here), but it should hopefully be in the next couple of hours.
21:28
The fix has been deployed on most servers.
22:42
All HTTP servers have the fix applied, all websites are now responsive as usual.