Archive for April, 2008
Saturday, April 19th, 2008
Update Sat Apr 19 00:30:38 PDT 2008 -- ATM Switch Maintenance Complete. We have completed the replacement of the backup management card in our ATM switch and all went as expected. There should have been no customer impact, and traffic levels look normal on the switch. -Jared and Matt ...
Posted in Uncategorized | No Comments »
Friday, April 18th, 2008
Fri Apr 18 11:29:19 PDT 2008 -- ATM Switch Maintenance. Tonight at midnight, we will be replacing the management card in our ATM switch that started throwing errors on 4/2/08. This card is in a backup role on the switch and replacing it should not cause any customer impact. ...
Posted in Uncategorized | No Comments »
Thursday, April 17th, 2008
Thu Apr 17 12:21:00 PDT 2008 -- News Server Outage. news.sonic.net is currently offline due to back to back disk failures in the redundant load balanced pair of servers that handle news readers services. At this time it is unclear how long it will take to restore news reader ...
Posted in Uncategorized | No Comments »
Saturday, April 12th, 2008
Sat Apr 12 09:08:51 PDT 2008 -- Los Angeles DHCP Failure. One of our DHCP servers in our Los Angeles PoP suffered a failure that prevented it from providing DHCP leases at approx. 2:30 AM today. This problem would have interrupted connectivity for dynamic IP DSL subscribers in the ...
Posted in Uncategorized | No Comments »
Tuesday, April 8th, 2008
Tue Apr 8 22:02:22 PDT 2008 -- Custsql MySQL replication upgrade tonight. This evening, at 10:00PM PDT, I will be performing this upgrade which will make our system much more robust and add yet another layer of data protection to your databases! For a very short period, you may ...
Posted in Uncategorized | No Comments »
Monday, April 7th, 2008
Mon Apr 7 23:29:19 PDT 2008 -- @Mail Webmail Service Interruption. Earlier this evening some routine server maintenance caused @Mail to go down unexpectedly. We are sorry for the delays in returning it to service; it took an unusual quantity of sleuthing to find the errors introduced last week ...
Posted in Uncategorized | No Comments »
Thursday, April 3rd, 2008
Update Thu Apr 3 02:22:47 PDT 2008 -- Emergency ATM Switch Maintenance. When we performed our card reload earlier tonight, we apparently hit a bug which caused an interface to stop forwarding ATM cells, but appear to be functioning perfectly. This caused a loss of connectivity for DSL some ...
Posted in Uncategorized | No Comments »
Thursday, April 3rd, 2008
Update Thu Apr 3 00:40:57 PDT 2008 -- ATM Switch Maintenance Complete. We have completed our reload of the affected card and everything appears to be operating normally. There should have been no customer impact. -Jared
Posted in Uncategorized | No Comments »
Wednesday, April 2nd, 2008
Wed Apr 2 10:40:07 PDT 2008 -- ATM Switch Maintenance. A backup management card in one of our ATM switches began experiencing errors this morning. Tonight at midnight we will be reloading the card to clear these errors. Since this card is the backup redundant management card, there should ...
Posted in Uncategorized | No Comments »