Archive for January, 2011
Saturday, January 29th, 2011
One of our core internal MySQL servers has experienced a failure off the SSD based storage system that it was recently migrated to. We're restoring from backups now, but it is too early to estimate when things will be back up and running. This does not directly impact any of ...
Posted in Uncategorized | No Comments »
Sunday, January 16th, 2011
One of our Redback DSL aggregation routers failed this morning at approximately 11:39 AM. We are in the process of migrating all customers off that Redback to a hot spare device. We expect that all affected DSL subscribers will be restored to service in 5 minutes.
-Jared
Posted in Uncategorized | No Comments »
Tuesday, January 11th, 2011
This Friday, Jan 14th at 12:01 AM we will be performing non-intrusive power maintenance on our equipment in the downtown Santa Rosa CO. We do not anticipate any customer impact during this work.
-Nathan and Tim
Update: This maintenance has been pushed to Friday, Jan 14th at 12:01 AM
Posted in Uncategorized | No Comments »
Saturday, January 8th, 2011
At 8:03PM this evening one of the DSL aggregation routers that serves legacy DSL customers in LATA 1 rebooted unexpectedly. Service for affected customers was restored by 8:05PM. We are investigating the cause of this reboot and will monitor closely for any further issues.
-Tim and Jared
Posted in Uncategorized | No Comments »
Wednesday, January 5th, 2011
As of 3:30pm PST, DSL customers served out of many San Francisco wire centers are currently without internet due to an AT&T equipment failure. Our estimated time of repair is within several hours. We are working with AT&T to fix the problem, and we hope to update our MOTD with ...
Posted in Network | 14 Comments »
Wednesday, January 5th, 2011
Starting at about 9:57 AM today, a distributed denial of service attack was launched at one of our DSL subscribers in Los Angeles. This resulted in reachability issues for many of our customers served out of LA. We blocked the DDoS attack at our edge within 10 minutes, thus restoring ...
Posted in Uncategorized | No Comments »