Archive for October, 2008

Transport Link Upgrade

Thursday, October 30th, 2008

Tonight at 12:01 AM we will be performing an upgrade on our transport link which connects our San Francisco POP to our San Jose POP. We will be moving to a new physical transport link which will provide us with the ability to upgrade the capacity of this link in ...

Momentary ATM Outage

Tuesday, October 28th, 2008

While troubleshooting our new ATM OC-12 circuit in San Francisco, an AT&T tech inadvertently removed the wrong fibers from a multiplexer card in the SNFCCA17 central office. This caused two of our other ATM OC-12 circuits to go off-line. These links serve DSL, Business-T and Frame Relay customers. The AT&T ...

Customer SQL v4 system maintenance

Saturday, October 25th, 2008

Tonight I will be performing maintenance on custsql.sonic.net, our mySQL 4x host. Just after 12:01AM I will be performing a necessary reboot of the system. Estimated customer impact is approximately 10 minutes at most. This does not effect mySQL v5 databases. -Don Update: Maintenance completed. Customer impact was just under three ...

Squirrelmail config database maintenance

Friday, October 24th, 2008

This morning at 12:01AM I performed some needed maintenance on our Squirrelmail configuration database. Some customers may have been unable to update their settings in Squirrelmail during this time. Customer impact was approximately 3 minutes. During this time, I also upgraded our Squirrelmail installation to the latest stable production version.  ...

Sebastopol DSL Outage

Wednesday, October 22nd, 2008

Hardware failure on the Sebastopol Central Office has caused DSL customers to lose connectivity. We are working with AT&T to resolve the issue, and hope to have an estimated time of repair shortly. -Adam, John and Steve Update: As of 5:00PM, service appears to be restored to all affected customers.

DSL Aggregation Router Reboot

Sunday, October 19th, 2008

The DSL aggregation router that serves DSL to the Chico area rebooted itself approximately 20 minutes ago, causing about 5 minutes of downtime for all DSL customers in that area. Currently all traffic levels and customer connectivity look normal at this time, and we will continue to monitor the router, ...

Trouble with the Sonic.net Website.

Friday, October 10th, 2008

Fri Oct 10 10:05:08 PDT 2008 -- Trouble with the Sonic.net Website. We are currently experiencing trouble with our corp.sonic.net Web Server that serves part of the Sonic.net Home Page and all of our Blogs. We are working on the problem and will have it back soon. -Augie, William, and ...

Mail Storage Maintenance.

Thursday, October 9th, 2008

Tonight at Midnight we will be performing maintenance on the NetApp Filers that store Customer E-Mail; there is no expected downtime during this period and will take less than an hour to be completed. During this period we will be adding additional capacity to these Filers; this capacity will allow for ...

Webmail IMAP performance problems solved.

Thursday, October 9th, 2008

Separate from our earlier post about slow imap.sonic.net performance (http://corp.sonic.net/status/2008/09/26/imap-performance-problems-solved/) - we have also received reports of slow Webmail IMAP performance and timeouts when Customers were using the Webmail clients on http://webmail.sonic.net. We believe we have isolated the problem, which was a bug in our IMAP Proxy software, and have not ...

Webmail Web Site Time-Warp.

Thursday, October 9th, 2008

A misguided attempt to update some software on our Webmail Cluster inadvertently took the software, associated web pages, and server configuration back to January of this year. As a result Customers would have seen inconsistent or broken behavior while trying to access the website from around 2:30am to 8:00am, at which ...