Archive for August, 2011

Brief FlexLink and Fusion outage

Wednesday, August 31st, 2011

This afternoon, at approximately 11:59AM, a network misconfiguration caused a brief outage affecting all FlexLink and Fusion customers in the Pacific Heights area of San Francisco. The cause was isolated and fixed, and service was restored by approximately 12:10PM. We are investigating the cause of the misconfiguration further so that ...

Non-disruptive NetApp Filer Maintenance.

Monday, August 29th, 2011

Tonight ( 29, August ) at 11:00 PM we will be performing a set of software upgrades across our NetApp Filers. These Filers store customers' e-mail, web files, and other data. There will be no impact on customers ability to access their information during this maintenance, and we expect it to take ...

Non-Intrusive ATM Switch Maintenance

Thursday, August 25th, 2011

Tonight, August 25 at 11:00 PM we will be performing minor hardware maintenance on one of our ATM switches that serves LATA1 (SF Bay Area) to increase capacity. This operation should not cause any impact to in-service customers, and is expected to take 5-10 minutes. -Jared Update: The maintenance has been completed. ...

Fusion Voicemail Message Waiting Issues

Monday, August 22nd, 2011

Starting Aug 17th at 3:47PM one of the servers in the voicemail cluster stopped sending notices to the voice switch to update the message waiting indicator status.  This lead to the MWI (the stutter dial-tone and light that flashes on your phone to let you know you have new voicemail) ...

NFS File Locking Bug and Mail Delivery

Saturday, August 20th, 2011

A small number of users with "functional but incorrect" custom procmail rules may have experienced issues with their inbound mail delivery starting yesterday afternoon after the firewalls on the mail servers that handle message delivery were updated to be more secure.  While the new firewall configuration was technically correct, it ...

Legacy DSL Subscriber Rebalancing

Wednesday, August 17th, 2011

Tonight, Thursday August 18 at 12:01 AM we will be moving some DSL subscribers from a congested DSL aggregation router to a new router to relieve the congestion. Affected customers will lose connectivity for 5-10 minutes. -Jared Update: The subscriber move is completed and all affected customers should be back online.

Non-Intrusive ATM Switch Maintenance

Tuesday, August 16th, 2011

Tonight, August 17 at 12:01 AM we will be inserting new cards into one of our ATM switches that serves LATA1 (SF Bay Area) to increase capacity. This operation should not cause any impact to in-service customers, and is expected to take 5-10 minutes. -Jared, Nathan and Matt

Fusion Voice Feature Updates

Monday, August 15th, 2011

All Fusion Voice customers can now enable Call Forwarding directly from their phones as well as in the updated Voice Options membertool.  In addition to being able to control call forwarding, the new Voice Options membertool can also manage Voicemail settings, disable Call Waiting, enable Caller ID Blocking, and enable ...

Brief Backbone Service Interruption

Wednesday, August 10th, 2011

At approximately 10:50 AM this morning, some routine router configuration caused an unexpected loss of connectivity for some of our POPs surrounding the Santa Rosa area. Service was restored at 10:55 AM. We are monitoring the situation, and looking into why innocuous configuration would cause this outage. -Jared