Month: October 2015

Fusion/FlexLink Maintenance – San Francisco

Update( 4:30AM): This maintenance is now complete.

Beginning tonight at midnight, we will be performing hardware and transport upgrades for a small portion of customers in San Francisco. Affected users will experience some routing changes and periods of downtime while the upgrades take place. This type of maintenance typically takes a few hours.

– Robbie and Michael

Fusion/FlexLink Intrusive Maintenance – San Francisco

Update ( 1:00AM ): This maintenance is now complete.

Beginning tonight at midnight, we will be performing hardware and transport upgrades for a small portion of customers in San Francisco. Affected users will experience some routing changes and periods of downtime while the upgrades take place.

– Robbie and Michael

Non-Intrusive Voice Maintenance

Tonight starting at midnight, we will be performing maintenance updates to our Phone Switch.

There should be no issues placing or receiving calls during this time, however it is possible that you could experience a call drop, or call quality spikes during this time.

Estimated maintenance time is ~2 hours

Thank you – Brandon

 

Update - 2:04am – 10/27/2015

Maintenance is going longer than expected. Estimated completion time by 3 am.

Update – 2:26am – 10/27/2015

Maintenance is complete.

Virtual Fax Service Outage

Customers that have Sonic’s Business Virtual Fax service are experiencing an outage.  We are working with our vendor to figure out what happened and to restore service as soon as possible.  We will update you as things progress.  Sorry for the inconvenience.

-Brandon

Update (2:09pm)  We are currently working to restore virtual faxing and should have the issue resolved within the next 30-45 mins.

Update(5:17pm) There were issues programming numbers that has been since fixed.  We have made successful faxes to test lines.  We are currently adding and testing all fax lines that previously existed.  We will update when all lines have confirmed to be working as expected. ETR ~1hr

Update(6:16) All Virtual Fax lines are programmed in, and tested.

Voice Network Maintenance

Tonight starting at midnight, we will be performing maintenance updates to our Phone Switch as well as servicing a device for some of our T1 voice connections.

There should be no issues placing calls during this time, however it is possible that you could experience a call drop, or call quality spikes during this time.  The phone switch should yield no problems during the update process, but the T1’s may have problems completing calls.

Expected maintenance time is ~2 hours

Thank you – Brandon

 

Maintenance is now complete (2:43am) -Brandon

FlexLink Ethernet Maintenence – San Francisco

Tonight at midnight a very small subset of FlexLink Ethernet customers located in San Francisco will experience about 10 minutes of downtime due to emergency system maintenence needed to restore services to network features.

-Update – 10/15/2015
The same equipment is having extra work done tonight at midnight for a likely final round.

Fusion Outage in Pittsburg Area

We are experiencing a connectivity problem that is affecting Fusion customers in the Pittsburg area. We are dispatching technicians to troubleshoot the problem with an ETA of 10:00am

-Michael

 

Update:  The router encountered a software defect which caused the router to stop responding.  Our technicians restarted the router and service has been restored.

-Brandon

Outage

At 8:30 am we started experiencing a large DDOS attack, causing most of our systems to become unaccessable. Our Network Operations Center is currently working to resolve the issue.

Update:9:40 am

We have blocked the large DDOS attack to our Santa Rosa Data Center. All services are back up.

Update: 10:45 AM

We have experienced some further trouble from this attack and have blocked the malicious traffic at this point.

 

NOC

 

Legacy DSL Intrusive Maintenance

Beginning tonight at midnight we will be performing maintenance on equipment serving legacy DSL customers in Northern California. Users may notice their connection go up and down for 10-20 minutes at a time during this maintenance window.

– Robbie and Tomoc