ATM Customer Aggregation Router Reload

July 28, 2014 – 11:02 am by tomoc

Tonight, July 28, starting at 11:59pm, we will be performing a maintenance reload on our ATM customer aggregation routers. This will result in 5-10 minutes of downtime for Business-T and FRATM customers.

Update: Maintenance complete

-Tomoc

Fusion/FlexLink Intrusive Maintenance

July 28, 2014 – 8:43 am by Tim Jackson

7/29/14 – 12:14AM – This maintenance is now complete.

This evening, 7/28/14, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Eastern portions of Santa Rosa. Expected downtime is less than 30 minutes.

-Tim J.

Non-Intrusive Voice Network Maintenance

July 28, 2014 – 8:37 am by Tim Jackson

7/29/14 – 12:13AM This maintenance is now complete.

Tonight 7/28/2014 starting at 11:59PM PDT we will be finishing a software upgrade on portions of our voice network in Santa Rosa. This is expected to take 10-15 minutes and no customer impact is expected from this maintenance.

-Tim J.

Fusion/FlexLink Intrusive Maintenance

July 24, 2014 – 1:06 pm by rabrown

Update(1:22AM): We were able to remotely resolve the issue with the problematic card  and all affected customers are now back online.

Update(12:51AM): This maintenance is now complete. A single card within a dslam in Mendocino failed to upgrade properly, leaving the customers served from that card offline for the moment. We are working towards a resolution and will update this post when the issue has been resolved.

This evening, beginning at 11:59PM, we will be performing intrusive maintenance on equipment serving Fusion and FlexLink customers in Fort Bragg, Mendocino, and Cloverdale. Expected downtime is less than 15 minutes. A small portion of customers may need to reboot their DSL modems after these code upgrades take place.

- Robbie

Outbound mail filter issue

July 22, 2014 – 3:25 pm by Kelsey

A bug introduced this afternoon in our outbound mail filters would, under certain circumstances, add a non-compliant header to messages sent through mail.sonic.net.  While most servers we’re happy to accept these messages some systems refused to accept the messages.  A fix for the bug has already been released into production.  –Kelsey

DNS Server Issues

July 20, 2014 – 1:56 pm by Kelsey

For the past couple of hours we’ve been having issues with our DNS servers.  We just identified the source of the problem and should have it completely resolved in a few minutes.  As it turns out, this was a variance on the attacks that have caused us trouble in the past and was escaping the notice of our automated systems.  We’re sorry for any inconvenience this may have caused!

-Kelsey, William, Tomoc and Tim

 

Non-Intrusive Network Maintenance – Bay Area

July 8, 2014 – 1:51 pm by Tim Jackson

7/9/2014 – 4:15AM PDT – This maintenance is now complete.

Tonight beginning at 11:59PM PDT we will begin performing non-intrusive maintenance on network in portions of the bay area. This includes a software upgrade to portions of our voice network. No customer impact is expected, and the estimated duration is around 2 hours.

-Tim J.

Meeting today 2 – 2:30

July 3, 2014 – 9:16 am by kavan

Due to the holiday tomorrow our usual Friday meeting is being held today from 2 to 2:30 PM. Our office and phones will be closed during this time.

Server maintenance tonight

July 1, 2014 – 3:09 pm by Grant Keller

Tonight at 11:59pm, we will be performing maintenance on several customer facing services. During this time there may be brief interruptions of the following tools:

  • Webmail
  • Signup Form
  • Custom Hosted Websites
  • Member Tools
  • Customer MySQL databases

 

Connectivity Issues to Santa Rosa Datacenter

June 29, 2014 – 4:10 am by rabrown

This morning, beginning around 3:45 AM, a host within our Santa Rosa datacenter became the target of a very large DDoS attack. We are currently in the process of battling this attack and users may notice reachability problems to services such as our email servers and member tools during this time.

- Robbie