Archive for the ‘Network’ Category

Large DDoS Attack

Friday, May 1st, 2009

At 7:17 PM today, a large distributed denial of service attack was aimed at one of our customers. The DDoS attack reached over 1 million pps at our network edge. The primary impact of the DDoS was to destabilize the FRATM/Business-T router that it was aimed at, though all users ...

DSL Uplink Failure

Saturday, April 25th, 2009

Earlier today, our support department diagnosed a problem with one of our DSL aggregation routers that resulted in customers served by that router having difficulties reaching some sites on the Internet. After escalating the issue, it was diagnosed that one of the redundant ATM uplinks of that router went faulty. ...

DSL Aggregation Router Maintenance Reload

Monday, April 20th, 2009

Tonight, April 21 at 12:01 AM, we will be performing a maintenance reload of one of our DSL aggregation routers. This router serves DSL to customers in the Bay Area. Expected impact is less than 5 minutes of service interruption for DSL customers served by this router. -Jared Update: The SMS reboot ...

Denial of Service Attack

Friday, April 17th, 2009

At approximately 3PM today a DoS attack was aimed at one of our Business-T customers. The attack saturated the uplinks of one of our customer aggregation routers, causing 5-10 minutes of service interruption to customers served by that router. The DoS attack has been blocked at our network edge. -Jared

ATM Customer Aggregation Router Reload

Wednesday, April 8th, 2009

This upcoming Friday, April 10 at 12:01 AM, we will be performing a maintenance reload on our ATM customer aggregation routers. This will result in 5-10 minutes of downtime for Business-T and FRATM customers. -Jared Update: The maintenance reloads were completed without issue. Total downtime for affected customers was under 10 minutes.

T1 Cable Maintenance

Monday, April 6th, 2009

This Wednesday, April 8 at 12:01 AM, we will be doing brief cable maintenance on the DS3 that backhauls some of our T1 capacity in our San Francisco POP. This will result in approximately 15 minutes of downtime for T1 customers on the affected DS3. -Jared and Nathan Edit: Fixed incorrect month. Update: ...

Los Angeles ATM Maintenance

Wednesday, March 25th, 2009

This Thursday, March 26 at 12:01 AM, we will be inserting a new card into our core ATM switch in Los Angeles. This switch handles all DSL, Business-T and FRATM connections in the Los Angeles area. No impact is expected, though the hardware insertion may require a reboot of the ...

Unexpected DSL Aggregation Router Reload

Thursday, March 19th, 2009

At approximately 4:30 PM today, one of the DSL aggregation routers that serve DSL customers in the Bay Area unexpectedly reloaded. This caused about 5 minutes of downtime for the customers served by this router.We are investigating the cause of this reload. -Jared

Customer Router Hardware Maintenance

Tuesday, March 17th, 2009

This Wednesday, March 18 at 11:00 PM, we will be inserting new interface cards into two of our T1/T3 customer aggregation routers in San Francisco. This work is not expected to cause an interruption of service, but a router reload may be required to complete this operation. If a reload ...

Fresno ATM Issues

Monday, March 9th, 2009

We are currently tracking an issue with our OC-3 aggregation circuit that serves the Fresno area.  The circuit went down for 5 minutes about 10 minutes ago.  It is presently up, but not passing any traffic.  We've been in touch with AT&T with regards to this issue and will update ...