Archive for February, 2008

WBA Petaluma Night Op.

Friday, February 29th, 2008

Fri Feb 29 09:43:03 PST 2008 -- WBA Petaluma Night Op. At 2am on Sunday morning (3/2/08) all Petaluma WBA customers will be offline for approximately five minutes while we upgrade the wiring system. -Jason

Combating Web Server Spam.

Thursday, February 28th, 2008

Thu Feb 28 11:07:57 PST 2008 -- Combating Web Server Spam. Some security changes to help combat SPAM being sent from our webcluster caused some user's scripts to break. We have corrected the issues and everything seems to be running normal. You should now be able to sleep better ...

Mail Hiccup.

Tuesday, February 26th, 2008

Tue Feb 26 12:40:45 PST 2008 -- Mail Hiccup. One of our clustered NetApp filers just paniced and, shortly after it rebooted, one of its Ethernet cards locked up. These two events lead to two brief POP/IMAP/Webmail server interruptions. Customers may have noticed timeouts or other errors while checking ...

WBA Petaluma Outage.

Wednesday, February 20th, 2008

Wed Feb 20 13:20:39 PST 2008 -- WBA Petaluma Outage. At 6:45am we lost power at our Petaluma tower site; we moved a gas generator into place and ran on generated power for approximately 45 minutes before power was restored. Overall downtime was from 6:45am to 7:30am with another ...

Upstream Network Issue.

Tuesday, February 19th, 2008

Tue Feb 19 12:37:46 PST 2008 -- Upstream Network Issue. At 12:15 PM today, one of our upstream network providers suffered an internal network outage, which caused a lack of reachability to many Internet sites. We have routed around that upstream while they repair the problem. -Jared, Dusty, and ...

Emergency maintenance on core administrative…

Wednesday, February 6th, 2008

Wed Feb 6 00:14:25 PST 2008 -- Emergency maintenance on core administrative server. One of our administrative servers that handles a lot of things behind the scenes like membertool backends, tech support tools, and ... writing MOTDs, crashed earlier this evening. As it's hardware had already been deemed suspect ...