An aggregation point for all the Sonic.net Blogs.
The new Sonic.net softball team, The Sonic.net Death Monkeys, is comprised mostly of Sonic.net employees with a few friends and family of employees - all of them are tough.
Jenny sent me some pictures as proof:
Kim's Arm.
Lani's Toe.
Terra's Leg.
Note: Terra’s Leg has Karl’s autograph - Karl being the one who threw the wild pitch that caused that bruise.
Two games down, and three to go. The Sonic Death Monkeys have been playing hard and are tied for 4th place! We’d love to have you in the stands cheering us on, tonight’s game starts at 7:20, Howarth Park, Santa Rosa. Thank you everyone!
Ed: for some reason this post was never approved after Jenny originally wrote it 23, September, sorry.
We are the nerdy type around here, and as such we love graphs - they are an easy visual aide to what can be mounds of data - so it pleases me to share with you the graphs from our recent ‘Mail Storage Maintenance‘:
Daily disk utilization for E-Mail storage.
You can see we were hovering around 85%; which for the NetApp Filers is the point at which the overhead of maintaining free and used space begins to impact performance. Fortunately for us, the storage requirements for Customer E-Mail grows linearly, so it’s easy to plan ahead and have a new shelf ready to install:
Yearly disk utilization for E-Mail storage.
As you can see, it was about this time last year when we added more capacity, and if the graphs hold true, we will be doing another upgrade in a year; of course at some point we will run into power and other physical constraints, at which point we may need to do an even bigger jump to newer Filers with higher capacity disks; for now though, we all sleep a little bit better knowing we have plenty of room to grow for the coming year.
Fri Oct 10 10:05:08 PDT 2008 — Trouble with the Sonic.net Website. We are currently experiencing trouble with our corp.sonic.net Web Server that serves part of the Sonic.net Home Page and all of our Blogs. We are working on the problem and will have it back soon. -Augie, William, and Kelsey.
Tonight at Midnight we will be performing maintenance on the NetApp Filers that store Customer E-Mail; there is no expected downtime during this period and will take less than an hour to be completed.
During this period we will be adding additional capacity to these Filers; this capacity will allow for future growth of Customer E-Mail storage and improved performance for all of Sonic.net’s E-Mail Customers.
–Augie, Don, William, Sal, and Kelsey.
Separate from our earlier post about slow imap.sonic.net performance (http://corp.sonic.net/status/2008/09/26/imap-performance-problems-solved/) - we have also received reports of slow Webmail IMAP performance and timeouts when Customers were using the Webmail clients on http://webmail.sonic.net.
We believe we have isolated the problem, which was a bug in our IMAP Proxy software, and have not received any reports of new problems since the beginning of the week when we implemented a fix for the problem software.
If you see timeouts when using http://webmail.sonic.net, please contact Technical Support (support@sonic.net or 1.707.547.3400) immediately, and provide the error message you receive and the time at which the problem occurred.
A misguided attempt to update some software on our Webmail Cluster inadvertently took the software, associated web pages, and server configuration back to January of this year.
As a result Customers would have seen inconsistent or broken behavior while trying to access the website from around 2:30am to 8:00am, at which point the data was restored from backups.
We applogize for any inconvenience this caused to our Customers; we will be reviewing our documented procedures so that this type of mistake does not occur in the future.
–Augie
At 3:40PM this afternoon we will be performing an emergency router reload on one of our ATM customer aggregation routers. All connected Business-T and FRATM customers will experience approximately 5 minutes of downtime during the reload. -Tim, Nathan, Matt and Jared
This Thursday, Oct 2 at 12:01 AM we will begin work retrofitting the backbone of our San Jose POP. This retrofit will enhance the redundancy and capacity of this POP to accomodate our growth and new CLEC-based products. Currently this POP does not directly serve any customers, so there should be no customer impact. We will route customer traffic away from the POP, so you may see longer routes to Internet hosts than normal during this time. We expect the operation to take 60-90 minutes.
-Jared and Nathan
On Tuesday September 30 at 12:01 AM we will be moving several hundred DSL subscribers from one of our DSL aggregation routers to another, to balance network load. This move should take less than 5 minutes and will only cause a brief service interruption.
-Jared