The Murkworks

Power restored around 12:40; all servers back online as of 13:45. Please resume normal... whatever it is you people do. XD

Power has failed at Murkworks North. PSE reports equipment failure, and an estimated repair sometime after noon.

Verizon's having more hardware problems, or more likely, never really fixed the hardware problems giving us trouble earlier in the week. A new ticket has been opened with BIG ARROWS pointing to the "THIS PIECE OF HARDWARE IS FAILING" report.

While not nearly as badly off as most of North America, we're set to experience a record-setting heat wave here around the Nightmare Factory. While we're pretty good at heat management, we do not have full A/C, and the Murkworks may have to shut down some servers during peak heat times of the day. This will happen with relatively little notice. The order of shutdown will be, as necessary: backup services, web services, mail services, then DNS and complete network, in that order. Temperatures are expected to return to ranges more approximating normal this weekend.

Last year when we went through this we stayed up, except for backup services, throughout the entire heat wave, then had a power outage just as things cooled down. It was sad.

We're back up but we've suffered a bit of damage. As far as I can tell all the servers came up fine. I haven't done much of a checkup yet but I'm working on it - we had a lot of issues getting power back up on all circuits and we've sparked a bunch of surge protectors, but it looks like we had them in all the right places.

After fluctuating violently several times, power is completely out here at Murkworks North. All servers are going offline IMMEDIATELY. No eta for return.

The murknet's upstream IP provider is apparently having some sort if difficulty; we can reach some local sites and some Of Vancouver, but most of the US is currently unreachable. We don't know why but it's too big a problem for them not to be aware, which is good since I'm not currently able to do much about it! Please carry on and hopefully it'll be patched up soon!

Hi, it's the figs of the Murkworks again, and we're having a second straight night of not just unusual but downright freakish severe weather - half a centimetre of hail, FOOM FOOM FOOM rain, and lots and lots of lighting, which we just don't see here. The cats are terrified. Fortunately there's not much wind associated with it so far, which makes it a lot less likely we'll lose power, but it's a possibility. Be advised that you may need to log out quickly on short notice.

We have our first winter storm advisory of the year, and with it, a series of brownouts that have hit what we internally call "Stage 2." (Stage 1: First alarms tripped. Stage 2: Multiple alarms, typically plus momentary darkness because we lose the lights. Stage 3: Extended power losses less than two minutes. After that, we shut down.) Hopefully it won't get any worse than this, but it could. Be prepared for power-related shutdowns on short notice.

Primary servers back online. Backup server still offline for heat reasons.