fig

Back online

Power restored around 12:40; all servers back online as of 13:45. Please resume normal... whatever it is you people do. XD
fig

Yes, network access is sucking

Verizon's having more hardware problems, or more likely, never really fixed the hardware problems giving us trouble earlier in the week. A new ticket has been opened with BIG ARROWS pointing to the "THIS PIECE OF HARDWARE IS FAILING" report.
  • Current Mood
    frustrated frustrated
fig

Heat-related shutdowns possible

While not nearly as badly off as most of North America, we're set to experience a record-setting heat wave here around the Nightmare Factory. While we're pretty good at heat management, we do not have full A/C, and the Murkworks may have to shut down some servers during peak heat times of the day. This will happen with relatively little notice. The order of shutdown will be, as necessary: backup services, web services, mail services, then DNS and complete network, in that order. Temperatures are expected to return to ranges more approximating normal this weekend.

Last year when we went through this we stayed up, except for backup services, throughout the entire heat wave, then had a power outage just as things cooled down. It was sad.
  • Current Mood
    hot hot
fig

Back up - check for problems

We're back up but we've suffered a bit of damage. As far as I can tell all the servers came up fine. I haven't done much of a checkup yet but I'm working on it - we had a lot of issues getting power back up on all circuits and we've sparked a bunch of surge protectors, but it looks like we had them in all the right places.
fig

Routing problems upstream of us

The murknet's upstream IP provider is apparently having some sort if difficulty; we can reach some local sites and some Of Vancouver, but most of the US is currently unreachable. We don't know why but it's too big a problem for them not to be aware, which is good since I'm not currently able to do much about it! Please carry on and hopefully it'll be patched up soon!
fig

A second night of severe weather

Hi, it's the figs of the Murkworks again, and we're having a second straight night of not just unusual but downright freakish severe weather - half a centimetre of hail, FOOM FOOM FOOM rain, and lots and lots of lighting, which we just don't see here. The cats are terrified. Fortunately there's not much wind associated with it so far, which makes it a lot less likely we'll lose power, but it's a possibility. Be advised that you may need to log out quickly on short notice.
  • Current Mood
    excited excited
fig

Winter storm advisory

We have our first winter storm advisory of the year, and with it, a series of brownouts that have hit what we internally call "Stage 2." (Stage 1: First alarms tripped. Stage 2: Multiple alarms, typically plus momentary darkness because we lose the lights. Stage 3: Extended power losses less than two minutes. After that, we shut down.) Hopefully it won't get any worse than this, but it could. Be prepared for power-related shutdowns on short notice.
  • Current Music
    Birdhouse in Your Soul | They Might Be Giants