What a 6-Hour Blackout Taught Me About Buying APC UPS Systems

You know that specific silence? The one where every monitor goes dark at the same time and the AC hum stops and someone across the office says, "Uh, is the power out?"

That was Tuesday, June 11, 2024. 2:14 in the afternoon. 94 degrees outside. Our whole office went dark.

I'm the office administrator at a 35-person company. I manage everything from facilities to office supply ordering—roughly $150K annually across 8 vendors. I report to both operations and finance. I took over purchasing in 2020.

I waited twenty minutes before calling the landlord because I assumed it was a quick fix. It wasn't. Their side was fine. Our transformer had fried—not our fault, but not theirs either. Just a hot-weather grid event that hit the wrong block.

The damage: about three hours of lost work on the server (one of the drives failed during the hard shutdown, which triggered a RAID fault), a finance spreadsheet that never got saved, and half a day of employees sitting around playing with their phones.

My IT manager estimated the work-loss at roughly $4,800 by the time we added it all up.

I reported it to both operations and finance. The VP of ops said one thing to me: "Buy what you need. Don't let this happen again."

What I actually had to do

Before this, my procurement experience covered office supplies, coffee, laptops, and cleaning contracts. Eight vendors for a company of 35. UPS systems? I'd never bought one.

My first instinct: hop on the local office supply site, buy a couple of APC Back-UPS 750VA units at around $110 each. One per desk. Done. Cheap, fast, and people were already using similar units.

Then I did some basic math. We had 2 servers, a switch, a NAS, and backup storage in the server cabinet. Plus a workstation at every desk, the POS system, security cameras, and a handful of network printers. All told, roughly 40 devices that needed some kind of power protection.

A single 750VA unit wasn't going to cut it. Not even close.

I went to the building electrician. He looked at our panel for twenty minutes, then asked me to step into the hallway.

Half our office's circuits ran off a handful of old breakers. He pointed at them—ETA breakers, he said, installed somewhere around 2015, maybe earlier. One had a scorch mark on the plastic casing.

He said: "Your surge protectors are protecting the computers. But they're plugged into a panel that's near its limit and a circuit that's already strained."

That was exactly what I was afraid of. He told me we'd need to rebalance the load, and we'd almost certainly need to replace those ETA breakers if we were going to add UPS capacity. He guessed $1,500 to $2,000 for labor and parts alone.

That weekend I sat at my laptop searching "how to fix circuit breaker." The answer was almost always the same: find the tripped switch, reset it. But repeated tripping means an underlying load problem, and swapping in a bigger breaker doesn't solve it—it just moves the heat somewhere else. I forwarded the article to the facilities manager. Not my job to fix it, but I made sure someone saw it.

My IT manager did the actual load calculation. He pulled together a spreadsheet: rated wattage for every device, summed up, plus a 20% margin.

The math said we needed:

• One high-capacity UPS for the server cabinet
• Three mid-range UPS units for the critical workstations (about 12 people whose work would stop if they lost power mid-task)
• Standard surge protection for everything else, on a properly balanced circuit

I got quotes from three vendors. CyberPower came in cheaper on the sticker price, but their reseller didn't carry a rack-mount model that would fit our cabinet. Tripp Lite was also competitive—roughly the same specs for the 3000VA range. We went with APC because our existing Back-UPS units were already APC, our IT team knew the platform, and APC's Smart-UPS line covered every size we needed in one platform.

Here's what we settled on:

• APC Smart-UPS SRT 3000VA RM 120V (SRT3000RMXLA) for the server cabinet
• 3 × APC Smart-UPS 1500VA for the critical workstations
• 4 × APC Back-UPS units for the remaining equipment
• APC surge protectors for spots where a full UPS didn't make sense

The SRT 3000VA ran about $3,400. The Smart-UPS 1500VA units were around $700 each—call it $2,100 for three. The Back-UPS units totaled about $550. Surge protectors added roughly $200. The electrician's labor and new breakers came to $1,900. Grand total: around $8,000.

The catch? My approved budget was $3,000. Finance pushed back once. Then the VP—the same one who'd said "don't let this happen again"—replied, "Do you want to compare that to the cost of another blackout?"

We got approval the next day.

Installation day, and the spare spark plug incident

The equipment arrived on schedule. (Should mention: we paid for 2-day shipping because I didn't want to wait.)

First installation was a Friday. We powered down the server cabinet, mounted the SRT 3000VA, and plugged in the load.

Then the breaker tripped.

We'd been testing with the cabinet on the same circuit as the switch gear, and the combined draw pushed it over. The electrician wasn't on site. The building's maintenance guy was patient but not equipped for actual electrical work. The UPS itself was fine—the problem was those old ETA breakers in the panel, which couldn't handle the extra load we'd added.

We ended up shutting it all down at 3 PM. First attempt, wasted afternoon.

That weekend, our backup generator—one of those portable units that maintenance drags out when things get bad—wouldn't start. I got the call from the maintenance guy.

He already knew why: the spark plug. Nobody had touched it in probably a year. The last time the generator was used, nobody could remember.

It was Saturday afternoon. He didn't want to wait until Monday. So he drove to the local auto parts store. The clerk asked, "What's this for?"

He said it was for a generator.

The clerk said, "We've got motorcycle spark plugs. Might not be the same size."

Turned out the size matched. (Should mention: we looked it up later—the part numbers cross-referenced.)

Twenty minutes later, the generator was roaring in the back lot. It was absurd. We'd spent thousands on backup power, and the thing standing between us and a functioning office was a motorcycle spark plug from a nearby store.

Monday, the electrician came back and replaced the old ETA breakers. That part cost more than I'd hoped—$1,900 total—but it solved the tripping problem. By Wednesday, everything was on UPS. Everything was stable.

Six months later: costs, batteries, and what I do differently now

After that June outage, we had three more power blips and emergency outages in the following six months. The four critical systems on the Smart-UPS units never went down. Not once. I check the UPS status lights every morning now, the way I check my email.

But there were still surprises.

Six weeks in, one of the Smart-UPS 1500VA units started flashing a battery warning light. Battery life ended. On a unit that had probably been sitting on a shelf for a couple of years before we bought it, that wasn't shocking—APC's own documentation puts battery life at 3–5 years, depending on temperature and usage. We replaced the battery for around $180 and moved on.

As for the total cost: roughly $6,250 in hardware and surge protection. Plus $1,900 for the electrician and breaker replacement. Plus $180 for the replacement battery. Call it $8,350 all in—I mean, $8,300, give or take, after I checked the invoices again.

To be fair, that's not pocket change for a 35-person shop. The June blackout had cost us $4,800 in one afternoon. But if the servers had gone down again, it would have been worse. That's what pushed the whole budget through.

And here's what I still kick myself about: I should have had someone look at the electrical panel when I took over purchasing in 2020. If I'd done that, we might have caught the breaker issue two years ago, before a scorch mark showed up on the plastic. The good news is that nothing catastrophic happened. The bad news is that I could have avoided this whole thing.

The honest lesson is about process, not speed. We lost two extra weeks because nobody had a simple checklist for what needed to be verified when adding power protection—panel condition, circuit load, equipment ratings, spare parts. Once we put that checklist together, the actual decision took one meeting. The delays all came from missing information.

Here's what I check now, every quarter:

• After any outage: Pull the UPS logs and verify that the protected devices bridged to battery and didn't just shut down.
• Every quarter: Press the self-test button on each UPS unit. Listen for warning beeps, note any flashing codes.
• Once a year: Have someone look at the electrical panel. Confirm the breakers are in good condition and properly rated. Don't wait for the tripping to start.
• If there's any noise, heat, or unexplained tripping: Call a licensed electrician. Don't Google "how to fix circuit breaker" and try it yourself. That advice is fine for a quick reset; it's useless for diagnosing a real problem.

One more thing I'd do differently: I'd buy a spare spark plug for the generator before we ever need it. Maybe two. The generator is the cheapest part of this whole system, and it's also the reason we almost couldn't run the office on a Saturday.

If you're staring down a UPS purchase right now and you haven't looked at your electrical panel yet—do that first. Then buy the UPS. That order matters.