Switching Power: The Path to a Brighter Future

Author: Sasank Chilamkurthy

Every computer needs electricity, but few software engineers think about where that electricity comes from. Over the past year, I have spent more time thinking about transformers, diesel generators, and tariff slabs than I ever expected. It turns out that power infrastructure is the hidden constraint that determines where and how you can deploy compute at scale.

Why Power Matters

Data centers are traditionally measured by the power they consume. A single Nvidia H100 GPU draws roughly one kilowatt under load. A hundred-GPU cluster therefore needs a hundred kilowatts of reliable power. That is enough electricity to power a small apartment building.

But raw power is not enough. Servers need uninterrupted power. A momentary outage can corrupt training runs, drop database transactions, and violate service-level agreements. So a data center needs not just a grid connection, but also backup power and power conditioning.

The Micro Data Center Model

Mega data centers consume tens of megawatts and require specialized substations, cooling towers, and real estate. They make sense for hyperscalers but are out of reach for most organizations.

Micro data centers are a compelling alternative. A fifty-to-three-hundred-kilowatt facility can fit in a small office building, use standard commercial power, and be backed up by an affordable diesel generator plus a battery pack. The capital cost is an order of magnitude lower, and the facility can be located closer to where the data is produced.

Reliability improves as well. Two independent hundred-kilowatt facilities are more resilient than a single two-hundred-kilowatt facility because either one can act as a failover for the other. This is the same logic that drives availability zones in public cloud regions.

What We Learned

While researching micro data centers, we spoke to engineers at power distribution companies and visited buildings that already host hundred-kilowatt connections. We learned that the biggest barrier is usually not hardware but paperwork: getting a commercial power connection approved, scheduling inspections, and negotiating tariffs.

Once the paperwork is done, the physical infrastructure is surprisingly manageable. A transformer, a generator, a battery bank, and a server room can all fit within a thousand-square-foot footprint. The real challenge is integrating software operations with facilities management so that the same team can handle both.

JOHNAIC was designed with this integration in mind. Our systems are built to run reliably in exactly these environments, with remote monitoring, automated failover, and a support model that treats power and compute as a single stack.

Published on 28/09/24