Story

How Do You Enable Your Hardware for Local AI Before You Install Anything?

Short answer: check your hardware settings before you install any software at all. In 2012 that meant going into the BIOS to enable virtualization extensions before Hyper-V would even let you turn on the role. In 2026 it means confirming your GPU drivers, memory allocation, and hardware acceleration settings are actually configured for inference before you install a local model runtime. Skip this step and you'll spend an hour debugging a "why won't this install" problem that a two-minute settings check would have caught.

I've built more test labs than I can count since 1988, and the failure I still see most often -- then and now -- is someone jumping straight to the software install and hitting a wall that was actually a hardware configuration problem the whole time.

The 2012 version: enabling the Hyper-V role

Back then there were several ways to turn on virtualization at the OS level -- command line (DISM /online /enable-feature /featurename:Microsoft-Hyper-V), PowerShell (Add-WindowsFeature Hyper-V), the Server Manager GUI, or letting SCVMM add the role automatically when you added a host. All four got you to the same place. But none of them worked if the BIOS hadn't been set up first -- virtualization extensions (VT-x/AMD-V) and, for anything serious, DEP had to be enabled at the hardware level before the OS role would even install cleanly.

The 2026 version: enabling your hardware for inference

The multiple-paths-to-the-same-result pattern still holds, just with different targets:

- Check GPU driver and compute-toolkit status first. Whether you're on NVIDIA with CUDA, AMD with ROCm, or Apple Silicon with Metal, the driver and toolkit have to actually be installed and recognized by the OS before any inference runtime can use hardware acceleration. Run the vendor's own diagnostic tool (nvidia-smi, for example) before you install anything else -- if it doesn't see the card, nothing downstream will either. - Confirm available VRAM and system RAM against the model you intend to run. This is the direct equivalent of checking whether your BIOS had virtualization enabled -- a hardware-level ceiling that no amount of software configuration will get around. A 14B parameter model needs real headroom; find out what you actually have before you commit to a model size. - Set power and thermal profiles for sustained load, not burst load. A gaming laptop configured for short bursts of GPU use will throttle hard under a sustained inference workload. Check the power plan and thermal settings the same way you'd check BIOS settings before a long virtualization workload. - Verify the OS actually exposes hardware acceleration to your runtime. On some systems this means confirming a specific driver mode or toggling a setting most users never touch. Just like Hyper-V needed the role explicitly enabled even after the BIOS was right, your inference runtime often needs an explicit acceleration flag set.

Do the multiple-paths check, same as 2012

Just like there were four ways to enable Hyper-V, there are usually multiple ways to confirm your hardware is ready:

1. Vendor diagnostic tool (the modern DISM equivalent) -- fastest, most authoritative. 2. Runtime's own built-in hardware check (many local model runtimes will report what acceleration they detected on startup) -- your PowerShell equivalent. 3. OS-level system information panel -- your GUI equivalent. 4. Let the orchestration layer report what it found when it starts up -- the modern version of SCVMM auto-detecting a host's capabilities.

If two of these disagree, trust the vendor diagnostic tool first and investigate the discrepancy before you go further.

The lesson that hasn't changed

Every "I can't install this" problem I debugged in 2012 that turned out to be a BIOS setting had the same root cause: someone assumed the software would just work on whatever hardware they had. Every "the model runs painfully slow" complaint I hear now has the same root cause: nobody confirmed hardware acceleration was actually active before blaming the model. Check the hardware layer first. It takes five minutes and saves you an afternoon.

← All stories · Proof records →