Story

Why Your AI Agent's Environment Runs Out of Disk Space (And How to Fix It Live)

Short answer: yes, you can almost always grow the volume without tearing anything down -- and the discipline for doing it safely hasn't changed since I first wrote this up for a Windows Server 2003 virtual machine back in 2011. I've been doing this since 1988, and "the disk filled up and now the thing won't start" is one of the oldest failure modes in computing. It just shows up in a new place now: an agent's container volume, a vector-store data directory, or a model cache that quietly grew until it hit a wall.

The classic fix: extend the volume, don't rebuild the machine

In 2011 the answer for a Server 2003 guest that ran out of room on drive C was almost never "rebuild the VM." It was: extend the underlying virtual disk at the hypervisor level, then extend the partition inside the guest OS to claim the new space. Two layers, two separate operations, and skipping either one leaves you with unused space you can see but can't use.

That two-layer discipline is exactly what still trips people up today.

The 2026 version: same two layers, different container

An AI agent's runtime -- whether it's a Docker container, a dev sandbox, or a cloud compute instance -- almost always has the identical two-layer structure:

- The underlying storage allocation. This is your hypervisor's virtual disk in 2011; today it's a container volume size limit, an attached cloud disk, or a storage quota on the compute tier running your agent. If the agent's process can't write -- model weights, vector embeddings, log files, conversation history -- check this layer first. Growing it usually doesn't require destroying the container; most platforms support extending an attached volume live. - The filesystem inside the runtime. Just like a Windows partition that doesn't automatically claim newly available disk space, a container's filesystem doesn't always grow to fill a resized volume on its own. You may need to explicitly extend the filesystem (or restart the container so it re-reads the new size) before the extra space is usable.

Miss either layer and you get the exact same symptom I saw constantly in 2011: the disk "has room" at the infrastructure level, but the running process still reports it's full.

What's actually filling up an AI agent's disk

The specific culprits are new, but the pattern of "something grows unbounded until it isn't" is not:

- Local model weight caches that re-download on every deploy instead of persisting - Vector database index files that grow with every ingested document and are never pruned - Conversation/session logs written to local disk instead of a managed log sink - Temporary files from document processing (PDFs, transcripts, scraped pages) that never get cleaned up after the job completes

Before you extend anything, check whether you're actually out of capacity or whether something is leaking. Extending a disk to accommodate a leak just buys you a few more days before the same alert fires again -- I learned that lesson the hard way on a production Exchange server in the 2000s, and it's just as true for a runaway log directory on an agent host today.

Do the extension, then find the real cause

If you genuinely need more room -- growing document corpora, a larger model, more concurrent sessions -- extend both layers, verify the process can actually write to the new space, and move on. But if the disk filled up unexpectedly, treat that the same way I've always treated it: as a signal to go find out why, not just a problem to patch. Set a monitor or alert at a threshold below 100% so you catch the next one before the agent falls over mid-task.

The takeaway

Running out of disk space under a live workload isn't a crisis if you know the two layers you have to extend and you check both. That was true extending a Windows Server 2003 VM's C: drive in 2011, and it's true extending a container volume under an AI agent today. Extend the storage, extend the filesystem, confirm the process can see it, and then go figure out what's actually consuming the space before you're back here next month.

← All stories · Proof records →