OS·WholeTech
OS·WholeTech / Proxmox / Analysis
🔬 Analysis · alternatives · gaps

The Proxmox setup, under the microscope.

The Proxmox guide gives you the clean, opinionated path: make one container, then it's just the Linux guide inside. This page is the honest second pass: why each choice was made, what else you could have done, what we deliberately left out, the trending tools worth a look, how to get ready for Mythos, and how to lock the whole home lab down.

Written May 2026. The AI-tooling world moves weekly — this is a snapshot of the landscape and the reasoning, not gospel.

Part 1

The steps, re-examined

Each guide step made one choice for clarity. Here's the reasoning and the roads not taken.

1

Creating the container — LXC, the default

We chose: a single Ubuntu LXC container called ai-box, created through the Proxmox web UI.

Why: an LXC is light, starts instantly, and sips resources — one always-on box for the whole house without the overhead of a full virtual machine. The UI wizard is the most teachable path.

Alternatives worth knowing
  • A full VM instead of an LXC. A VM is a complete, separately-kernelled virtual computer — stronger isolation and security, the obvious choice if you want the AI box truly walled off from the host and everything else. The trade is weight: more RAM, slower to boot, heavier on the host. An LXC is lighter but shares the host kernel, so its isolation is weaker. For autonomous agents that run unattended, a VM is the more defensible choice.
  • Unprivileged vs privileged LXC. The guide didn't stress this and should have: an unprivileged container (root inside ≠ root on the host) is meaningfully safer and is the right default. A privileged container is easier for some hardware tricks but a much bigger risk if anything inside is compromised. Create it unprivileged unless you have a specific reason not to.
  • Proxmox community helper-scripts (community-scripts.github.io, formerly tteck's) create a container in one line — real convenience, but they're community-maintained code you're running as root on your host. Convenience vs. trust: only run them if you trust the source, and read what they do first.
2–4 · ✦

Inside the container — Node, the agents & Hermes

We chose: install Node LTS, then npm-install Claude Code, Codex, and Gemini, plus Hermes as the bonus 4th agent — all inside the container.

Why: once the container exists, it's just a small Linux machine. From here the setup is identical to the Linux guide, so the reasoning and alternatives are the same too.

Same as the Linux guide
  • Everything inside the container — Node version managers, the native Claude Code installer, model choices, editor extensions, Codex's GPT-5.5 refresh and Claude's Opus 4.7 — is covered in the Linux guide and its analysis. Don't duplicate the reasoning; the container is Linux.
  • Hermes (Nous Research's self-improving, model-agnostic agent) installs natively in the container too — a good reminder that "the big three" isn't the whole field.
5

Tailscale — the network & the TUN grant

We chose: Tailscale, with two options — on the host, or inside the container after granting it the host's TUN device.

Alternatives & the trade-off
  • Running Tailscale on the Proxmox host is the simpler, cleaner option — the container reaches the tailnet through the host and you never touch its config. We led with the in-container route for self-containment, but host-side is often the better call.
  • The TUN device grant has security implications. The two lxc.cgroup2.devices.allow / lxc.mount.entry lines hand the container direct access to a host kernel device — that widens what the container can do and weakens its isolation. It's the right trade for many people, but it is a trade. Running Tailscale on the host avoids it entirely.
  • ZeroTier / Netbird / raw WireGuard are all alternatives, same as elsewhere on the network. We didn't cover Tailscale ACLs in the guide — they're how you stop a misbehaving agent box from reaching everything else. Covered in Security below.
6

Ollama & the GPU

We chose: Ollama + llama3.2 inside the container, CPU-only by default, with GPU passthrough noted as advanced.

Alternatives & the GPU question
  • GPU passthrough to a VM is the cleaner, more isolated path: dedicate the NVIDIA card to a VM, install the drivers there, and run Ollama in that VM. It's better walled off and the drivers behave more predictably.
  • Bind-mounting the GPU into an LXC is lighter (no full VM) but genuinely advanced — driver-version matching on host and container, device passthrough config, and a weaker isolation story. Worth it only once you're comfortable.
  • Better models (qwen3, deepseek-r1, gemma3) and the LM Studio / Jan / llama.cpp alternatives are the same as in the Linux analysis. llama3.2 is a gentle start, not the ceiling. Without a GPU, keep models small or use a GPU cloud.
Optional · the editor route

The editor route — never on the host, always on the workload

Proxmox is the hypervisor — the box that runs the box that runs the agents. The editor question on Proxmox has a hard rule baked into it: never put an editor (or any GUI tool) on the host itself. The host's job is to be lean, predictable, and snapshot-and-restore reliable. Editors belong on the workload — the LXC or VM you actually code in. Once you accept that, the editor route on Proxmox is cleaner than on any other platform on this site, because snapshots make experimentation cheap. Here are the two paths that work, and the one that doesn't.

The two real paths on Proxmox Set up Path A — laptop VS Code + Remote-SSH into the LXC Set up Path B — a dedicated code-server LXC Pick one or two AI extensions, not all of them Five minutes to set it up well Pros — what the editor route gives you on Proxmox Cons — what it costs you When to pick which
🪟The honest take: the home-lab editor question has a beautifully boring answer on Proxmox — put the editor where editors belong (a container), put the agents where agents belong (a container), put the model where models belong (a container), and let the hypervisor be a hypervisor. Snapshots make this safer than any other platform on the site; the only mistake is installing anything fancy on the host itself.
Part 2

What we left out — and why

The guide is deliberately a clean six-step spine. That clarity has a cost: real omissions — and on a hypervisor, several of them are about safety. Here they are, honestly, with the reason each was cut.

Left outWhat it isWhy it was cut
Hermes AgentNous Research's self-improving, model-agnostic coding agentGenuinely an oversight in v1 — it's newer and niche. Now added as the bonus 4th agent, installed inside the container. A good reminder that "the big three" isn't the whole field.
Unprivileged containersAn LXC where root inside isn't root on the hostThe real security omission. We should have stressed that the AI box belongs in an unprivileged container by default — it's the single biggest "free" hardening on this page. See Part 5.
Proxmox backupsvzdump snapshots and Proxmox Backup Server (PBS)Cut to keep the spine to "make it work." But a container running autonomous agents is exactly what you want backed up — set a scheduled vzdump, or stand up PBS, before you lean on it.
Snapshots before agents runAn instant point-in-time copy you can roll back toSkipped for length, but it's the home-lab superpower: take a snapshot, let an autonomous agent loose, roll back in seconds if it makes a mess. Covered in Part 5.
Resource limitsRAM, CPU, and disk caps on the containerWe set starter values and moved on. A runaway agent can pin the host; explicit limits keep one container from starving everything else on the box.
A non-root user insideA normal login instead of running everything as rootThe guide does everything as root for simplicity. Real setups add an unprivileged user inside the container so the agents don't run with full root rights.
Its own VLANPutting the AI box on an isolated network segmentOne layer past a first setup, but the right answer for an autonomous box: a VLAN means a misbehaving agent can't reach your other machines. See Part 5.
The host firewallProxmox's built-in firewall, at datacenter / node / container levelOff by default and not covered. It's how you make sure only Tailscale — never the open internet — reaches the web UI and the container.
🧭The pattern: we cut anything that wasn't needed to get a working AI box. The price, on a hypervisor especially, is that "production-ready" needs unprivileged containers, backups, snapshots, resource limits, and network isolation on top. This analysis page is where that depth lives.
Part 4 · the next wave

Getting ready for Mythos

Mythos is Anthropic's first model specialized for one domain: defensive cybersecurity. Announced April 7 2026 as the engine of Project Glasswing, it has already found a 27-year-old vulnerability in OpenBSD and bugs in FFmpeg. It is invitation-only ($25 / $125 per million tokens), shipped to 12 founding orgs and 40+ critical-infrastructure partners — not a download. Full briefing →

So "getting ready" isn't an install — it's preparing your environment so that when domain-specialized models (Mythos and the wave behind it) open up, you can point them at something useful:

🔭Honest take: as an individual you won't get Mythos itself soon. What you can do is build the habits — MCP, Git, a private network, a hardened, isolated VM — that make any future specialized model immediately useful. On Proxmox that "isolated VM" is a one-click reality (see the tool map).
Part 5 · don't skip this

Securing the install — the part most guides skip

You're running a hypervisor with a web admin panel, plus a container full of tools that can read files, run commands, and reach the internet, a private network, and a local model server. That's a lot of power on one box. Here's how to keep it from biting you — Proxmox and home-lab specifics first, then universal rules.

Real incident (Feb 2026): Check Point Research disclosed that a malicious config could redirect Claude Code's traffic via the ANTHROPIC_BASE_URL setting and exfiltrate your API key in plaintext. Anthropic patched it before disclosure — the lesson stands: keep Claude Code updated, install only from official sources, and be suspicious of any config that reroutes where a tool "phones home."
Proxmox & home-lab specifics Protect your keys & logins Keep the agents on a leash Supply chain (the install commands themselves) Lock down Ollama & Tailscale
✓ Good shape when: the container is unprivileged (or it's a dedicated VM), the Proxmox UI is Tailscale-only with 2FA on, you snapshot before autonomous runs, the AI box is on its own VLAN, no keys live in plaintext, agents can't read your secrets, Ollama is Tailscale-only, and everything auto-updates. That's a setup you can hand a vulnerability-finding model without flinching.
Back to it

Next