The Private AI Starter Stack
From blank machine to useful local agent—in one focused weekend.
edition 1.0 / practical, not precious
A practical field guide for choosing hardware, running a local model, and turning it into an agent that does useful work—without buying the wrong box first.
From blank machine to useful local agent—in one focused weekend.
The core offer is a compact, task-led guide. Each chapter ends with a decision or a working output, so the reader finishes with a stack plan—not a folder of bookmarks.
DDR4 remains a practical baseline, and a last-generation GPU can unlock capable small models without a new machine. DDR5 is an upgrade path.
No GPU required. Run lighter models on the no-GPU path and learn the workflow before buying hardware. See current recommended hardware →
A practical path for smaller models, chat, agentic tool use, vision, and pipelines, with lower token-context limits than the larger tiers. See current recommended hardware →
The proven reference build for model serving, Open WebUI, RAG, an agent layer, and automation pipelines. See current recommended hardware →
Headroom for bigger models, plus voice and image pipelines as hardware capability. See current recommended hardware →
* Community tool-calling finetunes exist for the Gemma 12B class at the same ~7GB footprint.
FIT CHECK · This product is for buyers with either 32GB+ system memory on the CPU-only path or a last-gen machine with 16GB RAM and 12–16GB VRAM. Hardware below both profiles is not the target audience for this product.
REFERENCE PROOF POINT · Intel Core i7-11700K · 64GB DDR4 · 24GB-GPU class · TrueNAS Community (free)
This is the public companion to the Private AI Starter Stack. Use the tier from the guide, compare the verified configuration, and follow the product link for the current price and availability.
For readers who would rather start with a complete system than source individual parts. Match the exact memory and GPU configuration shown here.
Core Ultra 7 265F · RTX 5070 Ti 16GB · 32GB DDR5, expandable to 128GB · 1TB · Windows 11 Home
$2,555.66Verified September 20, 2026 · sold by Amazon · in stock
Choose the RTX 5070 Ti configuration. This listing also contains RTX 5070, RTX 5060, and RX 9070 variants.
Check current price on Amazon →Ryzen 9 7900X · RTX 5070 12GB · 32GB DDR5 · 1TB NVMe · Windows 11 Home
$2,299Verified September 20, 2026 · sold by Amazon · in stock
Check current price on Amazon →M6 12-core CPU / 12-core GPU · 16GB unified memory · 256GB SSD. Unified memory counts toward model capacity, making this an entry point for smaller models.
$879.99Verified September 20, 2026 · sold by Amazon · pre-order at verification · released September 22, 2026
Check current price on Amazon →Two current add-in cards for readers upgrading a compatible desktop. Check power, case clearance, cooling, and motherboard support before ordering.
16GB GDDR7
$1,299.99Verified September 20, 2026 · sold by Amazon · in stock
Check current price on Amazon →12GB GDDR7
$856.99Verified September 20, 2026 · sold by Amazon · in stock
Check current price on Amazon →For larger local workloads and readers who already know why they need the extra capacity. The two RTX 3090 listings differ in condition and seller details.
GB10 Grace Blackwell · turnkey personal AI system
$4,999.99Verified September 20, 2026 · seller Micro Center · in stock
Check current price on Amazon →24GB · new/mixed listing
$2,399.99Verified September 20, 2026 · in stock
Check current price on Amazon →24GB · Refurbished – Excellent
$1,899.99Verified September 20, 2026 · seller KW-TECH CR · only 13 left at verification
Check current price on Amazon →Affiliate links are not available yet. This shortlist focuses on systems with AI-useful graphics and memory rather than basic office desktops.
Why Strix Halo fits: its large unified memory pool—up to 128GB—lets large models load entirely in fast memory without a discrete GPU.
Amazon category links are still pending, so no purchase links are shown here yet.
Compatibility check: confirm the motherboard generation, DDR4 versus DDR5 support, maximum capacity, XMP or EXPO support, and the number of free DIMM slots before buying.
Amazon prices and stock last verified September 20, 2026. Newegg observations were recorded September 20–21, 2026. Product links open the seller page so you can confirm current price, availability, condition, and configuration.
Both paths lead to a usable chat experience. The local reference stack uses Open WebUI as the browser interface.
For a compatible NVIDIA GPU and 32GB+ RAM. Use the official app catalog for a low-friction installation.
For a Mac, Windows PC, or Linux machine. Install Ollama from the command line, then connect Open WebUI or another OpenAI-compatible interface.
Your setup copilot is free. Paste your exact hardware and config into ChatGPT or Gemini for step-by-step setup and troubleshooting. Open source is the aim, but there’s no prize for doing it the hard way: use a free provider tier as your on-call helper while your Offline Stack setup does the real work. See current recommended hardware →
FIT CHECK · These setup paths assume either the 32GB+ CPU-only profile or the 16GB RAM + 12–16GB VRAM last-gen profile. Buyers without suitable local hardware are not the target audience for this product.
The customer path starts with a specific problem, delivers value before asking for a sale, and lets the digital product lead. Affiliate gear recommendations come after trust—not before it.
Short-form demos answer one question at a time: what fits in 24GB of VRAM, why local search feels slow, or which upgrade actually changes model size.
HOOK“Before you buy a mini PC for AI, check this number.”PROOFShow the decision in a real interface or build sheet.CTA“Comment STACK for the free decision scorecard.”The Offline AI Stack Scorecard turns budget, workload, and privacy priorities into one of three clear hardware profiles.
INPUTBudget, model size, noise tolerance, and uptime.OUTPUTA one-page build brief with the next three decisions.BRIDGEThe guide explains how to execute the chosen path.A short sequence teaches, reduces risk, and then presents the paid kit. No daily inbox pressure.
DAY 0Deliver the scorecard + choose-your-path explainer.DAY 2The three expensive mistakes first-time builders make.DAY 5Launch-kit offer with the exact contents and outcome.The $29 guide is the “read it” edition. The $49 Builder Bundle is the “build it tonight” edition, with the exclusive starter pack.
$29PDF guide: learn the why, choose a path, and build your own files.$49Guide + starter-pack zip + every v1.x update free, delivered automatically.VALUEThe extra $20 buys reusable implementation scaffolding—not gated chapters. The starter pack is exclusive to the $49 tier.Hardware appears beside the exact decision it solves. Each guide compares capability, limitations, and who should skip the purchase.
STARTUse what you already own whenever it fits.UPGRADEBuy only when memory, noise, or uptime blocks the goal.DISCLOSELabel qualifying Amazon links clearly.A completed checkout triggers the delivery platform—not a manual handoff. The confirmation page repeats access instructions and the email contains a direct library link.
NOWReceipt + download library + getting-started note.+1 DAY“Pick your path” onboarding prompt.+7 DAYSProgress check and one-question feedback request.The recommendation engine demonstrates how affiliate content stays honest: it narrows the path before presenting products. Choose a use case to preview the guidance.
Pick the closest starting point.
Begin with a current laptop or desktop and a compact quantized model. Spend only after you can name the workload your existing hardware can’t handle.
As an Amazon Associate we earn from qualifying purchases. See the current recommended hardware and verify today’s price →
Both editions deliver the complete PDF. The $49 Builder Bundle adds the exclusive starter pack as a zip and includes every v1.x update under the policy below.
Choose the $29 PDF when you want the complete method. Choose the $49 bundle when editable starter files will save you setup time.
GUIDE: $29 · BUNDLE: $49Every buyer receives the guide. Bundle buyers also receive one zip containing docker-compose, environment, minimal-RAG, first-model, and pitfalls files, plus a README and bonus pipeline examples.
BUNDLE: GUIDE.PDF + STARTER-PACK.ZIPBuilder Bundle buyers receive every v1.x update free, delivered automatically, under the complete Update & Support Policy.
$49 TIER: ALL V1.X UPDATES INCLUDEDThe repeatable work stays bounded. Real stack notes become content; the guide and newsletter reuse the same tested source material.
No. Commands age quickly. The guide explains the decision path, gives version-aware examples, and shows how to verify each step before moving on.
Not to start. A 32GB+ CPU-only machine can run lighter models, while a last-generation system with 16GB RAM and 12–16GB VRAM can run the small-model tier for chat, agentic tool use, vision, and pipelines. Expect lower token-context limits than the bigger tiers.
Use the free tier of ChatGPT or Gemini as your setup copilot: describe your exact machine and what you’re stuck on, and they’ll walk you through it. The guide’s examples are generalized on purpose; your copilot personalizes them.
The $49 builder bundle adds a zip with five editable files—docker-compose, .env.example, rag-minimal.md, first-model.md, and a pitfalls checklist—plus a README, two bonus pipeline patterns, and every v1.x update included under the policy. The $29 edition is the PDF guide alone.
No. Both editions are designed to stand alone. Bundle updates cover model-compatibility fixes, starter-file version bumps, hardware price refreshes, and corrected examples—not new topics or chapters, one-to-one setup help, or migration of an existing installation.
A future major edition with breaking changes, such as new chapters, will be a paid upgrade. Existing bundle owners will receive 50% off.
They help fund updates without changing the buyer’s price. Every qualifying Amazon link is labeled, and the guide includes reasons to skip a purchase when existing hardware is enough.
A practical, compact field guide to the decisions behind a private AI stack—from the machine you already own to a reliable personal agent.
Design preview only. Checkout, payment, email, and fulfillment are not connected.
Approximately 40–60 practical pages, organized to get from hardware decision to a usable first system.
You want the reasoning, not a pile of commands with no context.
You want useful AI while keeping sensitive work on systems you control.
You want to use existing or used hardware before buying a new machine.
You’re comfortable creating your own files from a clearly explained path.
No GPU required; use lighter models. See current recommended hardware →
A practical tier for smaller models, chat, agentic tool use, vision, and pipelines, with lower token-context limits. See current recommended hardware →
Reference full stack: model serving, Open WebUI, RAG, agent layer, and pipelines. See current recommended hardware →
Bigger models, plus voice and image pipelines as hardware capability. See current recommended hardware →
* Community tool-calling finetunes exist for the Gemma 12B class at the same ~7GB footprint.
FIT CHECK · This product is for buyers with either 32GB+ system memory on the CPU-only path or a last-gen machine with 16GB RAM and 12–16GB VRAM. Hardware below both profiles is not the target audience for this product.
Choose TrueNAS Community (free) with official-catalog Ollama or vLLM plus Open WebUI, or use Ollama CLI with Open WebUI on Mac, Windows, or Linux.
Your setup copilot is free. Paste your exact hardware and config into ChatGPT or Gemini for step-by-step setup and troubleshooting. Open source is the aim, but there’s no prize for doing it the hard way: use a free provider tier as your on-call helper while your Offline Stack setup does the real work. See current recommended hardware →
No. The CPU-floor path starts at 32GB+ DDR4 with lighter models. If you already own a last-generation machine with 16GB RAM and 12–16GB VRAM, it can run the small-model tier for chat, agentic tool use, vision, and pipelines, with lower token-context limits than the bigger tiers.
Use the free tier of ChatGPT or Gemini as your setup copilot: describe your exact machine and what you’re stuck on, and they’ll walk you through it. The guide’s examples are generalized on purpose; your copilot personalizes them.
Yes. Path B uses Ollama CLI plus Open WebUI—or another OpenAI-compatible interface—on Mac, Windows, or Linux.
You receive the PDF edition you purchase. The editable starter pack is exclusive to the $49 Builder Bundle.
$29 one-time · PDF only
Everything in The Guide, plus an editable starter pack that turns the decisions into concrete, privacy-safe starting files.
Design preview only. Checkout, payment, email, and fulfillment are not connected.
The complete PDF and the reasoning to create your own implementation.
The same complete PDF plus the exclusive starter pack, README, bonus pipeline examples, and the v1.x update policy.
docker-compose.ymlCATALOG-FRIENDLY.env.exampleCATALOG-FRIENDLYrag-minimal.mdCATALOG-FRIENDLYfirst-model.mdCATALOG-FRIENDLYpitfalls-checklist.mdCATALOG-FRIENDLYREADME.mdSTART HEREmorning-briefingBUILDER-TIER · BONUS PATTERNanomaly-digestBUILDER-TIER · BONUS CRON PATTERNCatalog-friendly files follow the low-terminal TrueNAS path. Builder-tier examples are for readers ready to adapt automation patterns.
Placeholder delivery flow: one PDF plus one zip containing the starter pack, README, and bonus pipeline examples. A live purchase, email, and fulfillment connection is not part of this design preview.
No GPU required; use lighter models. See current recommended hardware →
A practical tier for smaller models, chat, agentic tool use, vision, and pipelines, with lower token-context limits. See current recommended hardware →
Reference full stack: model serving, Open WebUI, RAG, agent layer, and pipelines. See current recommended hardware →
Bigger models, plus voice and image pipelines as hardware capability. See current recommended hardware →
* Community tool-calling finetunes exist for the Gemma 12B class at the same ~7GB footprint.
FIT CHECK · This product is for buyers with either 32GB+ system memory on the CPU-only path or a last-gen machine with 16GB RAM and 12–16GB VRAM. Hardware below both profiles is not the target audience for this product.
Compatible NVIDIA GPU + 32GB+ RAM → TrueNAS Community (free) → one-click Ollama or vLLM + Open WebUI from the official app catalog → browser chat. About an afternoon, minimal terminal.
Mac, Windows, or Linux → Ollama CLI → Open WebUI or another OpenAI-compatible interface.
Your setup copilot is free. Paste your exact hardware and config into ChatGPT or Gemini for step-by-step setup and troubleshooting. Open source is the aim, but there’s no prize for doing it the hard way: use a free provider tier as your on-call helper while your Offline Stack setup does the real work. See current recommended hardware →
FIT CHECK · These paths assume either the 32GB+ CPU-only profile or the 16GB RAM + 12–16GB VRAM last-gen profile. Buyers without suitable local hardware are not the target audience for this product.
The $49 Builder Bundle includes every v1.x update free, delivered automatically: model-compatibility fixes, starter-file version bumps, hardware price-band refreshes, and corrected examples.
What’s not included: new topics or chapters, one-to-one setup help, and migrating your existing installation.
Future major editions — breaking changes or new chapters — are paid upgrades. Existing Builder Bundle owners get 50% off as a loyalty discount. This is a self-serve product by design: no support beyond this policy is promised.
$29 is “read it”: the PDF only. $49 is “build it tonight”: the PDF plus the exclusive editable starter pack, README, bonus pipeline examples, and the Builder Bundle update policy.
No. The 32GB+ DDR4 CPU-floor path works with lighter models. A last-generation machine with 16GB RAM and 12–16GB VRAM can run the small-model tier for chat, agentic tool use, vision, and pipelines; its main trade-off is lower token-context limits than the bigger tiers.
Use the free tier of ChatGPT or Gemini as your setup copilot: describe your exact machine and what you’re stuck on, and they’ll walk you through it. The guide’s examples are generalized on purpose; your copilot personalizes them.
No. It is a self-serve product by design, and no support beyond the Update & Support Policy is promised.
Open WebUI is the browser interface for the reference stack.
$49 one-time · PDF + starter-pack zip
Preview the storefront handoff, or download the sample chapter to see the guide’s practical tone and structure.
The $29 edition is “read it.” The $49 edition is “build it tonight,” with the exclusive starter pack and the Builder Bundle update policy.
This is a storefront interaction preview. Live checkout would be connected to the selected commerce platform at launch.
The guide, starter pack, and every free v1.x update live in one download library.