Healthy AI First · Episode 3 · 19 min
Before the First Prompt

A ticket made of a single sentence, an agent that builds a clean account deletion feature in 20 minutes, and a question from Jonas that reveals what the agent quietly decided along the way. Meanwhile, the AI writes a delivery date into Miriam's client proposal that nobody ever committed to. This episode is about which decisions have to stay with people and which ones the agent can safely make: load-bearing walls, one-way doors, locks instead of notes in the prompt, a lost Mars probe, and how much planning is really needed.
Listen on
Companion document
All studies, sources and claims from this episode in one PDF, to read along or look things up later.
Download the companion document (PDF)Chapters
- 0:00Cold Open
- 1:08Welcome
- 1:51The List
- 3:10Miriam's Proposal
- 4:17Load-Bearing Walls
- 5:52One-Way Doors
- 7:28A word from us
- 8:19The Lock on the Door
- 9:27Locks in the Tool
- 11:01The Connection Next Door
- 12:28What Stays With Us
- 13:40What the Vendors Recommend
- 15:33Two Fields in the Ticket
- 16:47Your Load-Bearing Wall
Show notes
Fictional characters: Jonas (junior developer), Daniel (senior developer), Miriam (team lead for Daniel and Jonas). All studies and cases are real.
Try this week
- With coding agents: before each task, write down 2 sentences. What should the task explicitly not do? Which decision must the agent not make on its own? After the run, ask: "Which decisions are in this change that weren't in the request?"
- At the office (writing, planning, proposals): before the draft, decide which number, which date and which commitment must never come from the AI, and fill them in yourself.
- Count how often something comes to mind: that's your number of load-bearing walls.
Tool tip: locks instead of notes
A request in the prompt ("don't change anything", "don't invent dates") is not a boundary. Anything that must hold without exception belongs in a mechanism that enforces it:
- Claude Code, permission rules (deny rules):
permissions.denyin the settings, for exampleBash(rm *)orRead(./.env). Rules are evaluated deny first, then ask, then allow; an allow rule can't carve an exception out of a deny rule. Note from the docs: a Bash rule matches the command text and is not a security boundary around the program (for example,/bin/rmorbash -cget around it); use sandboxing for hard boundaries. https://code.claude.com/docs/en/permissions - Claude Code hooks:
PreToolUseruns before the tool calls its matcher covers and can block them (exit code 2 orpermissionDecision: "deny"). Extra protection, not a guarantee. https://code.claude.com/docs/en/hooks - Cursor hooks:
beforeShellExecutionruns before any shell command and can block it withpermission: "deny"or exit code 2. https://cursor.com/docs/agent/hooks - Codex rules:
prefix_rule(..., decision = "forbidden")blocks matching commands without prompting (marked experimental in the docs). https://learn.chatgpt.com/docs/agent-configuration/rules.md - Above all, minimal credentials: the agent gets no credentials for the production database, only for a development database with test data. What it can't reach, it can't delete.
Sources
- Jeff Bezos: 2015 Letter to Shareholders, Amazon (Type 1 and Type 2 decisions, one-way and two-way doors). https://www.sec.gov/Archives/edgar/data/1018724/000119312516530910/d168744dex991.htm
- Menzies, Nichols, Shull, Layman (2017): Are Delayed Issues Harder to Resolve? Revisiting Cost-to-Fix of Defects throughout the Lifecycle. Empirical Software Engineering. 171 projects, 2006 to 2014, data from Team Software Process projects; no consistent evidence for the effect. https://arxiv.org/abs/1609.04886
- The Register (July 22, 2025): Replit makes vibe-y promise to prevent vibe coding disasters. https://www.theregister.com/2025/07/22/replit_saastr_response/
- Additional primary source: Replit's own account dated July 29, 2025 (Doubling down on our commitment to secure vibe coding). https://replit.com/blog/doubling-down-on-our-commitment-to-secure-vibe-coding
- AI Incident Database, Incident 1152: Replit agent deletes a production database during a code freeze. https://incidentdatabase.ai/cite/1152/
- NASA, Mars Climate Orbiter Mishap Investigation Board, Phase I Report (November 10, 1999), press release. https://nssdc.gsfc.nasa.gov/planetary/text/mco_pr_19991110.txt
- Mars Climate Orbiter Mishap Investigation Board, Phase I Report (full text). https://llis.nasa.gov/llis_lib/pdf/1009464main1_0641-mr.pdf
- Hyrum's Law (Hyrum Wright): "With a sufficient number of users of an API, it does not matter what you promise in the contract: all observable behaviors of your system will be depended on by somebody." https://www.hyrumslaw.com/
- Anthropic: Best practices for Claude Code (explore, plan, implement, commit; let Claude interview you; skip the plan if you could describe the diff in one sentence; hooks instead of advisory instructions). https://code.claude.com/docs/en/best-practices
- Codex documentation: Best practices for Codex (plan first for complex or ambiguous tasks, say what "done" means). https://learn.chatgpt.com/guides/best-practices
- GitHub Blog (September 2, 2025): Spec-driven development with AI: Get started with a new open source toolkit (Spec Kit). https://github.blog/ai-and-ml/generative-ai/spec-driven-development-with-ai-get-started-with-a-new-open-source-toolkit/
- Foundation of the series: Healthy AI First Software Development, version 2 (October 1, 2026), chapter 4 "Planning and human decisions", sources 16 to 21.
Further reading
- Laurent Bossavit: The Leprechauns of Software Engineering (an analysis of where the cost-to-fix curve came from). https://leanpub.com/leprechauns
- Codex sandbox and approvals (
read-only,workspace-writewithout network access as the default,danger-full-access). https://learn.chatgpt.com/codex/agent-approvals-security
Healthy AI First is AI-researched and AI-generated, narrated in Björn's voice, recreated with AI, and reviewed by him.
Bringing AI into your team?
Björn is one of the founders of CLN Work. CLN Work helps companies adopt AI in small, verifiable steps: finding where real capacity is, which processes can be automated, and how to use AI interactively. The decisions stay with you.
Book a free 30-minute conversation