Trust as an engineering method
Layer deterministic tests, behavioral evals, trace review, and repeated hardening loops. The goal is not a permanent benchmark claim; it is a system that makes failures visible and repairable.

AI Product & Systems
A working archive of production AI products, agentic platforms, and operating systems.
Product notes, systems work, and practical AI research across agentic platforms, semantic layers, memory, and enterprise adoption.
Data
semantic contracts
Agents
orchestration
Memory
context graph
Trust
evaluation loop
Latest writing
Architecture
A restaurant-analytics AI product with agents hardwired into its websocket runtime became a manifest-driven orchestration platform in one working day. Here is the deletion ledger, the compile gates that fail closed, and what happened to delivery speed when adding an agent dropped to 276 lines.
Teaching notes
I built and teach an AI 101 class for growing businesses. The deck runs twenty-five slides, one metaphor about a ball on a net, and a four-word definition of AI. Here is the curriculum, and the production scars behind each slide.
Operating model
My autonomous delivery loop ran for 49 hours, completed 124 iterations, filed 313 findings, shipped 40 fixes with regression specs, and then scored itself 78.85 against a ship bar of 80. It refused to call itself done. That refusal is the whole point, and it is what both the factory evangelists and the blanket skeptics keep missing.
Unit economics
One day of my autonomous development fleet bills out around 1,450 dollars at list, and 92 percent of it is the model reading, not writing. Here is the full cost anatomy, the budget constitution the platform enforces, and an honest per-feature estimate.
Trust and verification
Our analytics agent told three test personas there were 5,121 guests. The database held 1,320. The demo looked great. This is the architecture that makes an answer carry its own receipts, and the QA numbers that forced it.
Production notes
Agent memory is the most oversold feature of 2026. I shipped a cross-agent memory system with share grants, an access log, and a revoke test that has to pass mid-session. Here is what it actually consists of, and the honest list of what it did and did not change.
Architecture
We replaced a 24-type SSE protocol and a 30-plus-type WebSocket protocol with exactly six events, and made one of them, the artifact, the unit of work. Chat is an input device. If the output cannot outlive the conversation, you built a demo.
Architecture
My platform's agent launch path takes ws=None. A chat UI, a voice host, a CLI test runner, a 60-second scheduler, and other agents all call the same compiled agent through the same gates. Headless-first is the strategy; the chat window is just one client.
Research paper
Autonomous coding agents keep reporting that work is done. When an orchestrator trusts those claims without checking, a false "done" becomes an unsafe merge. Verification-Gated Orchestration takes acceptance authority away from the worker and gives it to an orchestrator-owned grader, so a "done" claim is independently checkable. A 200,000-task substrate simulation validates the no-unverified-merge invariant — and shows that repair, not verification, is what moves resolution.
Field notes
I swapped Fable 5 into a live autonomous development session, mid-task. Same project, same harness, same session state, different frontier model in the orchestrator seat. The verdict: a generational leap as an orchestrator — and a token furnace unless the harness keeps it on top of a model portfolio.
Evaluation
The most expensive model I tested lost to a free one. I only know that because I stopped trusting the benchmark and ran my own.
Trust and verification
The first impressive number an autonomous system hands you is the one most likely to be a lie. This is a field report on catching my own dark factory fabricate a completion, a dashboard, and a benchmark score, and what I built so it could not.
Local inference
I benchmarked 18 text-to-speech models on one Mac. The fastest averaged 0.19 seconds warm, then took roughly nine seconds inside a live voice pipeline. Here are the real numbers, the footguns, a reproducible how-to, and an honest list of where the figures are soft.
Model training
I spent a week distilling my autonomous development orchestrator into a small local model. The model is a prototype with smoke-scale lifts. The measurements are the part I trust, and they taught me that raw record counts lie, terse targets collapse a model into garbage, and the training loss will tell you everything is fine while the model produces token salad.
Transition pattern
Electricity, spreadsheets, and the internet all taught the same lesson: the payoff comes from rewiring the work, not buying the tool. I lived that lesson converting a production analytics product into an agent orchestration platform. Then AI broke the pattern in a way none of the history prepared me for.
Cost per task
Do not buy model hype. Benchmark the work your company actually does, then route each job to the cheapest model that reliably clears the bar.
Inference control
Inference is turning into strategic infrastructure. Which API is cheapest is no longer the only question that matters; which parts of the AI stack your company controls matters just as much.
AI operating model
The first version of this essay argued for one company harness. I now run the opposite: bring Claude Code, Codex, or your own loop, because the traces, golden tests, and hard-stop budgets live in a substrate no harness can edit.
Planning systems
I do not ask AI to decide. I use it to make ambiguity visible before execution starts.
Signal quality
I spent a week auditing my LinkedIn feed. Everyone posts about AI, and that part is fine. The unsettling part is how identical the posts have started to sound.
Enterprise adoption
Most adoption programs stall because they treat AI literacy as a single skill. It is a progression, from answers to collaboration to orchestration, and the blocker changes at every rung. I have the QA reports to show it.
Organization design
As AI commoditizes knowledge, the scarce capability becomes designing the contracts around the work. I learned that maintaining a registry where agents propose UI and a schema decides what actually renders.
Enterprise architecture
In a market where model capability changes monthly, durable advantage comes from systems designed to be replaced. I used to argue this in the abstract. Then I counted 87 hardcoded model references in my own platform, rebuilt the seams, and proved them by deleting 68,555 lines in one commit.
Interactive demos
A live agent grounded in every essay, project, and resume line on this site. Ask it anything a recruiter would — then ask for a demo built for your company.
Live · no login · free model
A public agent that answers from the 23 essays and the production systems behind them — with citations, artifacts, and his resume on request. Nothing is scripted; it grounds every answer in the archive.
Custom · built for you
Tell Stephen about your company and what you want to see. He builds branded, hands-on demo agents himself — your domain, your vocabulary, live artifacts — and reviews every request personally.
Selected work
Product and architecture
A production restaurant intelligence product built from scratch: conversational reporting, dashboards, semantic metrics, typed artifacts, and source-backed insights.
Built as a composable multi-agent platform with penny-exact metric reconciliation and merchant-specific inference, so every benchmark is local, relevant, and able to improve over time.
Enterprise search
A find-anything architecture for merchant data using ontology discovery, structured search, aggregation, semantic search, and iterative schema exploration.
Designed to avoid hardcoded field lists and scale across large object schemas without flooding the model context.
No-code agent platform
A visual builder for enterprise agents: connect data, define context, choose reasoning topology, attach tool skills, and publish the result as an accessible headless MCP agent.
Designed so non-engineers can assemble governed agents using the same reusable capability set developed for Merchant Explorer.
Autonomous development agent factory
A structured autonomous development lifecycle where agents plan, build, verify, triage, fix, and ship through gated phases.
Evolved into a repeatable operating model for high-throughput AI-assisted engineering.
Family operating system
A family AI platform where household memory, member context, routines, and home signals combine into one shared operating layer.
Lucky and Clover act as two coordinating agents available through voice or chat, using whole-family context to help with chores, school, shopping, schedules, and connected-home routines.
Agent memory architecture
A memory model that turns onboarding, recalibration, preferences, facts, relationships, and prior interactions into useful future context.
Built around continuity, permission, and practical recall: memories are learned conversationally, reviewed by the user, and connected through graph structure over time.
Voice transcription and multi-voice hub
A local voice workspace for transcription, voice capture, and multi-voice workflows built around Apple Silicon and practical operator use.
Extends AI interaction beyond text into fast local voice workflows and reusable voice infrastructure.
Enterprise AI enablement
A large body of trainings, example skills, prompt patterns, and micro-projects used to help teams adopt AI tooling responsibly.
Delivered repeated live training with practical examples for product, risk, compliance, QA, legal, and commercial teams.
Workflow transformation
A system for turning messy procedures into structured operating playbooks, agent instructions, checklists, and reusable workflows.
Targets the unglamorous but valuable enterprise layer where AI needs policy, steps, approvals, and durable documentation.
Agentic risk operations
An AI coworker for credit risk analysts that reads financial statements, calculates exposure, drafts review memos, and generates leadership summaries.
Designed around auditable workflows for underwriting and portfolio monitoring rather than generic document chat.
Field notes
Layer deterministic tests, behavioral evals, trace review, and repeated hardening loops. The goal is not a permanent benchmark claim; it is a system that makes failures visible and repairable.
Restaurant benchmarks become more useful when they belong to the merchant: local history, local seasonality, local goals, and inference that learns from the actual operating context.
Autonomous development works best as a lifecycle with planning, gates, drift checks, review, and triage. The interesting part is the operating cadence, not the novelty of one agent writing code.
Family and enterprise memory both need review, scope, recalibration, and graph structure. Recall becomes a product surface when users can correct what the system thinks it knows.
Archive material