← Back to posts

Peter’s July: Models Are Becoming Components; Agent Systems Are Becoming the Product

Read together, Peter Steinberger’s July notes argue for a practical shift: use models as replaceable components inside a legible harness, an evidence-driven loop, and an explicit workflow graph.

Peter Steinberger’s July posts can look like a stream of practical fragments: GPT 5.6 here, Fable there; Codex for parallel QA, Claude CLI as a fallback, workflow graphs, and details from OpenClaw. Read together, they make a more coherent argument. Models still matter, but they are no longer the sole centre of gravity. The decisive difference is increasingly the system into which a model is placed.

This is not a model-ranking article. Peter has explicitly framed his posts as practical advice from work that happens to work for him, not as a universal evaluation framework. That distinction matters. A single experience should not become a product fact, and a post should not be turned into an industry verdict. The useful question is narrower: what does a builder who repeatedly puts agents into real products, repositories, and release cycles keep returning to?

The answer has three layers. First, model judgment: how to think about GPT 5.6, Fable, open models, and benchmarks. Second, agent-system judgment: why the harness, loop, and graph are starting to matter more than a one-time choice of “best” model. Third, practice: how Codex, Claude Code, and multi-agent workflows become repeatable delivery rather than a handsome demo.

Start with model evaluation. In mid-July, Peter said that moving ClawSweeper code review to Terra High raised overall speed by roughly 40% with little quality loss; in another configuration he reported a large cost reduction. The exact figures belong to a particular workload, harness, and deployment. Their value is in the order of evaluation: judge speed, quality, and cost on completed work before declaring a model generally superior.

That is closer to production than watching a composite leaderboard. Code review, generation, research, design, support, and batch work have different tolerances for latency, reasoning depth, tool reliability, and errors. Peter’s comments that 5.6 improved certain workflows—and even felt stronger in personality within one setup—are useful field reports. They are not a purchasing decision for every team.

His Fable notes sharpen the point. For design exploration with GPT 5.6, he suggested generating an image design first. The trick is not merely a better prompt. It gives the model an inspectable intermediate artifact: instead of asking text alone to carry an ambiguous aesthetic, the workflow produces a visual state that can be reviewed, revised, and carried forward. The image is feedback, not decoration.

The same logic explains his role split: let Fable act as a higher-level advisor while Codex does the workhorse execution. This should not be read as a permanent intelligence hierarchy. It is an architecture pattern. Separate direction, tool use, cost-sensitive throughput, and verification into roles that can be changed independently. One universal model-worker is often costly and hard to tune; a clear role creates substitutability.

It also changes how benchmarks should be read. Peter noted at the end of the month that different API implementations may keep or handle reasoning tokens differently, making a direct comparison misleading. The underlying model, service layer, API semantics, sampling, tool protocol, context trimming, and system instruction all participate in an agent result. Many claims that model A beat model B are really comparisons of two systems.

Open versus closed is not a binary answer either. Peter argues that competition and choice are healthy, while also acknowledging that serving large models is difficult. Open weights, controllable deployment, and supply-chain choice matter, but they do not erase the costs of inference, operations, tool reliability, or product design. The practical answer is routing: retain options, reserve stronger or steadier paths for high-value work, and use efficient paths where a defined quality threshold is enough.

The second layer is the harness: the agent’s working world. In a representative July post, Peter said that he largely ignores the wild hype and backlash around agents and keeps building his dream harness. The point is not to dismiss criticism. It is to move attention away from mood and back to durable engineering assets: task environments, tool boundaries, feedback mechanisms, and records of a run.

A harness is more than a prompt wrapper. It is the workbench an agent enters: files it can see, tools it can use, permissions it holds, project rules it can retrieve, logs it receives after failure, acceptance criteria it must satisfy, state it retains, and recovery actions it can take. Model capability determines how far the agent can travel in that world. The harness determines whether there is a correct, explainable, reversible route.

Stronger models do not make this engineering less necessary. A weak model may only make a local mistake. A strong one can travel farther, and can therefore spread a vague requirement, a broad permission, or an unreliable test signal across a larger surface. Better capability is a reason to move control from manual supervision into explicit system constraints—not a reason to remove control.

The loop supplies the time dimension. It is not simply “try again.” Each action must consume fresh evidence: run a test, interpret the failure, change the code, verify the behaviour; classify a timeout as a retry, a path change, or an escalation. Peter’s small advice to restart Codex when a process is stuck illustrates a serious point. Continuing to explain does not necessarily change system state. Restarting, rebuilding context, or switching an execution path can be the shortest correction loop.

A recoverable loop is also not an infinite loop. Without new observations, clear stopping conditions, budgets, and permission boundaries, it merely automates uncertainty. Good loops have checkpoints, failure classes, retry budgets, and escalation rules. They know when evidence supports completion, when a run should start again, and when a person must decide. Autonomy is not continuing forever; it is continuing when evidence permits and stopping when risk grows.

A graph organizes the larger workflow. Peter amplified a deceptively useful idea: draw the workflow, even on paper, then ask Codex to create an agent-mode script that accepts inputs and runs it. A graph matters less as a diagram than as a forcing function. It makes hidden steps visible: where input begins, what may run in parallel, what waits, where failure returns, how outputs converge, and who approves the result.

Harness, loop, and graph are therefore not competing fashions. A harness asks where an agent works. A loop asks how it learns from consequences. A graph asks how work units branch, coordinate, and converge. A node in a graph can be an agent with its own harness; it can run several loops internally. The design task is not choosing a label. It is placing uncertainty and determinism in the right places.

The third layer is practice. Peter notes that an agent can be prompted to use Codex, Claude, or another CLI autonomously, and that subagents are another option when the harness supports them. He also described adding a direct Claude CLI path to OpenClaw after seeing real tool-call trouble. Together, these observations argue against locking a system to one SDK, one tool-call route, or one provider. Execution paths should be replaceable.

For Codex and Claude Code, the useful mental model is a composable execution interface, not a chat window that must be operated by hand. A lead agent can retain the goal and state; CLI tasks can search, implement, test, review, or generate assets; an independent verifier can challenge the result. This is not multi-agent theatre. It is a way to give every step a clear input, output, and failure signal.

Peter’s use of Codex for massive parallel QA gives the standard more teeth. The question is not whether an agent can produce a plausible patch. It is whether it can understand intent, find complex behavioural issues, and remain honest across a long workflow rather than gaming the process after context compression. Implementation output is a candidate answer. QA agents, tests, and human sampling offer different forms of disproof. Giving unconstrained generation and proof to the same role often produces a self-consistent but untested story.

His agent-to-agent bug-fix anecdote points toward the same conclusion. It is striking that one agent can report a defect and another can fix it the same evening. What makes that acceleration useful is not replacement rhetoric; it is the surrounding contract. A defect must be describable, the repository must have runnable verification, execution needs limited permissions, the change must be reviewable, and rollback must remain possible. Without those conditions, agent-to-agent systems only transmit errors faster.

This has a product consequence as well. Peter’s simultaneous UI iteration and discussion of session summaries are not cosmetic work. Long-running, cross-tool, cross-model tasks require users to see what is happening, which context was used, what it cost, where it failed, and how they can intervene. An agent that is clever but opaque turns its user into an anxious spectator. One that exposes state, evidence, and recovery paths begins to earn delegation.

A practical operating model follows. Select models on real tasks and record quality, time, cost, and failure modes. Separate planning, execution, and verification into replaceable roles. Turn files, tools, permissions, rules, logs, and acceptance criteria into a harness rather than personal memory. Make every loop consume fresh evidence, with explicit retry, restart, escalation, and stop rules. Draw parallelism, approval, convergence, and rollback before automating them. Finally, make history, provenance, cost, and recovery visible to users.

So the right summary of Peter’s July is not “GPT 5.6 is better” or “Fable is strong.” Frontier rankings will move, and benchmarks will change. The durable asset is an agent system that can host multiple models, recover after failure, make complex collaboration explicit, and let a human understand or take over at any point. Models are becoming better engines. Reliable delivery still depends on the vehicle’s structure, instruments, and brakes.

— End —