A person observing a luminous relational field, visualising observer position in AI alignment

AI alignment often begins with a proxy: a loss, reward signal, evaluation score, policy or human-feedback channel that stands in for a broader intention. Improving that proxy can matter. It does not by itself establish that the surrounding system makes the intended outcome reachable, that the necessary relations exist, or that the consequential selections occur where designers think they do.

This note offers a structural reading of that gap. It is a conceptual analysis, not an empirical result or a complete theory of alignment.

Which conditions, relations and selection processes turn a proxy into consequential behaviour — and where can the intended meaning be lost?

The current I·V·O Lens separates those questions without assuming that a proxy, movement or observer is itself one of the three operators.

The problem in three layers

Many alignment analyses focus on the optimization target: reward hacking, specification gaming, goal misgeneralisation or an internal objective that diverges from the intended one. The target matters, but it operates inside a larger structure.

The I·V·O Lens asks three different structural questions within a defined scope.

On this reading, reward hacking is not simply movement in a bad direction. It can involve an O that leaves an exploit reachable, a V that couples behaviour to the scored proxy, and an I that repeatedly selects the high-scoring continuation while relevant human consequences remain outside its access.

Two readings, different jobs

O → V → I is the generative reading. It asks which structured possibilities permit relations to become instantiated and how situated selection then makes one continuation consequential.

I → V → O is the analytical reading. Starting from a consequential output, intervention or failure, it traces the selective process, the relations on which that process depended and the conditions that made those relations possible.

The arrows state a reading order, not a universal chronology or a causal result. Any causal claim still requires domain evidence and an identifiable test.

What the reading can test

A useful structural reading should distinguish failure modes that call for different interventions. A missing relation should not be treated as a poor selection rule. An exploit left reachable by O should not be described only as evaluator error. A human preference that never enters an instantiated feedback relation cannot be repaired merely by renaming the objective.

The reading becomes weaker when O, V and I cannot be assigned without importing the desired conclusion, when another decomposition explains the same evidence equally well, or when the proposed operators do not lead to different observations or interventions. Those are limits to investigate, not gaps to hide.

O → Structured Possibility V → Instantiated Relation I → Situated Selectivity

Generative reading: O → V → I.
Analytical reading: I → V → O.
Functions within a stated scope, not kinds of things.

O — Structured Possibility
Reachability is designed

Data, architecture, permissions, interfaces and deployment conditions make some behaviours reachable and others unavailable.

V — Instantiated Relation
A specified relation may not exist

The design must establish and inspect the actual couplings among model, data, tools, evaluators, users and institutions.

I — Situated Selectivity
Criteria make outcomes consequential

Loss, reward, decoding, evaluation and approval select from available continuations with limited access and situated criteria.

Access
Human intention is not a field value

A proxy carries selected information. It does not thereby contain every reason, consequence or position relevant to human judgment.

Consequence
Correction spans all three operators

A better proxy may help, but conditions, instantiated feedback relations and selection authority may also need to change.

What this reading must account for
01 Reward hacking

A reachable exploit, proxy coupling and score-based selection produce a high reward without the intended consequence.

02 Specification gaming

Formal requirements leave an unintended continuation available and consequential.

03 Mesa-optimization

An internal objective may instantiate relations that differ from those assumed by the training objective.

04 Out-of-distribution drift

Deployment conditions alter what is reachable and which learned relations remain informative.

05 Human feedback limits

Feedback exposes a selective slice of judgment, with position, access and criteria that need to remain explicit.

06 Governance burden

Institutions determine access, approval, appeal, monitoring and the authority to revise selection criteria.

Implications for alignment research

The central question is not only how to specify a better target. It is how conditions, actual relations and situated selection processes combine to make behaviour consequential.

That makes alignment an ongoing design and governance problem: inspect what remains possible, verify which relations actually exist and keep selection criteria open to evidence, correction and appeal.

Conceptual research note. No empirical validation or universal causal claim.

Architectural humility State the scope, affected positions and unavailable information before assigning the operators.
Reachability review Ask which behaviours and relations the actual conditions enable, exclude or leave exploitable.
Relational verification Check whether feedback, oversight and accountability relations exist in practice rather than only on paper.
Selective accountability Make criteria, access, authority, exclusions and revocation conditions inspectable at consequential selection points.
Falsifiable revision Record what would weaken the structural reading and which observation would justify a different intervention.

An invitation to think with this

This is not a pitch and not a consultancy offer.

If this structural reading of the alignment problem touches research you are working on, I would be glad to think along for 20 minutes.

[email protected]
Research note. Canonical O/V/I operator language, unchanged in v4.1.   O → Structured Possibility. V → Instantiated Relation. I → Situated Selectivity.