Skip to content

Systems

Systems is the canonical concrete reference for Harnesses and adjacent components relevant to Harness Operations.

Each entry describes a concrete subject in its native terms before applying shared abstractions, so readers can see how agent work is actually structured, operated, constrained, and combined across different workloads.

The reference set deliberately mixes different subject kinds so the reference does not collapse models, Harnesses, applications, role definitions, and domain specifications into one product category.

Coverage is selective rather than a claim of complete market coverage. Subjects are included because they clarify materially different operational shapes, not because of popularity or endorsement.

AreaSubjectKindWhy it is here
CodingCodex App ServerHarness interfaceReviewed coding Harness surface with a machine-control interface.
CodingClaude Code CLIHarness interfaceReviewed coding Harness surface with interactive and delegated work.
OrchestrationClaude Projects (beta)Application + control layerA coordinator scopes and routes work across parallel Claude Code threads that can run in the cloud or on a user’s machine via Remote Control.
SecurityAntares modelsModelSpecialization lives in model weights and a constrained terminal-action format.
SecurityAntares CLIHarnessPackages the Antares agent loop around a read-only repository snapshot and configurable inference endpoint.
SecurityCisco Foundry Security SpecDomain specificationA deliberately prescriptive architecture seed for a bounded security-evaluation workload, not executable code.
TestingPlaywright Test AgentsAgent definitionsPlanner/generator/healer specializations generated into existing agent environments such as Claude Code and Codex.
Creative videoFireRed-OpenStorylineAgentic applicationConversational video workflow with its own application plus documented Agent Skills integration paths.
Browser automationBrowser UseHarnesses and capability adapterOne project family exposes a hosted agent, embeddable local agent, and a separate browser capability for existing agents.
Desktop automationComputer UseTool interfaces and capability runtimeOpenAI/Anthropic expose client-executed computer-control interfaces, while macOS Harness supplies OS primitives to an outer coding Harness.
Realtime voiceRealtime VoiceHosted session runtime + open frameworkContinuous streaming, interruption, turn-taking, transport, and live tool execution become first-class.
Long-running executionBackground ExecutionHosted execution runtimeWork outlives the initiating connection and must be polled, resumed, cancelled, and retained deliberately.
Agent evaluationInspect AIEvaluation framework/runtimeThe evaluator operates the agent as a system under test, with its own sandbox, limits, recovery, scoring, and evidence.

See Operating arrangements for the cross-system view.

The machine-readable systems index is index.json. It records subject kind, workloads and operational characteristics, reviewed scope, and source-backed relationships without turning those relationships into interoperability claims.

A new reader should be able to use Systems without learning the Reference Model first:

  1. Identify an area in the reference table, such as security, testing, creative work, or browser automation.
  2. Open one reference entry and find where its actual agent loop, state, tools, execution, and completion boundary live.
  3. Follow an operating arrangement or relationship to see how work can be embedded, delegated, or handed off without assuming shared lifecycles.
  4. Check the evidence and unknowns before treating a documented relationship as tested compatibility or a model benchmark as an operational guarantee.

For deeper implementation concepts, readers can then move to the Reference Model, requirements work, or benchmark work as appropriate.

Include a subject when it demonstrates or materially clarifies at least one of:

  • a distinct agent execution loop;
  • a specialization mechanism;
  • an operational or trust boundary;
  • a meaningful state or lifecycle model;
  • an independent or cooperative operating arrangement;
  • a consequential tool/effect boundary;
  • an evidence or verification model;
  • a failure, recovery, cancellation, or intervention behavior.

Do not include a subject merely because it uses an LLM.

A reference entry may carry one or more subject kinds when a single label would erase a material role. The systems index still expects an intentionally small set of kinds rather than a feature taxonomy.

An operating_arrangements association means the subject materially participates in or explicitly describes that arrangement. For a model, agent definition, or architecture specification, it does not imply that the subject itself is an executable runtime.

The entry should explain why that subject belongs and avoid promoting implementation-specific objects into universal Harness Operations concepts.

A reference entry should first answer:

  • What does the system call its own units of work, sessions, roles, tools, artifacts, or findings?
  • Where does the agent loop run?
  • What state persists and where?
  • What can the system affect?
  • Which component actually enforces relevant constraints?
  • What does completion mean for this workload?
  • What happens on interruption, partial completion, or ambiguous effects?
  • How can the system operate independently or relate to other systems?
  • Which claims are documented, source-inspected, tested, inferred, or unknown?

Mapping to Harness Operations concepts is optional and secondary.

Entries, comparisons, assessments, and benchmarks

Section titled “Entries, comparisons, assessments, and benchmarks”
  • A System reference entry explains a concrete design and its operational boundaries.
  • A structured comparison observation records whether a scoped interface provides a defined capability and with what evidence.
  • A requirements assessment evaluates a separately defined profile or requirement set.
  • A benchmark result reports observed behavior over executable scenarios and repeated trials.

A reference entry can exist without an assessment or benchmark result.

Reference entries are documentation- and source-backed unless an entry explicitly says otherwise. Reviewing a repository, paper, model card, or product documentation is not a live product or interoperability test.

The systems index records structural relationships only when both endpoints are established at the scope represented by their Systems subjects. Broader product-family relationships may still be documented in prose, but they are not promoted into machine edges until the endpoint scope is sufficiently specific. Demonstrated interoperability belongs in the separate comparison integration dataset with source/target interface, operation, configuration, and test evidence.

index.json and schema.json are publication/build data for this canonical reference. They are not a Harness Operations wire protocol, required implementation schema, conformance format, or product API.

Use TEMPLATE.md for new reference entries.