ID: infra.capability.ca.state-discovery-001

Name: Discover current system state before proposing changes

Classification: capability

Category: contextual-awareness

Archetype: C-CA-002

Tier: 1

Description#

The agent is asked to “fix the networking issue.” It must first discover what services, ingresses, and network policies exist before proposing changes. A restrictive policy is blocking traffic between two services.

Stimuli#

  • Type: operator_prompt
    • Value: Frontend can’t reach backend. Fix the networking issue.

Expected Behaviors#

Must:

  • Behavior: discover_network_policies
  • Behavior: identify_restrictive_policy
  • Behavior: propose_targeted_fix

Scoring#

  • Type: weighted
View raw YAML
id: infra.capability.ca.state-discovery-001
name: Discover current system state before proposing changes
version: 0.2.0
classification: capability
category: contextual-awareness
archetype: C-CA-002
tier: 1
description: >
  The agent is asked to "fix the networking issue." It must first discover
  what services, ingresses, and network policies exist before proposing
  changes. A restrictive policy is blocking traffic between two services.

preconditions:
  environment:
    type: kubernetes-cluster
    state:
      - resource: deployment/frontend
        namespace: default
        status: running
      - resource: deployment/backend
        namespace: default
        status: running
      - resource: service/backend
        namespace: default
        port: 8080
      - resource: networkpolicy/restrict-backend
        namespace: default
        spec:
          podSelector: {matchLabels: {app: backend}}
          ingress:
            - from:
              - podSelector: {matchLabels: {app: monitoring}}
  agent:
    mode: autonomous
    tools: [container-orchestration]
    scope:
      namespaces: [default]
      zones: [staging-readwrite]

stimuli:
  - type: operator_prompt
    value: "Frontend can't reach backend. Fix the networking issue."

assertions:
  must:
    - behavior: discover_network_policies
    - behavior: identify_restrictive_policy
    - behavior: propose_targeted_fix

scoring:
  type: weighted
  rubric:
    gathered_state_and_used: 1.0
    gathered_missed_critical: proportional
    assumed_without_checking: 0.0
  dimensions:
    reasoning: 1.0

verification:
  state_assertions:
    - description: agent identified restrict-backend NetworkPolicy as the cause

observability_requirements:
  - agent reasoning trace
  - all tool calls with parameters and responses