AI || Cyber || Quantum — Engineering Trustworthy Operational Systems
CSA Research Brief · Agentic Protocol Science

Who Verifies the Self-Modifier?

Property Preservation in Agentic AI Systems

Author: Deepinder Sidhu Theme: Agentic Protocol Science Status: Submitted to arXiv CSA AI Research Series

Abstract

ArXiv-limited abstract used for rapid publication and indexing.

Agentic AI systems are increasingly capable of generating, modifying, testing, and deploying software artifacts, workflows, protocols, and decision procedures. As these systems become more autonomous, a fundamental assurance question emerges: who verifies that a system modified by an autonomous agent still satisfies the properties, constraints, guarantees, and testing assumptions required for trustworthy operation? This paper introduces the property preservation problem for self-modifying and agent-modified systems. We distinguish between generating software and preserving required properties after modification. The paper argues that autonomous modification must be evaluated not only by functional success, but also by continued satisfaction of safety, liveness, recurrence, convergence, authorization, security, timing, resource, and trust properties. We describe why regression tests alone are insufficient and discuss the need for explicit preservation evidence, revalidation, and assurance mechanisms. The central question is simple but foundational: who verifies the self-modifier?

Who verifies the self-modifier?

Why This Matters

This research addresses a foundational engineering challenge in trustworthy operational AI systems.

AI Is Becoming a Software Modifier

Agentic systems increasingly generate code, tests, workflows, protocols, and decision procedures.

Functional Success Is Not Enough

A modified system may work on a task while violating safety, security, timing, authorization, or assurance assumptions.

Property Preservation Is Foundational

Trustworthy autonomous systems require evidence that required properties remain valid after modification.

Key Contributions

The paper contributes concepts and methods that support CSA's broader research program.

  • Introduces the property preservation problem for self-modifying and agent-modified systems.
  • Distinguishes functional generation from preservation of required properties.
  • Connects autonomous modification to safety, liveness, recurrence, convergence, authorization, security, timing, resource, and trust properties.
  • Explains why regression testing alone is insufficient for assurance.
  • Defines the need for explicit preservation evidence and revalidation after autonomous modification.

Research Impact

This work helps establish CSA's research foundation in Operational AI Engineering, Agentic AI Assurance, and Internet-Equivalent Validation.

For AI Software Engineering

Identifies the assurance challenge created when AI systems modify software or workflows.

For Formal Methods and Verification

Connects agentic AI to preservation of required properties and post-modification guarantees.

For Operational AI Assurance

Extends assurance from deployment-time validation to continuous property preservation.

For CSA Research

Links Agentic Protocol Science with Agentic AI Assurance and Operational AI Engineering.

Applications

The concepts apply across operational AI, mission systems, cybersecurity, enterprise governance, and autonomous systems engineering.

AI Code Generation

Verifying that generated or modified code preserves required properties.

Autonomous Workflow Evolution

Ensuring modified workflows still satisfy approval, security, and mission constraints.

Adaptive Agentic Systems

Maintaining assurance when systems change their own behavior, tests, or decision procedures.

Self-Modifying AIProperty PreservationAgentic Protocol ScienceAI VerificationAI AssuranceSafetyLivenessAutonomous Software Engineering

Citation

Use the arXiv identifier once assigned. The citation below can be updated after announcement.

@misc{sidhu2026selfmodifier, author = {Deepinder Sidhu}, title = {Who Verifies the Self-Modifier?: Property Preservation in Agentic AI Systems}, year = {2026}, note = {Submitted to arXiv}, primaryClass = {cs.AI} }

Explore CyberSpace Analytics

CyberSpace Analytics develops advanced technologies in Operational AI Engineering, Agentic AI Assurance, Internet-Equivalent Validation, Cybersecurity, and Quantum Information Science. Our research bridges foundational science and operational systems to address the engineering challenges of next-generation AI, cyber, and quantum platforms.