AI Is Becoming a Software Modifier
Agentic systems increasingly generate code, tests, workflows, protocols, and decision procedures.
CSA Research Brief · Agentic Protocol Science
ArXiv-limited abstract used for rapid publication and indexing.
Agentic AI systems are increasingly capable of generating, modifying, testing, and deploying software artifacts, workflows, protocols, and decision procedures. As these systems become more autonomous, a fundamental assurance question emerges: who verifies that a system modified by an autonomous agent still satisfies the properties, constraints, guarantees, and testing assumptions required for trustworthy operation? This paper introduces the property preservation problem for self-modifying and agent-modified systems. We distinguish between generating software and preserving required properties after modification. The paper argues that autonomous modification must be evaluated not only by functional success, but also by continued satisfaction of safety, liveness, recurrence, convergence, authorization, security, timing, resource, and trust properties. We describe why regression tests alone are insufficient and discuss the need for explicit preservation evidence, revalidation, and assurance mechanisms. The central question is simple but foundational: who verifies the self-modifier?
This research addresses a foundational engineering challenge in trustworthy operational AI systems.
Agentic systems increasingly generate code, tests, workflows, protocols, and decision procedures.
A modified system may work on a task while violating safety, security, timing, authorization, or assurance assumptions.
Trustworthy autonomous systems require evidence that required properties remain valid after modification.
The paper contributes concepts and methods that support CSA's broader research program.
This work helps establish CSA's research foundation in Operational AI Engineering, Agentic AI Assurance, and Internet-Equivalent Validation.
Identifies the assurance challenge created when AI systems modify software or workflows.
Connects agentic AI to preservation of required properties and post-modification guarantees.
Extends assurance from deployment-time validation to continuous property preservation.
Links Agentic Protocol Science with Agentic AI Assurance and Operational AI Engineering.
The concepts apply across operational AI, mission systems, cybersecurity, enterprise governance, and autonomous systems engineering.
Verifying that generated or modified code preserves required properties.
Ensuring modified workflows still satisfy approval, security, and mission constraints.
Maintaining assurance when systems change their own behavior, tests, or decision procedures.
This paper is part of the CSA AI Research Series on trustworthy operational AI systems.
Use the arXiv identifier once assigned. The citation below can be updated after announcement.
CyberSpace Analytics develops advanced technologies in Operational AI Engineering, Agentic AI Assurance, Internet-Equivalent Validation, Cybersecurity, and Quantum Information Science. Our research bridges foundational science and operational systems to address the engineering challenges of next-generation AI, cyber, and quantum platforms.