33 for classified networks due to this robust underlying architecture. Nonetheless, the DOD and intelligence community will need to carefully delineate when preference constraints can be a useful tool, and when they are insufficient to protect sensitive information. Vulnerability to Prompt Injection, Data Management, and Cyber Security Generative AI tools are still nascent and present significant risks, including the ability to produce hard-to-detect but erroneous outputs—not only through hallucination, but also through more nuanced technical faults like prompt injection. In such cases, data reviewed by an LLM in response to a user prompt may contain hidden directives, causing the model to confuse data with instruction. The result is a nonsensical or factually wrong output for which the LLM cannot identify the source of the problem and cite potential output issues to end-users. This leaves Generative AI tools particularly vulnerable to either conflate simple directives in documentation, such as Standard Operating Procedures, or worse, fall victim to cyberattacks that covertly inject mis-instruction into critical national security data streams to drive LLMs and LRMs toward negative outcomes.38,39 Existing Tools Support Responsible AI Development, Human-in-the-Loop Remains Critical Responsible and ethical AI development within the DOD is critical because of the systemic risks that the technology poses to the military’s operations, particularly in cases involving at-scale rollouts of a given tool to thousands of DOD staff. DIU developed a framework to address these risks, called the Responsible AI (RAI) Guidelines, which CDAO expanded into a comprehensive RAI toolkit. RAI seeks to integrate responsible and ethical AI development throughout the evaluation and implementation process for Gen-AI integration, which we display in Figure 10 below: Figure 10: Overview of RAI Activities Throughout the Product Lifecycle Image Source: Chief Digital Artificial Intelligence Office, Responsible AI Division. RAI Toolkit: https://rai.tradewindai.com/ Generative AI Adoption in the US Military