The post U.S. Department of Defense, DoD, completes pilot program using chatbots for military medicine appeared on BitcoinEthereumNews.com.

One of the last projects tied to DoD and under Biden’s administration has come to a successful close. The Chief Digital and Artificial Intelligence Office (CDAO) of the US Department of Defense(DoD) has completed the Crowdsourced AI Red-Teaming (CAIRT) Assurance program pilot. This initiative is dedicated to integrating AI chatbots into military medical services.  The large language model (LLM) chatbots were implemented in the CAIRT program. Additionally, CAIRT assisted the DoD in the development of decentralized, crowdsourced strategies for AI Risk Mitigation and AI Assurance. Over 200 clinical providers and healthcare analysts contributed to the identification of potential vulnerabilities in the use of AI chatbots in military medical applications. Notably, the pilot identified several hundred potential issues, as reported by the DoD. To that end, the DoD said, “This exercise will result in repeatable and scalable output via the development of benchmark data sets, which can be used to evaluate future vendors and tools for alignment with performance expectations.”  CAIRT program behind the scenes According to DoD, a non-profit humane intelligence conducted the CAIRT LLM pilot. It achieved this in partnership with the Defense Health Agency (DHA) and the Program Executive Office of Defense Healthcare Management Systems (PEO DHMS). In addition, the humane intelligence used the red-teaming methodology to identify specific system issues. This involved the internal testing of system resiliency using adversarial techniques.  Furthermore, red-teaming drew participants who are interested in interacting with emerging technologies and as potential future beneficiaries. They were allowed the opportunity to contribute to the enhancement of the systems. In this program, humane intelligence used crowdsourced red-teaming to address two potential applications in military medicine: clinical note summarization and a medical advisory chatbot. Although vulnerabilities were identified, DoD highlighted, “these findings will play a crucial role in shaping DoD policies and best practices for responsible…

---

Filed under: News - @ January 3, 2025 9:19 am