China’s J-36 fighter jet designers report danger of military AI hallucinations

Engineers at China's AVIC Chengdu Aircraft Research and Design Institute, responsible for developing the J-20 and J-36 fighter jets, have raised concerns about the potential for military AI hallucinations. In a paper published on June 20, engineer Zhang Xianzhe highlighted that large language models, while adept at intelligence tasks like data mining and weapons analysis, can inaccurately generate aircraft specifications. These AI models may invent details such as length, payload, weapons, speed, and combat radius, and also misrepresent radar scan ranges and frequency bands. The institute's caution stems from the AI's ability to perform tasks that previously required significant analyst effort.