OpenAI bans accounts linked to Chinese AI surveillance tool

OpenAI has banned several accounts linked to a Chinese surveillance operation that used its technology to develop an AI tool for monitoring anti-China sentiment in Western countries, including the U.S. and the U.K. This initiative, referred to as Peer Review, involved utilizing ChatGPT to create sales pitches and debug code for the so-called 'Qianyue Overseas Public Opinion AI Assistant,' which aimed to report on social media discussions about human rights and protests. OpenAI's principal investigator, Ben Nimmo, noted that this was the first instance of uncovering an AI-powered surveillance tool utilizing their models, highlighting concerns over authoritarian regimes leveraging U.S. technology against their own citizens and others. The company emphasized its commitment to preventing such misuse of AI, stating that its policies prohibit facilitation of activities that threaten democratic values and human rights. Additionally, similar accounts from North Korea and Cambodia were also banned for malicious activities, including misinformation and financial fraud. OpenAI continues to alert the U.S. government about the potential threats posed by AI in the hands of authoritarian regimes.