According to a CCTV news report, in a case recently uncovered in Huangshi, Hubei, a criminal gang used theAI face-changingTechnology to unlock and sell social accounts for illegal profit. The victim, Mr. Wang, was induced to invest and eventually encountered cash withdrawal problems after joining a stock speculation live stream, and the other account was suspected of beingScamsFrozen and funds cannot be withdrawn.
During the investigation, the police found that the social accounts involved were unfrozen and re-logged in, and it was presumed that a gang helped to unblock them. After investigation, Huangshi police arrested three suspects in Henan Province and seized a large amount of electronic equipment and phone cards. The suspects, Gao Mou and Xu Mou, have been selling and helping others unlock social accounts online since the end of September 2023, utilizing dynamic videos produced by AI face-swapping technology to unlock accounts frozen by platforms, charging 15 to 30 yuan for each account unlocked, and unlocking a total of 2,107 accounts, making 400,000 yuan in illegal profits.
Experts from the Ministry of Industry and Information Technology's anti-fraud task force pointed out that unscrupulous elements obtain the victim's portrait or video through public channels, and use AI technology to learn to imitate and achieve the effect of faking the real.AI face-switching technology not only allows the activation of portraits on static photographs, but also enables face-switching in the state of real-time video communication, and even imitates the voice.
Currently, the relevant departments are developing AI face-switching fraud detection and early warning technology, cooperating with cell phone terminal enterprises to launch risk alert functions, protecting user data from leakage and providing early warning alerts after user authorization.
According to the Administrative Provisions on Depth Synthesis of Internet Information Services, providers of depth synthesis services are required to add watermarks to synthesized content, prompting the public that the content is generated or synthesized by AI while facilitating the tracing of the source. Experts remind that it is important to strengthen the protection of personal privacy, do not easily provide biological information, do not arbitrarily and publicly share moving pictures and videos, especially when it comes to the transfer of money remittance requirements, should be verified through a variety of ways to avoid being deceived.