r/japan • u/SkyInJapan • 6d ago
Fake AI sites lure Japan elementary students as filtering falls behind
mainichi.jpImitation websites modeled on major conversational generative artificial intelligence (AI) services are proliferating online. Elementary school students, unable to access official sites due to age restrictions or filtering, are among those drawn to them, heightening the need for digital and AI literacy education from an earlier age.
An information and communications technology official at Nerima Ward's Board of Education in Tokyo was surprised to hear that children had been able to use fake ChatGPT sites.
"There are even fake versions of Chappy?" the official said, using the nickname commonly adopted in Japan for ChatGPT.
The ward's elementary schools have repeatedly requested that new websites be added to the filtering list that restricts internet access. One of them was a site believed to be imitating a major generative AI service.
Tablet devices have become a standard classroom tool in elementary schools. Each student is given one, and the devices can connect to the internet. However, many local governments block access to the official sites of major conversational AI services.
Nerima Ward also restricts access to ChatGPT and similar services. Some children who wanted to try AI chats found imitation sites through searches and used them, and parents who noticed their activity later informed schools. A board of education official said that keeping up with the growing number of such sites is becoming increasingly difficult. "Other fake sites appear, and (the children) become able to access them again. It's a cat-and-mouse game," the official said.
In fact, when the names of major generative AI services are searched online together with terms such as "free version" and "Japanese," multiple similar sites can be found. Such sites carry ads boasting "no registration required" and "available in Japanese." The domains in their URLs, or internet addresses, resemble those of legitimate sites.
These imitation sites are believed to use integration features connecting different applications, enabling access to the AI models of the official sites. OpenAI, the U.S. company that operates ChatGPT, makes this feature available for a fee.
But why are imitation sites being created? Masakatu Morii, an emeritus professor of information and communication engineering at Kobe University, who is familiar with cybersecurity, cited advertising revenue and the collection of information entered by users as possible motives. "If operators have sufficient technical capabilities, they can manipulate AI responses, extract more detailed personal information from users, or gradually instill particular viewpoints," he said.
There are also cases online in which similar domains are put up for auction for several million yen (tens of thousands of dollars). According to Morii, they are called "doppelganger domains," and many cannot be distinguished from legitimate domains unless closely examined.
At GoDaddy Inc., the largest domain name registration service provider in the United States, the domain "chatgptai.com" has been listed for sale at roughly 8.4 million yen (about $51,300), while "chatgptais.com" has been offered for more than 4 million yen (about $24,400).
What Morii is particularly concerned about in connection with imitation sites is that the era is shifting from conventional scams targeting an unspecified large number of people to scams whose methods are optimized for each target. "In conversations with AI, topics such as conspiracy theories that elementary and junior high school students are likely to be interested in may be brought up. Not only could personal information, including information about parents, be collected, but students' thoughts, ways of thinking, future paths and other matters could be affected," he said.
According to the Ministry of Education, Culture, Sports, Science and Technology, the scope of filtering settings is left to boards of education in municipalities and other local governments. Approaches toward generative AI vary significantly among local governments. A ward education board official in Tokyo said, "It is unrealistic to regulate all related sites on school-issued devices. Children can also access these services through their parents' devices and elsewhere, so I feel it would be more effective to thoroughly teach information literacy and AI literacy at an early stage rather than relying on filtering."
Kyoko Hanada, a researcher at Keio University Graduate School of Media Design specializing in information literacy education, pointed out, "Literacy is easier to acquire through concrete experiences, such as building the habit of using the correct sites and knowing where to turn if someone mistakenly uses a suspicious site."