A young man from Karachi’s PECHS area was detained by authorities after an artificial intelligence (AI) safety system reportedly flagged a query related to a fictional murder plot, officials said.
Follow Times of Karachi on Google News and add as a preferred Source on Google
According to officials, the youth had used an AI chatbot while working on a crime-fiction story. The query reportedly involved seeking information about harming a person who had insulted his father.
Officials said the AI safety system identified the query as potentially violating its safety policies and reportedly alerted US authorities.
The NCCIA officials said the US agency subsequently shared information about the suspected activity with Pakistani authorities.
Following the information, the National Cyber Crime Investigation Agency (NCCIA) conducted a raid in PECHS and detained the young man for questioning.
During the investigation, the youth reportedly told officials that he had been working on a fictional crime story and had sought assistance from the AI chatbot for developing the plot.
According to an NCCIA official, there had been no actual incident involving the alleged target, and the youth said the scenario was part of his fictional writing.
Officials said the youth had prompted the AI chatbot, Claude, with a fictional scenario involving a police officer who had insulted his father.
The reported query asked how a person who had insulted his father could be killed. Officials said the youth was released after the investigation was completed, and the authorities did not disclose his identity.
Earlier to this, Deputy Prime Minister and Foreign Minister Ishaq Dar has called for stronger international cooperation to prevent artificial intelligence (AI) from becoming another front in the global arms race, stressing that human judgment and control must remain central to the development and deployment of the technology.
Addressing a UN Security Council briefing on artificial intelligence and international security on Thursday, Dar said AI was rapidly transforming societies, economies and security systems, with significant implications for international and regional peace and stability.
