If AI is addictive, where does the responsibility lie – with big tech or its users?
, ,

如果人工智能具有成瘾性,责任应该归于科技巨头还是用户?

If AI is addictive, where does the responsibility lie –…

Bernd Stahl, Professor of Critical Research in Technology, School of Computer Science, University of Nottingham

Generative AI systems show signs of being addictive, but the evidence is still at an early stage.

生成式人工智能系统显示出成瘾的迹象,但证据仍处于早期阶段。

When I talk to my son, an engineering student, and we have a question or disagreement, he immediately turns to ChatGPT as his primary source of information and confirmation.

当我与我的儿子——一个工程专业的学生——交谈时,如果出现问题或分歧,他会立即将ChatGPT作为获取信息和确认答案的主要来源。

He is not alone in this. The use of generative AI tools has exploded across different demographic groups. For many people, these tools can be entertaining, informative and beneficial. However, they also have a dark side.

他并非唯一如此。生成式人工智能工具的使用在不同人群中激增。对许多人来说,这些工具既具有娱乐性、信息性又很有益处。然而,它们也存在阴暗面。

Generative AI is not formally recognised as addictive right now – the medical evidence is still being gathered. But there is a significant amount of data showing heavy use of chatbots and other systems that produce text, images and video leads to neural patterns and behaviour that are associated with addiction.

目前,生成式AI尚未被正式认定为成瘾物——相关的医学证据仍在收集之中。但大量数据显示,沉迷于聊天机器人和其他产生文本、图像和视频的系统,会导致与成瘾相关的神经模式和行为。

In light of Meta’s and YouTube’s recent legal defeat in a landmark social media addiction trial, I believe it’s time to ask whether a similar logic applies to generative AI – and how it could be addressed. The starting point would be to identify who carries responsibility for overuse of generative AI.

鉴于Meta和YouTube最近在里程碑式的社交媒体成瘾诉讼案中的法律败诉,我认为现在是时候探讨是否类似的逻辑适用于生成式AI——以及如何解决这个问题了。起点在于确定谁对过度使用生成式AI负有责任。

The science on this is not settled, and there are some who counsel caution when using the term addiction. They propose the use of other expressions such as “problematic use”. However, in a recent paper, our team of researchers suggest there is strong evidence to suggest that generative AI has addictive properties.

关于这一点,科学界尚未达成共识,有些人在使用“成瘾”一词时建议保持谨慎。他们提议使用“问题性使用”等其他表达方式。然而,在一篇最近的论文中,我们的研究团队提出,有强有力证据表明生成式AI具有成瘾特性。

Much-discussed examples include emotional dependency on chatbot companions, compulsive engagement with them, and the loss of real-world acquaintances and friends.

讨论较多的例子包括对聊天机器人伴侣的情感依赖、对其的强迫性投入,以及与现实世界中的熟人和朋友关系的流失。

A key factor here is that, as in all cases of addiction, the behaviour has negative consequences for the user which may affect both their personal and professional lives.

这里的关键因素是,就像所有成瘾案例一样,这种行为会对用户产生负面后果,从而影响他们的个人和职业生活。

If we follow the argument that generative AI is a candidate for addictive behaviour, then we also need to look at responsibility. Societies tend to find ways to deal with harm by holding people or groups responsible for fixing it. Those who could be accountable include legislators, regulators, industry and health systems.

如果我们接受生成式AI具有潜在成瘾行为这一论点,那么我们也必须关注责任问题。社会倾向于通过追究个人或群体的责任来解决危害。这些可能需要承担责任的群体包括立法者、监管机构、产业界和医疗系统。

Historical examples

历史案例

Historical precedents such as smoking might offer insights into how the area of generative AI addiction could evolve.

像吸烟这样的历史先例可能会为我们提供关于生成式AI成瘾领域如何演变的一些见解。

Older readers may remember when the Marlboro Man would appear before any feature movie in their local cinemas. It eventually transpired that not only was smoking addictive and bad for your health, but that tobacco companies knew this. Nevertheless, it was publicly denied.

年长的读者可能还记得,在他们当地的电影院看任何一部大片之前,都会看到“马尔博拉男子”的形象。后来人们发现,不仅吸烟具有成瘾性且有害健康,而且烟草公司对此是知情的。然而,这一点却被公开否认了。

This led to lengthy and high-profile litigation, eventually resulting in large-scale financial payouts and changes to the industry. These changes included the plain packaging of tobacco products and gruesome warning labels on them.

这导致了旷日持久、备受关注的诉讼,最终造成了大规模的经济赔偿和行业变革。这些变化包括烟草产品的纯包装以及上面令人不适的警告标签。

Gambling could be following a similar trajectory – and now social media companies may be taking their first steps into a similar process.

赌博可能会遵循类似的轨迹——而现在社交媒体公司可能正在迈出进入类似过程的第一步。

A key question is whether the makers of a product – be it tobacco, gambling or social media – are aware of its addictive properties. Another important factor being considered is whether certain companies may even use the allegedly addictive properties of their products for corporate advantage.

一个关键问题是:产品制造商(无论是烟草、赌博还是社交媒体)是否了解其成瘾特性?另一个需要考虑的重要因素是,某些公司是否甚至会利用其产品的所谓成瘾特性来获取企业优势。

AI is not tobacco, of course, but there may be parallels to be studied.

当然,AI不是烟草,但其中可能存在可以进行比较研究的相似之处。

In our research, we have identified four groups of stakeholders that are now being called upon to address the challenges linked to the possibility of addiction to generative AI.

在我们的研究中,我们确定了四个现在被要求解决与生成式AI成瘾可能性相关的挑战的利益相关者群体。

The first is governments and regulators. These have a key role to play in highlighting the problems, setting the rules of engagement, and creating incentives for other parties to engage with the topic.

第一个是政府和监管机构。他们在突出问题、制定行为规则以及为其他各方参与该议题创造激励机制方面发挥着关键作用。

They can do this by requiring labelling, restricting advertising, applying liability law and providing research funding – along with many other mechanisms.

他们可以通过要求标注、限制广告、适用责任法并提供研究资金等多种机制来实现这一点。

But the most important role in addressing potential addictive behaviour associated with generative AI would be held by big tech companies that develop and own these technologies – and stand to benefit financially from them.

但解决与生成式AI相关的潜在成瘾行为的最重要角色,将由开发和拥有这些技术的科技巨头公司承担——而它们也将从这些技术中获得经济利益。

These companies own and have access to user data, which would be needed to ascertain the features that support or alleviate addiction. They are also the parties that would benefit financially from addiction by increasing user numbers and engagement, the main currency of the digital age.

这些公司拥有并可以获取用户数据,而这些数据对于确定支持或缓解成瘾的特征是必不可少的。它们也是通过增加用户数量和参与度(这是数字时代的主要货币)来从成瘾现象中获益的各方。

In addition to these two groups, academic researchers have an important role in collecting and interpreting data, and providing the evidence needed to recognise addiction and addictive features – in ways that allow for evidence-based political or legal debate.

除了这两个群体之外,学术研究人员在收集和解释数据、提供识别成瘾和成瘾特性的证据方面也发挥着重要作用——从而为基于证据的政治或法律辩论创造条件。

Finally, civil society organisations such as user or patient groups can help by providing support, advocating for members’ interests, and establishing early-warning structures.

最后,像用户或患者团体这样的民间社会组织可以通过提供支持、倡导成员利益以及建立早期预警结构来提供帮助。

The point is that none of these interested parties can address the problem on their own. They need to collaborate.

关键在于,这些感兴趣的各方都无法单独解决这个问题。他们需要进行协作。

Someone else’s problem

别人的问题

A key problem at the moment is the lack of structured debate about responsibilities – everybody assumes it is someone else’s problem. But there is ample precedent showing how greater engagement from those involved with the issue may be achieved.

目前的一个关键问题是缺乏关于责任的结构化辩论——每个人都认为这是别人的问题。但有充分的先例表明,可以实现相关方更大的参与度。

With tobacco, the World Health Organization (WHO) formed the Framework Convention on Tobacco Control – a treaty-based mechanism that brought together governments, public health bodies, researchers and civil society to evaluate evidence and draw up common rules. The International AI Safety Report shows comparable international consensus-building activities are already happening in other aspects of AI.

在烟草方面,世界卫生组织(WHO)制定了《烟草控制框架公约》——这是一个基于条约的机制,汇集了各国政府、公共卫生机构、研究人员和民间社会,共同评估证据并制定共同规则。《国际人工智能安全报告》显示,可比较的国际共识建立活动已经在人工智能的其他方面发生。

Some responsibility also falls on the users of AI, who should try to avoid or control their own potentially harmful behaviour. But appeals to individual moderation or mindfulness have been shown with other addictions to be insufficient.

部分责任也属于AI的使用者,他们应该努力避免或控制自身潜在有害的行为。但从其他成瘾性疾病来看,仅诉诸个人克制或正念已被证明是不足够的。

While the harms associated with smoking or alcohol misuse are well known, society still relies on age limits, packaging rules and advertising restrictions. Generative AI is being integrated into the everyday fabric of our society. The choices we now make will determine what acceptable use looks like for years to come.

尽管吸烟或滥用酒精带来的危害是众所周知的,社会仍然依赖年龄限制、包装规则和广告限制。生成式AI正在融入我们社会的日常结构。我们现在做出的选择将决定未来可接受的使用方式是什么样的。

Bernd Stahl does not work for, consult, own shares in or receive funding from any company or organisation that would benefit from this article, and has disclosed no relevant affiliations beyond their academic appointment.

Bernd Stahl不为任何从本文中受益的公司或组织工作、提供咨询、拥有股份或获得资金支持,并且除了其学术任命之外,未披露任何相关的隶属关系。

Read more