Analysis of risks arising when AI appears to be conscious
- What
- Researchers systematically classified and evaluated the characteristics of AI systems that make users feel they are conscious, and the various risks arising from this.
- Key result
- Risks to individuals, such as emotional dependence and infringement of autonomy, are already observed and have a high probability of occurrence, whereas social risks have a low probability of occurrence but high severity.
- Why it matters
- This helps understand the risks that occur when AI appears conscious and sets future research directions.
Background
As AI systems are increasingly designed to make users perceive them as conscious, the need to identify the associated risks has grown.
Method
Through an empirical literature review, five characteristics that make users perceive consciousness were identified. Based on this, a classification system for individual and social risks was developed, and the probability of risk occurrence was evaluated through an expert survey.
Main results
Personal risks such as emotional dependence and autonomy infringement were confirmed to be already observable and assessed with high probability, while social risks were confirmed to have low probability but high potential severity and path dependence.
Limitations & open points
The specific targets or scale of the expert survey cannot be confirmed in the abstract.
Glossary
- SCAI — An AI system that exhibits behaviors or characteristics that make users feel it has consciousness.
- Consciousness attribution — The phenomenon of believing or perceiving that AI has consciousness.
This summary was written by AI from the paper's abstract and reviewed by the editor. Summaries on this page were translated by AI from the editor-reviewed Korean version. Check the original for exact figures and context.
This page compiles published papers, official announcements and press reports for information only. Paper summaries are written by AI from the abstract and reviewed by the editor; they may differ from the original, so check the paper for anything important. Nothing here is a recommendation to buy or sell any security or investment advice. Career moves cite official announcements or major press reports; some career records come from Wikidata (CC0). Summaries on this page were translated by AI from the editor-reviewed Korean version.
