| 351 | 0 | 283 |
| 下载次数 | 被引频次 | 阅读次数 |
激进派认为超级智能具有道德思维的速度、质量与稳定性优势，可以替代道德教育中的教师角色。基于价值体系、实践形态与主体地位三个维度，对其展开批判。超级智能很难形成容纳人类多元价值的道德判断体系，它或是走向功利主义编码造成的道德偏见固化，或是因演进机制黑箱化而带来道德教育角色的不可控风险。人类道德教育实践的情感互动在人机之间难以生动达成，亦难以在机器函数上实现道德的“适度”,且其行动风格对道德的社会学习带来风险。人类出让道德教育地位给超级智能，蕴含人类权力的转移隐喻，人类尊严受到冲击，道德判断与行动能力也易弱化。从人类、国家、社会三个维度，提出超级智能道德教育应用的基本立场，强调其工具性、责任性和谨慎性。
Abstract：The radicals believe that superintelligence has the advantages of speed, quality and stability in moral thinking and can replace the role of teachers in moral education. This paper conducts a critique based on three dimensions: value system, practical form and subject status. It is difficult for superintelligence to evolve a moral judgment system that accommodates the diverse values of human beings. It either leads to the solidification of moral biases caused by utilitarian coding or brings uncontrollable risks to moral education due to the black box of the evolution mechanism. The emotional interaction in human moral education practice is difficult to be vividly achieved between humans and machines, and it is also hard to realize the “moderation” of morality on machine functions. Moreover, its action style poses risks to the social learning of morality. When humans give up the role of moral education to superintelligence, it implies a metaphor for the transfer of power. Human dignity will be undermined, and the ability of moral judgments and actions will be prone to atrophy. Based on the dimensions of human being, country and society, present paper puts forward the basic standpoint of the application of superintelligent inmoral education.
[1]Gabriel F,Kennedy J,Marrone R,et al.Pragmatic AI in Education and its Role in Mathematics Learning and Teaching[J].Npj Science of Learning,2025,10(26):1-7．
[2]Gabriels K,Volkman R.Living Well in Extended Reality:Training Phronesis and Socratic Humility in XR[J].Journal of Moral Education,2025:1-18．
[3]吴康宁．人工智能究竟给教育带来怎样的挑战[J]．教育研究，2025,46(6):4-21．
[4]Russell S.Artificial Intelligence:The Future is Superintelligent[J].Nature,2017,548(7669):520-521．
[5]Nature Editorial.More-Powerful AI is Coming.Academia and Industry must Oversee It-Together[J].Nature,2024,636(8042):273．
[6]Bostrom N.Superintelligence:Paths,Dangers,Strategies[M].Oxford:Oxford University Press,2014．
[7]Russell S.Human-Compatible Artificial Intelligence[C]//Muggleton S,Chater N.(eds.)Human-Like Machine Intelligence.Oxford:Oxford University Press,2021:4．
[8]Hoffman R,Beato G.Superagency:What Could Possibly Go Right with Our AI Future[M].New York:Dallepedia,LLC,2025．
[9]Bostrom N.Ethical Issues in Advanced Artificial Intelligence[C]//Smit I,Wallach W,Lasker G.(eds.)Cognitive,Emotive and Ethical Aspects of Decision Making in Humans and in Artificial Intelligence.Windsor,Ont:Institute of Advanced Studies in Systems Research and Cybernetics,2005．
[10]Guerrero J M.Mind Mapping and Artificial Intelligence[M].Cambridge:Academic Press,2023:159．
[11]Zeng Y,Lu E,Sun K.Principles on Symbiosis for Natural Life and Living Artificial Intelligence[J].AI and Ethics,2025,5(1):81-86．
[12]Mitchell M.Debates on the Nature of Artificial General Intelligence[J].Science,2024,383(6689):eado7069．
[13]Wang H R,Qin Y J,Lin Y K,et al.Empowering Large Language Models:Tool Learning for Real-World Interaction[C]//Proceedings of the47th International ACM SIGIR Conference on Research and Development in Information Retrieval,SIGIR’24.New York:ACM,2024:2983-2986．
[14]Dietrich E.Homo Sapiens 2.0:Building the Better Robots of Our Nature[C]//Anderson M,Anderson S L.(eds.)Machine Ethics.Cambridge:Cambridge University Press,2011．
[15]Savulescu J,Persson I.Moral Enhancement,Freedom and the God Machine[J].Monist,2012,95(3):399-421．
[16]Persson I,Savulescu J.Unfit for the Future:The Need for Moral Enhancement[M].Oxford:Oxford University Press,2012:106．
[17]Volkman R,Gabriels K.AI Moral Enhancement:Upgrading the Socio-Technical System of Moral Engagement[J].Science and Engineering Ethics,2023,29:1-14．
[18]Fossa F.Artificial Moral Agents:Moral Mentors or Sensible Tools?[J].Ethics and Information Technology,2018,20(2):115-126．
[19]Russell S.Should We Fear Supersmart Robots?[J].Scientific American Magazine,2016,314(6):58-59．
[20]Poszler F,Portmann E,Lütge C.Formalizing Ethical Principles within AI Systems:Experts’Opinions on Why (not) and How to do It[J].AI and Ethics,2025,5(2):937-965．
[21]Larionov I,Perova N.Strong AI and the Biotechnological Moral Enhancement[C]//2024IEEE Ural-Siberian Conference on Biomedical Engineering,Radioelectronics and Information Technology(US-BEREIT).New York:IEEE,2024:224．
[22]Rowlands M.What is Moral Enhancement?[J].Royal Institute of Philosophy Supplement,2018,83:5．
[23][英]哈耶克．致命的自负[M]．冯克利，胡晋华，等译．北京：中国社会科学出版社，2000:135．
[24][古希腊]亚里士多德．尼各马可伦理学[M]．廖申白，译．北京：商务印书馆，2003．
[25]Cecchini D,Pflanzer M,Dubljevi?? V.Aligning Artificial Intelligence with Moral Intuitions:an Intuitionist Approach to the Alignment Problem[J].AI and Ethics,2025,5(2):1523-1533．
[26]Peterson C.Automated Ethical Decision,Value-ladenness,and the Moral Prior Problem[J].AI and Ethics,2025,5(2):1583-1594．
[27]Russell S J,Norvig P.Artificial Intelligence:A Modern Approach(Fourth Edition)[M].London:Pearson Education Limited,2022:57．
[28]Floridi L,Cowls J,Beltrametti M,et al.AI4People-An Ethical Framework for a Good AI Society:Opportunities,Risks,Principles,and Recommendations[J].Minds and Machines,2018,28(4):689-707．
[29]Rahwan I.Society-in-the-Loop:Programming the Algorithmic Social Contract[J].Ethics and Information Technology,2018,20(1):5-14．
[30]Savulescu J,Gyngell C,Kahane G.Collective Reflective Equilibrium in Practice (CREP) and Controversial Novel Technologies[J].Bioethics,2021,35(7):652-663．
[31]Dewitt B,Fischhoff B,Sahlin N．“Moral Machine”Experiment is no Basis for Policymaking[J].Nature,2019,567(7746):31．
[32]Lanier J.The Dangerous Fantasies Driving the Quest for Super-Intelligent AI[J].Nature,2025,640(8059):595．
[33]Bathaee Y.The Artificial Intelligence Black Box and the Failure of Intent and Causation[J].Harvard Journal of Law&Technology,2018,31(2):890-938．
[34]Duffy C．“There Are No Guardrails”.This Mom Believes an AIChatbot is Responsible for Her Son’s Suicide[EB/OL].(2024-10-30)[2025-09-08].https：//edition.cnn.com/2024/10/30/tech/teen-suicide-character-ai-lawsuit/index.html．
[35]中华人民共和国教育部．中小学德育工作指南[EB/OL].(2017-09-05)[2025-05-08].http：//www.moe.gov.cn/srcsite/A06/s3325/201709/t20170904_313128.html．
[36]Misselhorn C.Artificial Moral Agents:Conceptual Issues and Ethical Controversy[M]//Voeneky S,Kellmeyer P,Mueller O,et al.(eds.)The Cambridge Handbook of Responsible Artificial Intelligence:Interdisciplinary Perspectives.Cambridge:Cambridge University Press,2022:31-49．
[37]Davies J.Program Good Ethics into Artificial Intelligence[J].Nature,2016,538(7625):291．
[38]康德著作全集（第9卷）[M]．李秋零，主编．北京：中国人民大学出版社，2013．
[39]Lu Q Y,Svegliato J,Nashed S B,et al.Ethically Compliant Autonomous Systems under Partial Observability[C].2024 IEEE International Conference on Robotics and Automation (ICRA),2024:16229-16235．
[40]Weber-Guskar E.How to Feel about Emotionalized Artificial Intelligence?When Robot Pets,Holograms,and Chatbots become Affective Partners[J].Ethics and Information Technology,2021,23(4):601．
[41]Krügel S,Ostermaier A,Uhl M.ChatGPT’s Inconsistent Moral Advice Influences Users’Judgment[J].Scientific Reports,2023,13:1-5．
[42]康德著作全集（第6卷）[M]．李秋零，主编．北京：中国人民大学出版社，2013:4．
[43]Richter F.From Human-System Interaction to Human-System Co-Action and Back:Ethical Assessment of Generative AI and Mutual Theory of Mind[J].AI and Ethics,2025,5(1):25．
[44]苏曦凌．“跳出教育看教育”：教育的公共服务属性及其理解---基于国家治理场域[J]．学海，2024(6):86.
基本信息:
DOI：10.19484/j.cnki.1000-8934.2026.01.017
中图分类号:G41;N031;TP18
引用信息:
[1]卢愿清.超级智能可能成为德育导师吗?[J].自然辩证法研究,2026,42(01):121-129.DOI:10.19484/j.cnki.1000-8934.2026.01.017.
基金信息:
教育部哲学社会科学研究重大课题攻关项目“数字化未来与数据伦理的哲学基础研究”(23JZD005)
2026-01-18
2026-01-18