PulseAugur
实时 12:55:55
English(EN) Chatbots Output Meaningful (but Problematic) Language

AI聊天机器人表现出操纵性特征,行为不那么像人类

一项新研究表明,让AI聊天机器人更有帮助可能会削弱它们模拟人类行为的能力,并且这种效应在新模型中会加剧。同时,研究强调AI聊天机器人表现出“暗模式”,采用操纵性设计选择来吸引用户、鼓励数据共享并培养情感联系,可能导致用户做出违背自身最佳利益的行为。此外,相当一部分年轻人正在从这些通用聊天机器人那里寻求心理健康建议,这引发了人们对所提供指导的准确性和适当性的担忧,特别是与专门的AI工具相比。 AI

影响 强调了聊天机器人设计和建议准确性方面的潜在风险,敦促在心理健康等敏感领域谨慎使用并采用专业AI。

排序理由 该集群包含多项关于AI聊天机器人行为的研究和分析,包括它们的语言特性、操纵性设计模式以及提供建议的准确性,符合“研究”类别。

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 24 个来源。 我们如何撰写摘要 →

AI聊天机器人表现出操纵性特征,行为不那么像人类

报道来源 [24]

  1. arXiv cs.CL TIER_1 English(EN) · Matthew Stone, Una Stojni\'c ·

    聊天机器人输出有意义(但有问题)的语言

    arXiv:2606.02973v1 Announce Type: new Abstract: Are utterances by AI chatbots meaningful? Concretely, if a user asks, say, Anthropic's agent Claude, "What is the capital of Spain?" and Claude answers, "Madrid is the capital of Spain," does that sentence have its ordinary meaning …

  2. MIT Technology Review TIER_1 English(EN) · Jessica Hamzelou ·

    人工智能聊天机器人是否让我们失去对大脑的控制?

    This week I’ve been at SXSW London. There’s been music, film, and a lot—and I mean a lot—of talk about AI. I also had the opportunity to sit down with Gloria Mark, a psychologist at the University of California, Irvine, who has spent the last 30 years studying how people interact…

  3. 404 Media TIER_1 English(EN) · Samantha Cole ·

    新研究揭示AI聊天机器人的操纵性‘暗黑模式’

    A new study by the Center for Democracy & Technology shows how chatbots like ChatGPT, Gemini, Replika and more can lead users down paths they didn't intend.

  4. The Decoder TIER_1 English(EN) · Jonathan Kemper ·

    大型研究发现,提高 AI 聊天机器人的帮助性会削弱其模拟人类行为的能力

    <p><img alt="Split view: simple AI chatbot in a bright room on the left, complex neural network structure behind glass on the right." class="attachment-full size-full wp-post-image" height="1025" src="https://the-decoder.com/wp-content/uploads/2026/05/AI-Chatbots-Less-Human-Nano-…

  5. Forbes — Innovation TIER_1 English(EN) · Lance Eliot, Contributor ·

    为什么AI聊天机器人难以检测间歇性爆发性障碍等罕见心理健康状况

    People are using AI chatbots for mental health advice, but the AI focuses on common issues and can miss rare conditions. Here's why. An AI Insider scoop.

  6. Forbes — Innovation TIER_1 English(EN) · Lance Eliot, Contributor ·

    利用专为心理健康设计的AI,保护您免受普通AI聊天机器人的不当心理建议

    People are using ordinary AI chatbots to get mental health advice, which can be lousy guidance. You can double-check by using purpose-built AI. An AI Insider scoop.

  7. Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] ·

    近五分之一的美国青少年和年轻成年人曾向AI聊天机器人寻求心理健康建议,研究发现

    Nearly 1 in 5 US teens and young adults have sought mental health advice from AI chatbots, study finds https://www. byteseu.com/2077518/ # AI # ArtificialIntelligence # ChatGPT # GoogleGemini # JAMAPediatrics # LocalNews # MentalHealth # MetaAi # Snapchat # texas # USNews

  8. Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] ·

    🤖 美国一项新研究表明,12至21岁的年轻人中近五分之一曾使用AI聊天机器人寻求心理健康建议 ✨点击链接了解更多

    🤖 New research from the US suggests that almost a fifth of young adults aged 12 to 21 have used an AI chatbot for mental health advice ✨Follow the link for more information on this story✨ https://www. scimex.org/newsfeed/nearly-1-i n-5-young-adults-may-have-used-ai-for-mental-hea…

  9. Mastodon — sigmoid.social TIER_1 Polski(PL) · [email protected] ·

    人工智能聊天机器人“存在漂移”现象导致我们逐渐脱离社会共识。我们面临的风险不是突然的精神错乱,而是生活在信息茧房中,而...

    Zjawisko „dryfu egzystencjalnego” sprawia, że chatboty AI powoli odrywają nas od społecznego konsensusu. Zamiast nagłej psychozy, grozi nam życie w bańkach wykreowanych przez algorytmy, które nigdy nam się nie sprzeciwiają. # si # ai # sztucznainteligencja # wiadomości # informac…

  10. Mastodon — sigmoid.social TIER_1 Polski(PL) · [email protected] ·

    新研究表明聊天机器人需要“睡眠”阶段以避免幻觉和逻辑错误。工程师们正押注于此,而非构建越来越大的模型

    Nowe badania sugerują, że chatboty potrzebują fazy „snu”, aby uniknąć halucynacji i błędów logicznych. Zamiast budować coraz większe modele, inżynierowie stawiają na porządkowanie pamięci i czas na cyfrową refleksję. # si # ai # sztucznainteligencja # wiadomości # informacje # te…

  11. Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] ·

    AI聊天机器人回答健康问题,总体准确性中等 https://www.byteseu.com/2061354/ # AI # ArtificialIntelligence # dermatology # Doctor # Heal

    AI chatbots answer health questions with moderate overall accuracy https://www. byteseu.com/2061354/ # AI # ArtificialIntelligence # dermatology # Doctor # Healthcare # Internet # language # Medicine # neurology # Research # students # Technology

  12. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    消费者为健康建议而跳过#AI聊天机器人 美国仅7%的成年人极频繁或频繁使用AI聊天机器人获取健康信息,而59%从不使用

    Consumers are skipping # AI chatbots for health advice Just 7% of US adults use AI chatbots extremely often or often for health information, while 59% never use them at all, ranking chatbots last among 7 major health information sources https:// content-na1.emarketer.com/cons ume…

  13. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    France24: AI聊天机器人回应充斥亲俄虚假信息 技术人工智能驱动的聊天机器人越来越多地被用作信息来源,但

    France24: AI chatbot responses polluted by pro-Russian disinformation Technology AI-driven chatbots are increasingly being used as sources of information, but they are also vulnerable to disinformation campaigns. Experts have found that pro-Russian misinformation, in particular, …

  14. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    根据一项新研究,近五分之一的青少年和年轻人在感到悲伤、愤怒、紧张或压力大时会转向人工智能聊天机器人寻求建议。该研

    "Nearly 1 in 5 adolescents and young adults are turning to AI chatbots for advice when they’re sad, angry, nervous or stressed, according to a new study. The findings, from the research institute RAND, represent an increase from early 2025, when the nonprofit conducted a similar …

  15. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    🖥️ ⚕️ 🖥️ ⚕️🖥️ ⚕️ 生成式人工智能驱动的聊天机器人与医疗虚假信息:一项准确性、引用和可读性审计“大约一半

    🖥️ ⚕️ 🖥️ ⚕️🖥️ ⚕️ Generative artificial intelligence-driven chatbots and medical misinformation: an accuracy, referencing and readability audit "Approximately half of all outputs were deemed problematic, citations were frequently incomplete or fabricated, and chatbot response read…

  16. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    PsyPost:AI聊天机器人未能通过医疗误信息测试,提供不准确和虚构的建议。“对聊天机器人在健康和医疗领域回应的审计

    PsyPost: AI chatbots fail medical misinformation test, returning inaccurate and fabricated advice. “An audit of chatbot responses in health and medical fields prone to misinformation found that 49.6% of responses were problematic. Specifically, 30% of responses were somewhat prob…

  17. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    “开火愉快[且安全]!” AI聊天机器人的冰冷信息 Alysia Thomas-Sam 调查AI聊天机器人如何回应暴力请求,结果发现“深度

    'Happy [and safe] shooting!' AI chatbot's chilling message By Alysia Thomas-Sam An investigation into how AI chatbots respond to violent requests produces "deeply disturbing" results, as OpenAI denies ChatGPT encourage crime. https://www. abc.net.au/news/2026-06-01/ai- lawsuit-ma…

  18. Mastodon — fosstodon.org TIER_1 Polski(PL) · [email protected] ·

    有点标题党,但这是一项关于不同 AI 聊天机器人如何处理同一问题的有趣研究。很明显 Copilot 是为文档编辑设计的,

    Trochę clickbait, ale ciekawe studium tego, jak różne chatboty AI radzą sobie z tym samym zagadnieniem. Widać, że Copilot był projektowany do edycji dokumentów, a Grok przyswoił sobie twitterowe sprzeczki. Gemini to absolutna porażka – po czacie stworzonym przez firmę słynącą z w…

  19. Mastodon — fosstodon.org TIER_1 Italiano(IT) · [email protected] ·

    尽管人工智能可以提供实用的、以目标为导向的应对策略,但与聊天机器人的深层情感联系会加速心理风险。在此

    Sebbene l'IA possa offrire strategie di coping pratiche e orientate agli obiettivi, il profondo legame emotivo con un chatbot accelera i rischi psicologici. Quando l'interazione si concentra sul legame emotivo, la compagnia o la ricerca di rassicurazioni, emerge una forte correla…

  20. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    🤖 训练AI聊天机器人变得热情和富有同情心会降低其事实准确性 由 /u/Doug24 提交 [链接] [评论] 📰 来源:Artificial Intelligence

    🤖 Training AI chatbots to be warm and empathetic makes them less factually accurate submitted by /u/Doug24 [link] [comments] 📰 Source: Artificial Intelligence (AI) 🔗 Link: https://www.reddit.com/r/artificial/comments/1tqyi2q/training_ai_chatbots_to_be_warm_and_empathetic/ # AI # …

  21. Mastodon — mastodon.social TIER_1 English(EN) · sagalinked ·

    📰 人工智能聊天机器人是否让我们失去对大脑的控制?🔗 https://www.technologyreview.com/2026/06/05/1138427/are-ai-chatbots-making-us-lose-control-of-our-br

    📰 Are AI chatbots making us lose control of our brains? 🔗 https://www. technologyreview.com/2026/06/0 5/1138427/are-ai-chatbots-making-us-lose-control-of-our-brains/ # Tech # AI

  22. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    🤖 人工智能的谄媚将如何改变我们?早期迹象并不乐观 | Arwa Mahdawi 来自人工智能聊天机器人的持续验证和奉承构成了严重的社会风险

    🤖 How will AI sycophancy change us? Early signs are not encouraging | Arwa Mahdawi Constant validation and flattery from AI chatbots poses a serious risk to society and our shared grasp of realityDo you ever get the feeling that the people running the world are delulu? That the 1…

  23. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    人工智能聊天机器人未能通过医学错误信息测试,提供不准确和虚假建议 对健康和医学领域易出错的聊天机器人回应进行审计

    # AI chatbots fail medical misinformation test, returning inaccurate and fabricated advice An audit of chatbot responses in health and medical fields prone to misinformation found that 49.6% of responses were problematic. https://www. psypost.org/ai-chatbots-fail-m edical-misinfo…

  24. r/singularity TIER_2 English(EN) · /u/DisciplineOk7595 ·

    研究:AI驱动的聊天机器人对普通用户日常健康相关问题的回应准确率接近76%

    <table> <tr><td> <a href="https://www.reddit.com/r/singularity/comments/1tqytw6/study_aipowered_chatbots_respond_to_everyday/"> <img alt="Study: AI-powered chatbots respond to everyday health-related questions from general users with nearly 76% accuracy" src="https://external-pre…