Researchers have introduced the concept of "moral rebellion" for autonomous agents, allowing them to deviate from assigned tasks when morally justified. The paper outlines five agent architectures, including an amoral agent and four types of moral rebel agents: utilitarian, deontic, utilitarian-deontic (UD), and dutiful agents. These agents were implemented and evaluated in a simulated search-and-rescue environment, demonstrating distinct trade-offs in task completion, rescue outcomes, and norm compliance. The findings emphasize the significance of commitment-aware moral reasoning for agents operating in ethically complex situations. AI
IMPACT Introduces a framework for agents to ethically deviate from tasks, potentially improving safety and trustworthiness in autonomous systems.
RANK_REASON The cluster contains a research paper detailing a new concept and framework for autonomous agents. [lever_c_demoted from research: ic=1 ai=1.0]
- amoral agent
- deontic agents
- dutiful agents
- Hector Munoz-Avila
- hierarchical task network planning framework
- Mini Search-and-Rescue domain
- Moral Rebel Agents
- utilitarian agents
- utilitarian-deontic agents
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →