ZeniMax Is Reportedly Using AI To Ban Roleplayers in ESO

This week, multiple reports have emerged from Elder Scrolls Online roleplaying communities regarding suspensions linked to AI moderation of private exchanges. Players claim they were suspended for messages that were never reported by others, suggesting an automated system flagged their content. The flagged messages ranged from using semi-sexual language in private chats to using profanities during interactions with NPCs.

According to the Terms of Service updated on February 12th, 2024, ZeniMax Online Studios employs both human review and AI-powered methods for content moderation. The terms state:

To the extent that ZeniMax performs any content moderation of UGC to ensure its compatibility with these Terms of Service (including the Code of Conduct or any relevant EULA), such content moderation may be carried out via human review as well as through the use of AI-powered proactive and reactive moderation methods including without limitation, software that uses algorithmic decision making.

ZeniMax’s proactive content moderation includes without limitation using tools to block and filter UGC that is illegal and/or incompatible with these Terms of Service.

Concerns are growing within the ESO roleplay community regarding the implications of AI moderation. The community values the freedom to explore dark themes inherent to the game’s setting. A notable example involves a player receiving a warning for a joke made in a private chat, which led to anxiety about the AI’s role in moderating private conversations and its potential to misconstrue context.

A thread on the ESO forums has gathered various reactions. Some players are apprehensive about the AI’s accuracy and its potential to unjustly penalize users. Others are worried about the AI’s ability to handle complex and nuanced interactions within the game, which are crucial for roleplay. There is a broader concern that stringent moderation could drive players away from the game, as expressed by several users considering canceling their subscriptions or exploring other MMOs with active roleplay communities.

The discussion also highlights broader issues with AI moderation in gaming. Comparisons were drawn to similar moderation issues on other platforms, where AI systems have occasionally led to unwarranted bans and frustrations among users.

As the situation develops, the ESO community is eager for more transparency from ZeniMax regarding the AI moderation process. Many are calling for a balanced approach that protects players while allowing the creative and interactive nature of roleplay to flourish.