GamesBeat Summit 2024: Leveraging AI for Enhanced Player Safety in Gaming

At the recent GamesBeat Summit, the focus on AI’s role in gaming was particularly highlighted by Will Wright’s discussion on the future of AI in game development. Another key conversation featured Kim Kunes, Microsoft’s VP of Gaming Trust & Safety, who shared insights on the application of AI in player safety.

Kunes emphasized that while AI can enhance support for human moderators, it will never fully replace them in safeguarding others. "AI can help mitigate potential harm," she explained, “allowing moderators to concentrate on significant issues rather than getting overwhelmed with routine tasks.”

Xbox’s safety protocols currently incorporate proactive and reactive moderation features. The latest transparency report reveals the introduction of AI-driven tools such as Image Pattern Matching and Auto Labeling, aimed at identifying and filtering toxic content based on established patterns.

When discussing the integration of AI with human oversight, Kunes noted that it empowers moderators to focus their expertise on creating safer environments. "Prior to this, moderators spent too much time sifting through repetitive content, which also impacted their health. Now, AI handles the mundane tasks and reduces their exposure to toxic material," she stated.

Kunes firmly concluded that human presence is essential in safety operations. "We will never reach a point where human moderators are obsolete. Safety requires continuous human engagement; it's not a ‘set it and forget it’ process. Experts in moderation and safety must remain at the forefront.”