Experimentation in Trust & Safety: Methodologies and Challenges
Date & Time
Friday, May 17, 2024, 4:25 PM - 4:50 PM
Erin Arnesen

Trust and Safety is inherently a dynamic, high risk, and rapidly changing space that relies on a mix of tools, policies, and human judgment. Experimentation (A/B testing) is necessary to parse out the causal impact of changes, allowing us to isolate what truly drives improvement. Rigorous experimentation in this domain presents unique challenges, including ethical considerations, privacy concerns, complexity of multi-platform environments, and cross-functional dependencies. This talk will explore why experimentation is essential for Trust and Safety teams, and discuss strategies to standardize and scale this practice despite inherent challenges.

This presentation will share a case study and framework for how Google T&S has launched the Experimentation Platform. The Experimentation Platform enables a continuous improvement model for tools used to moderate content across all Google core products, from Shopping to Maps to Search. These learnings have been adapted and stress tested to apply across T&S digital technology spaces, and at companies ranging from small to enterprise.

Location Name
Full Address
Clayton Hotel Burlington Road
Leeson Street Upper
Dublin D D04 A318
Summit Session Type