Trust and Safety is inherently a dynamic, high risk, and rapidly changing space that relies on a mix of tools, policies, and human judgment. Experimentation (A/B testing) is necessary to parse out the causal impact of changes, allowing us to isolate what truly drives improvement. Rigorous experimentation in this domain presents unique challenges, including ethical considerations, privacy concerns, complexity of multi-platform environments, and cross-functional dependencies. This talk will explore why experimentation is essential for Trust and Safety teams, and discuss strategies to standardize and scale this practice despite inherent challenges.

This presentation will share a case study and framework for how Google T&S has launched the Experimentation Platform. The Experimentation Platform enables a continuous improvement model for tools used to moderate content across all Google core products, from Shopping to Maps to Search. These learnings have been adapted and stress tested to apply across T&S digital technology spaces, and at companies ranging from small to enterprise.