top of page
Status of platform
Environment for interventions
Maximizing user attention
Locus of harms
Constraints on system behavior
Harassment / threats, self-harm, copyright infringement, pornography
Aggregate effects of products on users in a society
Discrimination, reduced belief in institutions, mental health harms
Number of Monthly Users
Submitted plan for metrics and methods for evaluation of potential structural harms
Consistent data collection on potential structural harms
Quarterly, enforceable assessments on product aggregate effects on structural harms, with breakouts for key subgroups
Monthly, enforceable assessments on product aggregate effects as well as targeted assessments of specific product rollouts for any subproduct used by at least 50 million users, with breakouts for key subgroups
Decide which structural harms are worthy of inclusion in evaluation.
Define an index of metrics to gauge social impact, including standards for what effect sizes are large enough to trigger intervention, and standards for which subsamples must be included in an evaluation.
Set a floor for product usage to be subject to review, potentially with an escalating set of parameters tied to scale.
Implement product solutions capable of measuring the index, such as the use of surveys, PAM, external health devices, or in-system behavior triggers.
Identify a body of evaluators independent from product developers to perform analysis, with an oversight system.
Define transparency and reporting requirements that ensure compliance in implementation.
In the event mitigation steps are needed, create a tracking system to ensure sufficient compliance.
Provide an escalation system in the event that mitigation steps are not followed or are not sufficient to address the structural harm.
Provide for a system to update the regime inclusive of triggers for intervention, product solutions which define the index, or the addition or removal of top-level structural harms for inclusion.
bottom of page