QA / QC, Moderation, Review

Formalized protocols for: safety-oriented content policies, transparency around content review, and arbitration mechanism for users to contest system decisions. 

• User-generated content

• Algorithm-generated content

1. For regulators / policy makers 

   1. Are regulators able to query content portals for sample sets to ensure compliance?

   2. Policy questions for user generated content

      1. How does your system handle QA/QC metrics?

         1. Do you have documentation regarding error rates, false positive/negatives; etc

      2. Does your system allow for batching of flagged content 

         1. For 3rd party auditors?

         2. For regulators upon request?

   3. Does the user-generated content undergo automated safety review? If not, what internal protocols trigger a review e.g. sentiment analysis?

      1. What technical standards have been used to evaluate benchmarks for safety flagging?

      2. Intake mechanism to compel disclosure for what privacy regulations are being adhered to? (eg HIPAA? GDPR?)

         1. Privacy enforcement for various classes of data?

            1. PII

            2. Health data

            3. 3rd party data transfers

            4. Tracking data on sensitive/high-risk browsing

               1. Social media tracking pixels on hospital websites

            5. Biometric data