Resource Planning

  1. Checklist / Questions to ask your Development Tteam

    • Did you do a technology assessment to determine if the problem being solved needs AI technologies. Acting on predictions in an automated way should should only be used when risk is low. The following uses case best suited for AI technologies to predicting recommendations based on different data subjects, predicting future events eg. weather, natural language understanding, and image recognition. Other uses cases such as people don’t want this task automated, should be reconsidered more information when to use AI or not.

    • Did you create an Impact Statement which frames the problem to be solved and includes Risk Assessment chart with measurable thresholds for bias, fairness, transparency, Data Gathering, Data privacy, Training Data, Explainability, List key potential harms)

    • Did you create a sBOM (Bill of Material) which includes: list of all components ( data, models and code). Here’s how to create a sBOM

    • Are you familiar with Factsheets? What Ethics by Design approach did you use eg. Scoping, Mapping, Artifact Collection, Testing, and Reflection

    • Did you create a Risk Management chart to include list of intent ‘harm/risk, probability and planned mitigation if mistakes are made eg. data drift occurs

    • Do you have a training plan for staff on project?

    • Do you have an AI Ethics board in place to review and govern the ethical development and deployments

    • Is your teams trained on ethical deployment of AI (annual certification needed)

    • What standards / regulation are to be adhered to

  2. External Resources - Tools to use.

    • Impact Assessment tool

    • Dataiku helps manage data drift or individual prediction explanations

    • Templates(Samples)

      • Technical Assessment

      • Impact Statement - Guide

      • AI BOM

      • AI Ethics Risk Management chart

      • AI Ethics Board

      • AI Training Plan

  3. Case Studies

  4. Further Readings