Bitzu

AIF-C01 ยท Responsible and explainable AI

Transparent and explainable models

Transparent versus opaque models, SageMaker Model Cards, open source models and licensing, the safety versus transparency tradeoff and human-centered explainable design.

Key points

  • Transparent model: can be inspected and understood (linear model, decision tree).
  • Opaque model: a black box such as a deep neural network; needs explanation.
  • Amazon SageMaker Model Cards: intended uses, risk rating, training details, evaluation results.
  • Open source models: visibility, but licences you must read.
  • Interpretability versus performance tradeoff: simpler models are easier to explain, may be less accurate.

Source: https://docs.aws.amazon.com/sagemaker/latest/dg/model-cards.html

Practice questions

Single choice

What is the main purpose of an Amazon SageMaker Model Card?

  1. To document key details of a model in one place for governance and reporting
  2. To host the model for real-time inference
  3. To automatically retrain the model nightly
  4. To encrypt the model artifacts
Show answer

Answer: A. To document key details of a model in one place for governance and reporting

A model card records intended use, risk rating, training and evaluation details in one place for governance. It does not train or host the model.

Select all that apply

Which items typically belong in a SageMaker Model Card?

  1. Intended and not-intended uses of the model
  2. The monthly AWS invoice
  3. A risk rating such as low, medium or high
  4. Training details and evaluation results
  5. Security group rules for the VPC
Show answer

Answer: A. Intended and not-intended uses of the model, C. A risk rating such as low, medium or high, D. Training details and evaluation results

Cards capture intended uses, risk rating and training and evaluation details. Billing invoices and network firewall rules are not part of model documentation.

True or false

True or false: an open source model can be used for any purpose with no conditions, because its weights are public.

Show answer

Answer: False

Open source and open-weight models still ship with licences that may restrict commercial use, redistribution or specific applications. Always read the licence.

Practice 8 questions on this topic in Bitzu

Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.

Download on the App StoreGet it on Google Play

More AIF-C01 topics in this module