AIF-C01 ยท Responsible and explainable AI
Transparent and explainable models
Transparent versus opaque models, SageMaker Model Cards, open source models and licensing, the safety versus transparency tradeoff and human-centered explainable design.
Key points
- Transparent model: can be inspected and understood (linear model, decision tree).
- Opaque model: a black box such as a deep neural network; needs explanation.
- Amazon SageMaker Model Cards: intended uses, risk rating, training details, evaluation results.
- Open source models: visibility, but licences you must read.
- Interpretability versus performance tradeoff: simpler models are easier to explain, may be less accurate.
Source: https://docs.aws.amazon.com/sagemaker/latest/dg/model-cards.html
Practice questions
What is the main purpose of an Amazon SageMaker Model Card?
- To document key details of a model in one place for governance and reporting
- To host the model for real-time inference
- To automatically retrain the model nightly
- To encrypt the model artifacts
Show answer
Answer: A. To document key details of a model in one place for governance and reporting
A model card records intended use, risk rating, training and evaluation details in one place for governance. It does not train or host the model.
Which items typically belong in a SageMaker Model Card?
- Intended and not-intended uses of the model
- The monthly AWS invoice
- A risk rating such as low, medium or high
- Training details and evaluation results
- Security group rules for the VPC
Show answer
Answer: A. Intended and not-intended uses of the model, C. A risk rating such as low, medium or high, D. Training details and evaluation results
Cards capture intended uses, risk rating and training and evaluation details. Billing invoices and network firewall rules are not part of model documentation.
True or false: an open source model can be used for any purpose with no conditions, because its weights are public.
Show answer
Answer: False
Open source and open-weight models still ship with licences that may restrict commercial use, redistribution or specific applications. Always read the licence.
Practice 8 questions on this topic in Bitzu
Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.
