Bitzu

AIF-C01 ยท ML lifecycle, MLOps and metrics

Model sources and ways to use a model

Open source pre-trained models versus custom training, and consuming a model through a managed API versus a self-hosted endpoint.

Key points

  • Pre-trained (often open source) model: reuse or fine-tune it; cheaper and faster.
  • Custom model from scratch: when you need full control and have the data.
  • Managed API such as Amazon Bedrock: no servers to run, pay per use.
  • SageMaker AI endpoint: host the model yourself; more control over instance, container and scaling, more to operate.

Source: https://docs.aws.amazon.com/bedrock/latest/userguide/what-is-bedrock.html

Practice questions

Single choice

Which service gives API access to foundation models without you managing any model-serving infrastructure?

  1. Amazon Bedrock
  2. A self-managed Amazon EC2 GPU fleet
  3. A SageMaker AI endpoint you size yourself
  4. Amazon S3
Show answer

Answer: A. Amazon Bedrock

Amazon Bedrock is a fully managed service exposing foundation models through an API. A SageMaker AI endpoint and EC2 both require you to choose and operate the compute.

Select all that apply

Which are advantages of starting from a pre-trained model instead of training from scratch?

  1. Less training data is typically needed
  2. Shorter time to a working prototype
  3. Complete control over every training example
  4. Guaranteed higher accuracy on any domain
  5. No licence terms to check
Show answer

Answer: A. Less training data is typically needed, B. Shorter time to a working prototype

Pre-trained models usually need far less data, time and compute. Full control over training data and guaranteed best accuracy on every niche task are not guaranteed benefits.

True or false

An open source pre-trained model can always be used commercially without reading its licence.

Show answer

Answer: False

False. Open source models ship under different licences, some with commercial or usage restrictions, so licence terms must be checked.

Practice 8 questions on this topic in Bitzu

Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.

Download on the App StoreGet it on Google Play

More AIF-C01 topics in this module