AIF-C01 ยท GenAI strengths, limits and AWS services
Cost trade-offs of AWS GenAI services
On-demand token pricing versus provisioned throughput, custom models, regional coverage, availability and redundancy, and the advantages of managed GenAI services.
Key points
- On-demand: charged per token processed, no commitment; for spiky or unknown traffic.
- Provisioned Throughput: reserves model units billed hourly; an optional 1- or 6-month commitment lowers the rate; for steady, high volume.
- Custom model in Bedrock: requires Provisioned Throughput.
- Also: models differ by Region, availability and redundancy, no servers to run with managed services.
Source: https://docs.aws.amazon.com/bedrock/latest/userguide/prov-throughput.html
Practice questions
With on-demand pricing for a Bedrock text model, what is the main billing unit?
- Tokens processed, with no upfront commitment
- Hours of reserved model units
- Number of IAM users in the account
- Gigabytes of training data stored
Show answer
Answer: A. Tokens processed, with no upfront commitment
On-demand text model usage is billed by the tokens processed (input and output), with no upfront commitment.
Which facts about Provisioned Throughput in Amazon Bedrock are correct?
- It is billed hourly based on model and number of model units
- Longer commitment terms lower the hourly price
- It is the only option that has no hourly billing
- It cannot be used with customized models
- It stops billing automatically when idle
Show answer
Answer: A. It is billed hourly based on model and number of model units, B. Longer commitment terms lower the hourly price
It is billed hourly per model unit, and longer commitments lower the hourly price. Custom models must use it, and it is not billed per token with no commitment.
True or false: a model customized in Amazon Bedrock can be invoked on-demand like any base model, with no Provisioned Throughput.
Show answer
Answer: False
False. According to the Bedrock documentation, a customized model requires purchasing Provisioned Throughput to be used.
Practice 8 questions on this topic in Bitzu
Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.
