Bitzu

AIF-C01 ยท GenAI strengths, limits and AWS services

Measuring GenAI business value

ROI, efficiency, conversion rate, average revenue per user, accuracy, customer lifetime value and cross-domain performance as success measures.

Key points

  • Compare against a baseline measured before launch.
  • ROI: gain versus total cost.
  • Efficiency: time or cost saved per task.
  • Conversion rate: share of visitors who buy or sign up.
  • ARPU: average revenue per user.
  • Customer lifetime value: total value of a customer over the relationship.
  • Accuracy: correct outputs.
  • Cross-domain performance: how well one solution works across different areas.

Practice questions

Single choice

Which metric measures the share of website visitors who complete a desired action such as a purchase?

  1. Conversion rate
  2. Average revenue per user
  3. Return on investment
  4. Customer lifetime value
Show answer

Answer: A. Conversion rate

That is the conversion rate. ARPU is revenue per user, and ROI compares gain with cost.

Select all that apply

An online shop adds a GenAI product recommender. Which metrics would show its commercial impact?

  1. Conversion rate of visitors who see recommendations
  2. Average revenue per user
  3. Colour contrast of the product page
  4. Number of GPU hours used in training
  5. Length of the recommender's source code
Show answer

Answer: A. Conversion rate of visitors who see recommendations, B. Average revenue per user

Conversion rate and average revenue per user reflect purchasing behaviour. Server uptime and font size are not measures of commercial impact from recommendations.

True or false

True or false: ROI for a GenAI project should count only the model's usage fees, not staff time, integration work or monitoring.

Show answer

Answer: False

False. ROI compares benefit with total cost, including people, integration, evaluation and ongoing operation.

Practice 8 questions on this topic in Bitzu

Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.

Download on the App StoreGet it on Google Play

More AIF-C01 topics in this module