AIF-C01 ยท GenAI strengths, limits and AWS services
Measuring GenAI business value
ROI, efficiency, conversion rate, average revenue per user, accuracy, customer lifetime value and cross-domain performance as success measures.
Key points
- Compare against a baseline measured before launch.
- ROI: gain versus total cost.
- Efficiency: time or cost saved per task.
- Conversion rate: share of visitors who buy or sign up.
- ARPU: average revenue per user.
- Customer lifetime value: total value of a customer over the relationship.
- Accuracy: correct outputs.
- Cross-domain performance: how well one solution works across different areas.
Practice questions
Which metric measures the share of website visitors who complete a desired action such as a purchase?
- Conversion rate
- Average revenue per user
- Return on investment
- Customer lifetime value
Show answer
Answer: A. Conversion rate
That is the conversion rate. ARPU is revenue per user, and ROI compares gain with cost.
An online shop adds a GenAI product recommender. Which metrics would show its commercial impact?
- Conversion rate of visitors who see recommendations
- Average revenue per user
- Colour contrast of the product page
- Number of GPU hours used in training
- Length of the recommender's source code
Show answer
Answer: A. Conversion rate of visitors who see recommendations, B. Average revenue per user
Conversion rate and average revenue per user reflect purchasing behaviour. Server uptime and font size are not measures of commercial impact from recommendations.
True or false: ROI for a GenAI project should count only the model's usage fees, not staff time, integration work or monitoring.
Show answer
Answer: False
False. ROI compares benefit with total cost, including people, integration, evaluation and ongoing operation.
Practice 8 questions on this topic in Bitzu
Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.
