AIF-C01 notes
AI use cases and applications

Business Metrics for Generative AI

Model accuracy alone doesn't show value. Business metrics tie a generative AI application to outcomes and ROI, and the right metric depends on the use case.

MetricWhat it tells youTypical use case
User satisfactionHow users rate the generated content or recommendationsCustomer support, e-commerce sites
Average revenue per user (ARPU)Revenue generated per userPersonalized recommendations and upselling
Cross-domain performanceHow well the model handles different domains or tasksAssistants used across departments
Conversion rateShare of users who complete a desired action, such as a purchaseMarketing content, product recommendations
EfficiencyTime, cost, or resources savedAutomating document or content work

The full notes captured only the first slide (user satisfaction). The other metrics follow the AWS course.

For customer support, the best measure of success is customer satisfaction, not revenue metrics.