AIF-C01 notes
Optimizing foundation models

Business Case

AnyCompany, a telecom provider, wants a generative AI support chatbot to cut the cost of phone support and the load of online tickets.

  • Goals: reduce online tickets by 70% and reach a customer satisfaction score of at least 4 out of 5, measured by a survey after each issue.
  • Model: an LLM, because the chatbot needs to understand natural language.
  • Problem: LLMs are trained on public data and don't know AnyCompany's services.
  • Fix, part 1: give the model company knowledge from chat logs, past tickets, and call recordings. That data must be collected, anonymized, and cleansed into a knowledge base. This is RAG.
  • Fix, part 2: let the chatbot take actions in customer accounts, such as ordering a phone or upgrading a plan. This is agents.