Virtual Assistant Metrics Quiz
40 Questions
0 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What metric displays the number of service catalog items used in intents active fulfillments?

  • Total Action Flows
  • Total Conversation Flows
  • Total Custom Messages
  • Total Service Catalog (correct)

    • The Total Action Flows metric shows the number of knowledge articles utilized.

    False

    How many minutes are assumed to be saved for employees per issue resolved by the bot?

    60 minutes

    The metric that provides the percentage of utilized knowledge articles is called _____ Articles Utilization.

    <p>Knowledge</p> Signup and view all the answers

    Match the following metrics with their descriptions:

    <p>Total Time Saved for Employees = Shows time savings for employees per resolved issue Fulfillments Breakdown = Displays count and percentage of supervised vs. unsupervised fulfillments Action Flows Utilization = Shows number of action flows utilized in requests Top Fulfillments = Displays the most frequently used fulfillments in requests</p> Signup and view all the answers

    What does the term 'Total Active Users' refer to?

    <p>Users who have engaged with the virtual assistant during a time period</p> Signup and view all the answers

    The metric for New Users is populated when a user's details do exist in the Aisera application.

    <p>False</p> Signup and view all the answers

    What captures the details of the workflow and shows how many requests were completed?

    <p>Flows Completion</p> Signup and view all the answers

    The metric that captures the count of users from various locations interacting with the virtual assistant is called _____

    <p>User Locations</p> Signup and view all the answers

    Match the metrics with their definitions:

    <p>VIP Users = Total number of special users engaging with the assistant Live Users = Count of users engaging with the virtual assistant in real time Device Types = User devices that interact with the chatbot Number of Requests by Top Users = Breakdown of users who have engaged the most</p> Signup and view all the answers

    What does the 'Total Active Users over Time' metric capture?

    <p>The trend of users interacting with the assistant during a selected period</p> Signup and view all the answers

    The Device Platforms metric captures the devices used by users to contact the virtual assistant.

    <p>True</p> Signup and view all the answers

    What does the Knowledge Analytics dashboard help track?

    <p>Document ingestion and click-through rates</p> Signup and view all the answers

    The Knowledge Article Utilization Rate measures the total number of articles served by the bot.

    <p>False</p> Signup and view all the answers

    What does CTR stand for in the context of Knowledge Article metrics?

    <p>Click-Through Rate</p> Signup and view all the answers

    The ______ captures the user's browser type when interacting with the virtual assistant.

    <p>Browsers</p> Signup and view all the answers

    Which of the following is not a metric tracked by the Knowledge Analytics dashboard?

    <p>User email interactions</p> Signup and view all the answers

    Average Click-Through Rate is calculated by dividing the total CTR of articles by the number of articles.

    <p>True</p> Signup and view all the answers

    What is meant by Top Knowledge Gaps in the context of unresolved conversations?

    <p>It refers to the breakdown of knowledge gaps identified from conversations that were not resolved.</p> Signup and view all the answers

    To improve the virtual assistant's performance, tracking ______ can highlight areas for enhancement.

    <p>knowledge gaps</p> Signup and view all the answers

    What does MTTR stand for?

    <p>Mean Time To Resolution</p> Signup and view all the answers

    Active Tickets count includes all tickets created regardless of their status.

    <p>False</p> Signup and view all the answers

    What does the Tickets by Priority measure?

    <p>It captures the number of tickets created, broken down by priorities as defined in the system of record.</p> Signup and view all the answers

    The _______ dashboard is used to track Intents, Entities, and Fulfillments.

    <p>App Performance</p> Signup and view all the answers

    Match the following ticket metrics with their descriptions:

    <p>Total Tickets = Captures the count of total tickets created for a given time period. Active Tickets = Captures the count of tickets from an active system of record. Tickets over Time = Captures ticket count trend over a period of time. MTTR over Time = Captures the MTTR trend over a period of time.</p> Signup and view all the answers

    Which of the following describes Total Intents?

    <p>Total number of active intents that understand the user's request.</p> Signup and view all the answers

    The App Performance dashboard does not track Fulfillments.

    <p>False</p> Signup and view all the answers

    What is indicated by MTTR over Time?

    <p>It captures the Mean Time To Resolution trend over a period of time.</p> Signup and view all the answers

    The dashboard used to analyze ticket trends is called the _______.

    <p>Tickets over Time</p> Signup and view all the answers

    What is Total Entities in the context of the App Performance dashboard?

    <p>The total number of active Entities that have been created in the system</p> Signup and view all the answers

    What does the Intents Utilization metric represent?

    <p>The percentage of total intents used in user requests</p> Signup and view all the answers

    The Top Intents chart displays the least used intents in requests.

    <p>False</p> Signup and view all the answers

    What does the Entities Utilization metric indicate?

    <p>It indicates the percentage of total entities that have been utilized for all user requests.</p> Signup and view all the answers

    The _____ Utilization metric captures the percentage of action-flows that have been utilized in serving requests.

    <p>Fulfillments</p> Signup and view all the answers

    Match the following terms with their corresponding explanations:

    <p>Intents Utilization = Percentage of total intents used in user requests Entities Utilization = Percentage of total entities used in user requests Top Intents = Most frequently used intents in conversations Fulfillments Utilization = Percentage of action flows utilized in requests</p> Signup and view all the answers

    Which of the following provides additional details about an identified intent?

    <p>Hovering over the intent bar graph</p> Signup and view all the answers

    Knowledge articles are not part of the active fulfillments.

    <p>False</p> Signup and view all the answers

    What do users see when they click on the Top Entities chart?

    <p>Additional details like the name of the entity and the number of requests it was identified in.</p> Signup and view all the answers

    The metric for _____ shows the total number of knowledge articles used in active fulfillments.

    <p>Total Knowledge Articles</p> Signup and view all the answers

    Which metric would you check to see how many action flows have been utilized?

    <p>Fulfillments Utilization</p> Signup and view all the answers

    Study Notes

    Aisera Analytics Overview

    • Aisera Analytics is a tool for configuring and leveraging metrics using Aisera's Analytics capability.
    • The document is dated May 2024.
    • AISERA is a company providing generative AI for businesses.

    Table of Contents

    • The document contains a comprehensive table of contents listing various topics and their respective page numbers.
    • Topics include Overview, Introducing Aisera Analytics, Types of Dashboards, Requests, Sessions and more.
    • The table of contents highlights pre-built analytics, requests, sessions, users, knowledge, tickets, app performance and business metrics.

    Pre-Built Analytics

    • Pre-Built Analytics pages contain OOTB Dashboards.
    • Key dashboards included: Requests, Sessions, Users, Knowledge, Tickets, Application Performance, and Business Metrics.

    Requests

    • The Requests dashboard provides metrics on user-app interactions.
    • Some key metrics are Resolution Rate, Not Helpful Rate, Abandoned Rate, Escalation Rate, Assisted Rate, and total requests.
    • Resolution rate over time and requests over time are also relevant metrics.

    Sessions

    • The Sessions dashboard provides insights from user-virtual assistant interactions.
    • Key metrics include total sessions, average daily sessions, live sessions, and average session duration.

    Users

    • The Users dashboard tracks user engagement with the virtual assistant.
    • Metrics are focused on total users, new users, live users, VIP users and user locations.

    Knowledge

    • The Knowledge dashboard tracks knowledge document usage and click-through rates.
    • Metrics include total knowledge documents and knowledge article utilization rate .

    Tickets

    • The Tickets dashboard monitors ticket-related metrics like total tickets, active tickets, and MTTR.
    • Other metrics shown are mean time to resolution, ticket priorities and types.

    App Performance

    • The App Performance dashboard shows overall virtual assistant performance.
    • Key metrics include active intents, entities, and fulfillments.

    Business Metrics

    • The Business Metrics dashboard displays key indicators for user productivity, agent impact, and avoided costs.

    Tenant Configuration

    • Resolution Rate is a key KPI for customers calculated on tenant-level configuration.
    • Configuration is done through the Admin UI → Settings → Configuration.

    Total Sessions

    • Total sessions metric measures the total number of user sessions within a given time.

    ESAT

    • ESAT captures the average End User Satisfaction score within a specific time period.

    Average Session Duration

    • This captures time duration from user interaction to session end.

    Total Requests

    • This shows the total number of conversation requests.

    Average Daily Requests

    • This captures average daily number of conversation requests.

    Average Conversation Duration

    • This measures average duration of all conversations.

    Average Session Requests

    • This identifies average number of conversations per session.

    Average User Session

    • Shows the average number of conversations sessions.

    Top Intents

    • A metric to show the most frequently used intents.

    Intents Usage and Engagement

    • Shows intents per user session.

    Flows Completion

    • Shows the workflow details.

    Total Intents

    • The metric represents total active intents in the application.

    Total Entities

    • The metric indicates total active entities in the application.

    Total Fulfillments

    • The metric identifies total active fulfillments in the application.

    Top Knowledge Articles

    • The metric shows the total knowledge articles used in active fulfillments.

    Total Conversation Flows

    • The metric represents the number of conversation flows used in active fulfillments.

    Top Entities

    • The metric displays top utilized entities in user conversations.

    Total Service Catalog

    • The metric shows the number of service catalog items used in fulfilling intents.

    Total Custom Messages

    • The metric represents total custom messages utilized in fulfilling intents.

    Knowledge Articles Utilization

    • The percentage of used knowledge articles is shown.

    Conversation Flows Utilization

    • The metric shows the number of knowledge flows used in the requests.

    Action Flows Utilization

    • The metric shows how many action flows have been used.

    Service Catalog Utilization

    • The number of service catalog items used is listed.

    Custom Messages Utilization

    • The number of custom messages used is shown.

    Fulfillment Breakdown

    • The pie chart displays fulfillment breakdown, either Supervised or Unsupervised.

    Total Fulfillments by Source

    • The percentage of total fulfillments from each source is displayed.

    Top Fulfillments

    • The pie chart displays the most commonly used fulfillment types in conversations.

    Business Metrics

    • The metrics within this section show business efficiency in the use of the chatbot.
    • Metrics include the cost and time saved for employees.

    Agent Impact

    • Measures the time saved by agents from reduced workloads.
    • Illustrates work elimination via the chatbot.

    Avoided Cost

    • Measures the amount of support cost that has been reduced by the chatbot.

    Custom Analytics

    • Custom Analytics allows users to create their own reports and KPIs.
    • Metrics include conversations, by different categories, like country or channel.

    ###Top Flow Gaps

    • Visualizes flows served as fulfillments and categorizes them as terminal or non-terminal.

    Top Intents with KB Gaps

    • Shows intents mapped to knowledge docs served as fulfillment in requests.
    • Top recommended actions to address knowledge gaps with the chatbot.

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Related Documents

    Aisera Analytics PDF

    Description

    Test your knowledge on metrics related to virtual assistants and their usage. This quiz covers various metrics, including total active users, knowledge articles utilization, and action flows. Perfect for those looking to deepen their understanding of virtual interaction metrics.

    More Like This

    Use Quizgecko on...
    Browser
    Open
    Browser
    Browser