Glossary
Glossary of terms used in the Maven dashboard.
Quality
Maven Quality is a measurement of Maven’s confidence in its own answer. There are three categories of quality:
- Good: Maven’s self-assessment is that the answer was both correct and of high quality
- Needs Improvement: Maven could not confidently answer the question due to a lack of knowledge or because the end user gave the interaction a thumbs down.
- Ineligible/Pending: Ineligible conversations are those where the user cancels the conversation mid-answer or a question was considered an attack attempt and was blocked.
How Maven Quality is Calculated
Maven Quality takes the following signals into account:
- Automatic self grading: Maven has a self-grading mechanism that determines how confident it is based on how much relevant information it has in knowledge and actions
- Automatic grading against human responses: where human agent responses are available they can be compared to Maven’s own response
- Human feedback: user provided thumbs up and down feedback serves is a strong signal of quality