Administer > Smart Analytics administration > Administrator tasks > Work with Smart Ticket tuning > Use the Confusion Matrix tool > Category Tuning form

Category Tuning form

In a Confusion Matrix, category IDs in both the column headers and the row headers are clickable. You can click a category ID in a Confusion Matrix to open a Category Tuning form.

This form contains the following fields or tabs.

Field / Tab Description
Category The ID of the current category.
Categorizer The Smart Ticket task that is used for this test round.
Category Name The name of the current category.
Document Count The total number of documents within this category.
Training Document The number of documents used to train this category.
Category Trainings

In this tab, you can find all training documents for this category, as well as their ticket ID, status and training text.

  • You can use the Add Training Document button to add more documents or the Delete Training Document button to delete existing documents, and then click the Apply Changes button to tune this category.
  • The Confusion Matrix tool can help you decide which tickets should be deleted by calculating the relevance of chosen tickets against the current category. You can select training tickets and click the Evaluate Relevance button to get the results.
Testing Samples

This tab contains all tickets used to test this category, as well as their ticket ID, title, and body.

  • You can use the Add Test Sample button to add more documents to trigger a new round of test.
  • You can also use the Delete Test Sample button to delete any existing test samples that are appropriate for this category.
Category Terms

This tab contains all terms related to the current category, and their weights.

  • You can add new terms to the system with a specified weight by using the Add Term button.
  • You can modify the weight for existing terms by specify a new weight in the Modified Term Weight column and the clicking Save Term Weights. Such modifications will adjust the classification results regarding this category.
  • You can use the Reset Terms button to revert the weights of all terms to their generated term weights. This will revert your manual term weight changes.
  • You can choose one term and click the View Selected Term Occurrence button to see the exact places where this term occurs.
  • You can use the View History button to view all category tuning snapshots of the current category.

Note

  • The Weight column indicates the current weight of the term, the Generated Term Weight column indicates the system-generated weight for the term, and the Modified Term Weight column allows you to specify a new weight for the term.
  • Term weights may change accordingly after training with new training samples; however, if you adjust a term weight manually, it becomes a fixed value and will not be automatically changed.

  • If a term is a stop word after stemming, the system displays the following error message when you click this term:

    No valid query text supplied All terms were invalid, through being stop words, too short, or incorrectly formatted.