Access Confusion Matrix data

The Confusion Matrix tool analyzes data against a Smart Ticket task. Follow these steps to view confusion matrix data for a Smart Ticket task:

  1. Go to System Administration > Ongoing Maintenance > Smart Analytics > Smart Ticket.
  2. Select a Smart Ticket task from the list, and then click Visualize.

    Note  

    • This Visualize functionality is available only after you run a test against the categorizer (Smart Ticket task).
    • If your Service Manager is in the multi-company mode and you have added multiple companies to the Smart Ticket task, you need to select a company after you click Visualize.
  3. If needed, modify the following settings for Confusion Matrix.

    Field Description
    Top N Categories

    This field indicates how many categories you want to analyze with the Confusion Matrix tool. For example, if you select a value of 10, only the top 10 categories in your data distribution analysis report will be analyzed.

    Note

    • Selecting a large number of categories may lead to slow page rendering. Normally, you need to take care of your major categories only.
    • Both the row number and the column number in a Confusion matrix are less than the minimum value of the current predictable category count and the Top N Categories value. If the previous testing version has unpredictable categories, the number of rows and columns in the Confusion Matrix based on the previous test result will not match the Top N Categories settings.

      For example, there are 13 categories in the first round testing result. The system administrator changes the data source coverage from 90 to 50, and then only 7 categories are predictable. Consequently, after training and testing, the system displays a 7*7 Confusion Matrix table for both the first round and the second round testing result even though the system administrator sets the Top N Categories value to 13.

    Display Format

    There are two options:

    • By Error Count: Show the confusion matrix data by number of error tickets.
    • By Error Ratio (%): Show the confusion matrix data by test error ratio (percentage).
    Medium Error Threshold

    This is the minimum error count or error ratio (depending on the display format) that you want to assign a medium severity.

    In the Confusion Matrix table, numeric values between this field value and the High Error Threshold value are highlighted in yellow.
    High Error Threshold

    This is the minimum error count or error ratio (depending on the display format) that you want to assign a high severity.

    Note In the Confusion Matrix table, numeric values no less than this field value are highlighted in red.

  4. Click Confusion Matrix to view the Confusion Matrix results.