Two Way Parameter Sensitivity

Parameter Sensitivity analysis is the analysis of how sensitive the results of a belief update (propagation of evidence) is to variations of the value of a parameter of the model. The parameters of a model are the entries of the conditional probability distributions.

The two way parameter sensitivity analysis observes the resultes of a belief update to variations of the values of two parameters of the model. The parameter values could be entries of the conditional probability distribution from one or two nodes.

Two way sensitivity analysis

The Two Way (P.S) panel performs parameter sensitivity analysis with values from two parameters of the model. On the top left corner there are four drop down boxes that accept user input.

  • “Hypothesis variable” : Select the node to be observed.

  • “State” : Select the state of the hypothesis node to be observed. To observe all states check the “All states” check box.

  • “Parameter 1” : Select the node from which we will select parameter values. The probability distribution table (CPT) of the selected node is displayed in the middle of the panel. To perform sensitivity analysis on changes to two parameter values from the same CPT, select two values in the CPT and press “compute”. The results are shown in the information table and the 3D graph, simular to the Parameter Sensitivity Panel.

  • “Parameter 2” : To perform parameter sensitivity analysis on changes to two parameter values from two CPTs, check the check box next to “Parameter 2” drop down box to enable it. Selecting a second node in this drop down will display a tabbed panel in the middle of the Two Way (P.S) Panel that holds two CPTs. Select one parameter value in each CPT and press “compute”.

../../../_images/twoway.png

Figure 1: Parameter Sensitivity Analysis

When performing parameter sensitivity analysis with two parameters from the same CPT the information table displayed includes the following columns:

  • State: The state of the hypothesis node.

  • CPT1, CPT2: The first and the second parameters selected in the CPT.

  • Result: The belief of the given state of the hypothesis.

  • \(\alpha\), \(\alpha_1\), \(\beta\), \(\gamma\), \(\gamma_1\), \(\delta\): Sensitivity constants.

  • Sensitivity value1: The sensitivity value of the current states to changes of the value of the first parameter (CPT1). The sensitivity value1 is computed based on the function:

\[\frac{(\alpha_1 * \gamma_2 - \alpha_2 * \gamma_1) * cpt_2 + \alpha_1 * \delta - \gamma_1 * \beta}{(\gamma_1 * cpt_1 + \gamma_2 * cpt_2 + \delta)^2}\]
  • Sensitivity value2: The sensitivity value of the current states to changes of the value of the second parameter (CPT2). The sensitivity value2 is computed based on the function:

\[\frac{(\alpha_2 * \gamma_1 - \alpha_1 * \gamma_2) * cpt_1 + \alpha_2 * \delta - \gamma_2 * \beta}{(\gamma_1 * cpt_1 + \gamma_2 * cpt_2 + \delta)^2}\]

The sensitivity function used to generate the 3D graph is: \(\frac{\alpha_1 * cpt_1 + \alpha_2 * cpt_2 + \beta}{\gamma_1 * cpt_1 + \gamma_2 * cpt_2 + \delta}\)

The Sensitivity values are currntly not computed when performing parameter sensitivity analysis with two parameters from two CPTs.

Import a case file

It is possible to perform parameter sensitivity analysis after importing cases from a case file or a database. The “Data Source” button imports cases in the wizard and gives the user the option of selecting a case to be entered as evidence in the domain. Sensitivity analysis can now be performed for each case in the file. In Figure 2, a case file is imported and displayed as a table. When clicking on a case, it is entered as evidence in the domain and after performing sensitivity analysis as shown above (Figure 1), the sensitivity values calculated and the lines in the graph, are different because the new evidence is taken in to consideration.

Sensitivity analysis can not be performed on a hypothesis node with evidence entered. To avoid error messages, the node names of nodes with evidence are marked with (e) in the Hypothesis Variable Combo.

Across Cases

When cases are loaded in the wizard, it is possible to perform parameter sensitivity analysis across many cases. Selecting all (Ctrl-A) or some cases in the cases table (Figure 2) and then computing the sensitivity for the selected hypothesis and parameters, will generate a table in the information panel that displays the results for all cases. Each row in the table shows the results of the parameter sensitivity analysis for the selected state of the hypothesis, in each case. It is not possible to compute sensitivity for all states of the hypothesis across cases. No results are shown for cases where the computation has failed (fx. when evidence is entered in the hypothesis).

../../../_images/twoway1.png

Figure 2: Sensitivity computed across cases.

The information table in addition to the Sensitivity Value, also displays the Parameter Importance value as it adjusts through every case. The parameter importance value at the last row is the final one computed after going through all cases. The parameter importance value is currently not computed when performing parameter sensitivity analysis with two parameters from two CPTs.

Selecting a row in the info table will show the Sensitivity function graph for the selected case.