Classification Insights | CSIS Dashboard

Avg Accuracy

55.3%

Avg Precision

74.8%

Avg Recall

62.1%

Avg F1

65.7%

Avg ROC AUC

51.7%

Top Predictors

Model Interpretation

Values summarize saved decision-tree classification outputs. Feature importance indicates which respondent traits or cluster dimensions were most useful for predicting the selected service-stage indicators.

ChildandYouthWelfareProgram
MCA Dim1 0.4192
ChildandYouthWelfareProgram
MCA Dim2 0.33
ChildandYouthWelfareProgram
Cluster 3 0.0895
Women’s Welfare Program
MCA Dim2 0.4059
Women’s Welfare Program
MCA Dim1 0.3347
Women’s Welfare Program
A5 College Undergrad 0.0701
PersonswithDisabilities (PWD)Welfare Program
MCA Dim1 0.4508
PersonswithDisabilities (PWD)Welfare Program
MCA Dim2 0.3505

Simplified Decision Tree Explorer

The simplified tree uses feature selection first: top predictors are selected from feature importance, then a smaller decision tree is retrained with limited depth for easier interpretation.

Indicator Top Predictors

Current tree: F1_FSSi - ChildandYouthWelfareProgram

MCA Dim1 MCA Dim2 MCACluster A5 A1

|--- Dim2 <= -1.14
|   |--- Dim2 <= -1.19
|   |   |--- Dim1 <= -0.61
|   |   |   |--- class: Aware
|   |   |--- Dim1 >  -0.61
|   |   |   |--- class: Not Aware
|   |--- Dim2 >  -1.19
|   |   |--- Dim1 <= -0.88
|   |   |   |--- class: Aware
|   |   |--- Dim1 >  -0.88
|   |   |   |--- class: Aware
|--- Dim2 >  -1.14
|   |--- MCACluster_2 <= 0.50
|   |   |--- Dim1 <= -0.64
|   |   |   |--- class: Aware
|   |   |--- Dim1 >  -0.64
|   |   |   |--- class: Not Aware
|   |--- MCACluster_2 >  0.50
|   |   |--- Dim2 <= 1.51
|   |   |   |--- class: Aware
|   |   |--- Dim2 >  1.51
|   |   |   |--- class: Not Aware

Gini Split Diagnostics

Node	Type	Rule	Gini	Samples	Not Aware	Aware	Prediction
0	Split	Dim2 <= -1.140	0.5	4350	0.5	0.5	Aware
1	Split	Dim2 <= -1.193	0.4881	961	0.4	0.6	Aware
2	Split	Dim1 <= -0.614	0.4972	761	0.5	0.5	Aware
3	Leaf	Prediction	0.4708	334	0.4	0.6	Aware
4	Leaf	Prediction	0.4994	427	0.5	0.5	Not Aware
5	Split	Dim1 <= -0.885	0.3374	200	0.2	0.8	Aware
6	Leaf	Prediction	0.0	45	0.0	1.0	Aware
7	Leaf	Prediction	0.3877	155	0.3	0.7	Aware
8	Split	MCACluster_2 <= 0.500	0.4993	3389	0.5	0.5	Not Aware
9	Split	Dim1 <= -0.641	0.4919	1780	0.6	0.4	Not Aware
10	Leaf	Prediction	0.4997	418	0.5	0.5	Aware
11	Leaf	Prediction	0.4862	1362	0.6	0.4	Not Aware
12	Split	Dim2 <= 1.512	0.497	1609	0.5	0.5	Aware
13	Leaf	Prediction	0.4955	1580	0.5	0.5	Aware
14	Leaf	Prediction	0.383	29	0.7	0.3	Not Aware

Show technical full tree

|--- Dim1 <= 1.28
|   |--- MCACluster_3 <= 0.50
|   |   |--- A1_Boarder <= 0.50
|   |   |   |--- Dim1 <= -0.24
|   |   |   |   |--- Dim2 <= -1.13
|   |   |   |   |   |--- Dim1 <= -0.70
|   |   |   |   |   |   |--- class: Aware
|   |   |   |   |   |--- Dim1 >  -0.70
|   |   |   |   |   |   |--- class: Aware
|   |   |   |   |--- Dim2 >  -1.13
|   |   |   |   |   |--- Dim2 <= -1.12
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |   |   |--- Dim2 >  -1.12
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |--- Dim1 >  -0.24
|   |   |   |   |--- Dim1 <= -0.22
|   |   |   |   |   |--- class: Aware
|   |   |   |   |--- Dim1 >  -0.22
|   |   |   |   |   |--- Dim2 <= 1.38
|   |   |   |   |   |   |--- class: Aware
|   |   |   |   |   |--- Dim2 >  1.38
|   |   |   |   |   |   |--- class: Not Aware
|   |   |--- A1_Boarder >  0.50
|   |   |   |--- class: Not Aware
|   |--- MCACluster_3 >  0.50
|   |   |--- Dim2 <= -0.35
|   |   |   |--- class: Aware
|   |   |--- Dim2 >  -0.35
|   |   |   |--- Dim1 <= 0.04
|   |   |   |   |--- Dim1 <= -0.18
|   |   |   |   |   |--- A1_Spouse/ Partner <= 0.50
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |   |   |--- A1_Spouse/ Partner >  0.50
|   |   |   |   |   |   |--- class: Aware
|   |   |   |   |--- Dim1 >  -0.18
|   |   |   |   |   |--- A5_College Undergrad <= 0.50
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |   |   |--- A5_College Undergrad >  0.50
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |--- Dim1 >  0.04
|   |   |   |   |--- class: Aware
|--- Dim1 >  1.28
|   |--- Dim2 <= -1.16
|   |   |--- Dim2 <= -1.49
|   |   |   |--- class: Aware
|   |   |--- Dim2 >  -1.49
|   |   |   |--- class: Aware
|   |--- Dim2 >  -1.16
|   |   |--- Dim1 <= 1.81
|   |   |   |--- A5_ Hi-Sch Undergraduate <= 0.50
|   |   |   |   |--- Dim2 <= -0.56
|   |   |   |   |   |--- class: Not Aware
|   |   |   |   |--- Dim2 >  -0.56
|   |   |   |   |   |--- Dim2 <= -0.38
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |   |   |--- Dim2 >  -0.38
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |--- A5_ Hi-Sch Undergraduate >  0.50
|   |   |   |   |--- class: Aware
|   |   |--- Dim1 >  1.81
|   |   |   |--- Dim1 <= 3.05
|   |   |   |   |--- Dim2 <= -0.72
|   |   |   |   |   |--- class: Not Aware
|   |   |   |   |--- Dim2 >  -0.72
|   |   |   |   |   |--- Dim1 <= 1.99
|   |   |   |   |   |   |--- class: Aware
|   |   |   |   |   |--- Dim1 >  1.99
|   |   |   |   |   |   |--- class: Aware
|   |   |   |--- Dim1 >  3.05
|   |   |   |   |--- B1_No <= 0.50
|   |   |   |   |   |--- A5_ Hi-Sch Undergraduate <= 0.50
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |   |   |--- A5_ Hi-Sch Undergraduate >  0.50
|   |   |   |   |   |   |--- class: Aware
|   |   |   |   |--- B1_No >  0.50
|   |   |   |   |   |--- Dim2 <= -1.02
|   |   |   |   |   |   |--- class: Not Aware
|   |   |   |   |   |--- Dim2 >  -1.02
|   |   |   |   |   |   |--- class: Not Aware

Indicator Model Performance

Target	Indicator	Accuracy	Precision	Recall	F1	ROC AUC
F1_FSSiv	Older Persons / Senior Citizens Program	62.9%	95.5%	63.8%	76.5%	52.4%
F1_FSSiii	PersonswithDisabilities (PWD)Welfare Program	63.0%	67.3%	85.6%	75.4%	50.7%
F1_FSSi	ChildandYouthWelfareProgram	55.1%	88.7%	56.4%	69.0%	52.6%
F1_FSSv	Family and Community Welfare Program	56.0%	62.8%	70.3%	66.3%	49.9%
F1_FSSvi	Programs for Internally Displaced Persons	52.2%	53.0%	59.3%	56.0%	50.8%
F1_FSSii	Women’s Welfare Program	42.8%	81.3%	37.2%	51.1%	53.8%