Classification Insights

Decision-tree evidence for selected CSIS service indicators.

Awareness
Locality Filter All Mindanao records · 4500 of 4500 records
Locality Filter All Mindanao records

Showing 4500 of 4500 respondent records. Predictive model scores remain the full-sample reference unless retraining is explicitly run.

Choose a Question to Review

Select a service area, service stage, and survey question. Advanced factor settings are optional.

Question-level result
These selectors apply to every tab on this page. For results across all seven service areas, open the Cross-Service Predictor Summary.

Per-Question (Indicator-Level) Classification Review

Each CSIS service indicator represents a specific survey question and is classified separately. Results are grouped by evidence strength so readers can quickly see which findings are usable and which still need validation.

Currently selected question

ChildandYouthWelfareProgram

The cards below place this question alongside other questions from the selected service stage, so its evidence strength can be compared fairly.

Awareness

How to read this result

Start with “Ready for interpretation.” Treat “Use with caution” as supporting evidence, and do not make strong claims from indicators that need stronger evidence.

Improvement path for Social Welfare Services - Awareness
0 Ready for interpretation Use these indicators as the clearest decision-support results.
No indicators fall under this status for the selected view.
1 Use with caution Use these as exploratory patterns and compare them with descriptive evidence.
  • Women’s Welfare Program
5 Needs stronger evidence Do not overstate these indicators; they need more signal before stronger prediction claims.
  • Family and Community Welfare Program
  • ChildandYouthWelfareProgram
  • Older Persons / Senior Citizens Program
  • PersonswithDisabilities (PWD)Welfare Program
  • Programs for Internally Displaced Persons
Technical and methodology notes

Available data: The current dataset does not include direct access-barrier variables such as distance, waiting time, facility supply, staff interaction, or household service need. The portal should therefore improve the existing evidence first instead of inventing unavailable predictors.

Eligible responses: Stage-specific modeling is applied through the saved stage response files and skip-pattern handling: Awareness uses valid awareness responses; Availment uses the availment stage; Satisfaction and Need for Action are interpreted only for respondents who reached the service-use stage.

Predictor selection: The decision-tree pipeline now enriches the general profile and citizen-segment predictors with available service-context evidence when applicable: health background variables for Health Services, education background variables for Support to Education, and crime, disaster, corruption, and citizen-attitude evidence for Governance and Response. Feature selection remains part of the model search, while chi-square is kept in the citizen segment evidence area as profile-cluster support.

Model comparison: Recommended model comparison: keep Decision Tree as the official explanation model, then add Random Forest as a performance benchmark and Logistic Regression as a simple baseline. If another model improves ROC AUC or recall, report it as supporting evidence while keeping the decision tree for readable rules.

What the Model Found

For Social Welfare Services - Awareness, the summary combines 6 indicator-specific decision-tree model(s). Mean F1 is 59.0% and mean ROC AUC is 52.4%, so the result should be read as an overall tendency across indicators. The indicator-level rows remain the main evidence for decision-support use.

Use the mean scores for the general story; use the indicator rows for the actual evidence.

Stage eligibility is handled before modeling: Awareness uses all valid Yes/No responses; Availment uses Awareness = Yes; Satisfaction and Need for Action use Awareness = Yes and Availment = Yes. Skip-pattern values such as 95-99 are excluded from the target class.

  • Mean precision is 74.9%, indicating moderate when an indicator model predicts the positive service outcome.
  • Mean recall is 51.4%, meaning some indicator models may still miss actual positive cases, especially when recall is lower than precision.
  • Mean F1 score is 59.0%, which balances precision and recall across the indicator models.
  • Mean ROC AUC is 52.4%, showing how well the indicator models separate outcome groups across thresholds on average.
  • Top predictors currently include Age Group, MCA Dim2, HH Toilet Type, MCA Dim1, Highest Educational Attainment. These variables are useful signals for explaining which respondent profiles are linked to the selected service outcome.
  • Interpretation: the model has limited separation power. Use the predictors as exploratory clues and validate findings with descriptive charts and local service context.

Key Influencing Factors

These factors contributed most strongly to how the model separated the survey responses. They show association, not proof of cause.
  • ChildandYouthWelfareProgram
    Age Group
    0.2982
  • ChildandYouthWelfareProgram
    MCA Dim2
    0.2814
  • ChildandYouthWelfareProgram
    HH Toilet Type
    0.1641
  • Women’s Welfare Program
    MCA Dim1
    0.467
  • Women’s Welfare Program
    Highest Educational Attainment
    0.2267
  • Women’s Welfare Program
    Sex
    0.2133
  • PersonswithDisabilities (PWD)Welfare Program
    MCA DimMagnitude
    0.7002
  • PersonswithDisabilities (PWD)Welfare Program
    MCA Dim2
    0.2998

Key-Factor Strength Chart

Show how strongly each available factor influenced the model result.

Optional detail

Key Influencing Factors

Decision Tree Interpretation

Read the tree together with its plain-language insights.

Predictors shown in the simplified tree Age Group MCA Dim2 HH Toilet Type House Ownership
Simplified decision tree visualization

Evidence Tables

Show readiness review, indicator metrics, rule reference, and diagnostics.

Optional detail

Model Readiness Review

This table explains whether each indicator has enough signal for decision-support use and why some results should remain exploratory.
Indicator Signal Quality (F1 / ROC AUC / Recall / Baseline) Meaning Majority Response (Baseline Class) Eligible Records Baseline Accuracy (Majority Guess) Model Accuracy Gain (Model - Baseline) Possible Cause Suggested Data Improvement
F1_FSSii
Women’s Welfare Program
Moderate signal The model has some useful signal based on F1 and ROC AUC, but separation between outcome groups is still limited. Yes / Positive (80.7%) 4349 80.7% 71.4% -9.3 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Social Welfare Services.
F1_FSSv
Family and Community Welfare Program
Needs more predictors The model has difficulty separating respondents based on ROC AUC, recall, or F1. Yes / Positive (62.0%) 4500 62.0% 53.4% -8.5 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Social Welfare Services.
F1_FSSi
ChildandYouthWelfareProgram
Needs more predictors The model has difficulty separating respondents based on ROC AUC, recall, or F1. Yes / Positive (88.6%) 4500 88.6% 48.1% -40.6 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Social Welfare Services.
F1_FSSiv
Older Persons / Senior Citizens Program
Needs more predictors The model has difficulty separating respondents based on ROC AUC, recall, or F1. Yes / Positive (94.8%) 4500 94.8% 43.1% -51.7 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Social Welfare Services.
F1_FSSiii
PersonswithDisabilities (PWD)Welfare Program
Needs more predictors The model has difficulty separating respondents based on ROC AUC, recall, or F1. Yes / Positive (66.8%) 4500 66.8% 47.9% -18.9 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Social Welfare Services.
F1_FSSvi
Programs for Internally Displaced Persons
Needs more predictors The model has difficulty separating respondents based on ROC AUC, recall, or F1. Yes / Positive (51.2%) 3900 51.2% 49.5% -1.6 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Social Welfare Services.

Indicator-Level Metrics

How the mean scores are formed

The AVG values summarize 6 indicator model(s) for Social Welfare Services - Awareness. They describe the overall pattern across indicators, not the result of one specific indicator.

Average F1 is 59.0%, which gives the most balanced quick reading because it considers both correct positive predictions and missed positive cases.

Average ROC AUC is 52.4%, so the model should be read as decision-support evidence. Values closer to 50% mean the predictors have limited ability to separate the outcome groups.

Average accuracy is 52.2%, precision is 74.9%, and recall is 51.4%. Compare the indicator rows below to see which indicators are stronger or weaker than the AVG.

Target Indicator Accuracy Precision Recall F1 ROC AUC CV F1 Best CV F1 Selected Features Base Predictors Service Context Total Predictors Depth Leaf Criterion
F1_FSSii Women’s Welfare Program 71.4% 82.3% 82.2% 82.3% 57.1% 81.9% 80.1% 16 17 0 17 3 10 gini
F1_FSSv Family and Community Welfare Program 53.4% 60.7% 70.3% 65.2% 48.8% 61.4% 65.9% all 17 0 17 5 10 gini
F1_FSSi ChildandYouthWelfareProgram 48.1% 90.6% 46.2% 61.2% 53.5% 63.3% 81.9% 16 17 0 17 3 10 entropy
F1_FSSiv Older Persons / Senior Citizens Program 43.1% 94.9% 42.2% 58.4% 52.5% 74.4% 76.0% all 17 0 17 6 10 gini
F1_FSSiii PersonswithDisabilities (PWD)Welfare Program 47.9% 69.3% 39.6% 50.4% 52.7% 63.2% 66.8% 16 17 0 17 3 35 gini
F1_FSSvi Programs for Internally Displaced Persons 49.5% 51.3% 28.1% 36.3% 50.0% 59.7% 61.6% 8 17 0 17 3 10 gini

Decision Rule Reference

Some tree rules use coded profile values. Read the tree from top to bottom, then use this reference to translate the rule into respondent-friendly meaning.
Code Meaning Code Values / Variable Type How to Read the Split
Dim2 MCA profile dimension 2 A combined respondent-profile score from MCA. It is not a single survey question. Dim2 <= -0.35 follows one side of the profile map; values above -0.35 follow the other side.
A3.1 Age Group 1=18→24; 2=25→29; 3=30→34; 4=35→39; 5=40→44; 6=45→54; 7=55→64; 8=65→74; 9=75 and above <= 3.5 means 18→24, 25→29, 30→34; > 3.5 means 35→39, 40→44, 45→54, 55→64, 65→74, 75 and above.
B2 House Ownership 1=OWNER, OWNER-LIKE POSSESSION OF HOUSE AND LOT; 2=RENT HOUSE/ROOM, INCLUDING LOT; 3=OWN HOUSE, RENT-FREE LOT WITH OWNER’S CONSENT; 4=OWN HOUSE, RENT-FREE LOT WITHOUT OWNER’S CONSENT; 5=RENT-FREE HOUSE AND LOT WITH OWNER’S CONSENT; 6=RENT-FREE HOUSE AND LOT WITHOUT OWNER’S CONSENT; 99=OTHERS (Specify) <= 5.5 means OWNER, OWNER-LIKE POSSESSION OF HOUSE AND LOT, RENT HOUSE/ROOM, INCLUDING LOT, OWN HOUSE, RENT-FREE LOT WITH OWNER’S CONSENT, OWN HOUSE, RENT-FREE LOT WITHOUT OWNER’S CONSENT, RENT-FREE HOUSE AND LOT WITH OWNER’S CONSENT; > 5.5 means RENT-FREE HOUSE AND LOT WITHOUT OWNER’S CONSENT, OTHERS (Specify).

Gini Split Diagnostics

Node Type Rule Gini Samples Not Aware Aware Prediction
0 Split Dim2 <= -0.350 0.5 4500 0.5 0.5 Aware
1 Split A3.1 <= 3.500 0.4941 1789 0.4 0.6 Aware
2 Split Dim2 <= -1.256 0.4998 560 0.5 0.5 Not Aware
3 Leaf Prediction 0.4855 209 0.6 0.4 Not Aware
4 Leaf Prediction 0.4961 351 0.5 0.5 Aware
5 Split A3.1 <= 6.500 0.4843 1229 0.4 0.6 Aware
6 Leaf Prediction 0.468 902 0.4 0.6 Aware
7 Leaf Prediction 0.5 327 0.5 0.5 Aware
8 Split Dim2 <= 0.343 0.498 2711 0.5 0.5 Not Aware
9 Split B2 <= 5.500 0.4859 846 0.6 0.4 Not Aware
10 Leaf Prediction 0.4907 818 0.6 0.4 Not Aware
11 Leaf Prediction 0.2759 28 0.8 0.2 Not Aware
12 Split A3.1 <= 5.500 0.5 1865 0.5 0.5 Not Aware
13 Leaf Prediction 0.488 758 0.4 0.6 Aware
14 Leaf Prediction 0.4949 1107 0.6 0.4 Not Aware