Classification Insights

Decision-tree evidence for selected CSIS service indicators.

Awareness
Locality Filter All Mindanao records · 4500 of 4500 records
Locality Filter All Mindanao records

Showing 4500 of 4500 respondent records. Predictive model scores remain the full-sample reference unless retraining is explicitly run.

Choose a Question to Review

Select a service area, service stage, and survey question. Advanced factor settings are optional.

Question-level result
These selectors apply to every tab on this page. For results across all seven service areas, open the Cross-Service Predictor Summary.

Per-Question (Indicator-Level) Classification Review

Each CSIS service indicator represents a specific survey question and is classified separately. Results are grouped by evidence strength so readers can quickly see which findings are usable and which still need validation.

Currently selected question

Community-based greening projects

The cards below place this question alongside other questions from the selected service stage, so its evidence strength can be compared fairly.

Awareness

How to read this result

Start with “Ready for interpretation.” Treat “Use with caution” as supporting evidence, and do not make strong claims from indicators that need stronger evidence.

Improvement path for Environmental Management - Awareness
0 Ready for interpretation Use these indicators as the clearest decision-support results.
No indicators fall under this status for the selected view.
2 Use with caution Use these as exploratory patterns and compare them with descriptive evidence.
  • Clean-up Programs/Projects
  • Community-based greening projects
3 Needs stronger evidence Do not overstate these indicators; they need more signal before stronger prediction claims.
  • Air Pollution Control Program
  • Solid Waste Management
  • Waste Water Management
Technical and methodology notes

Available data: The current dataset does not include direct access-barrier variables such as distance, waiting time, facility supply, staff interaction, or household service need. The portal should therefore improve the existing evidence first instead of inventing unavailable predictors.

Eligible responses: Stage-specific modeling is applied through the saved stage response files and skip-pattern handling: Awareness uses valid awareness responses; Availment uses the availment stage; Satisfaction and Need for Action are interpreted only for respondents who reached the service-use stage.

Predictor selection: The decision-tree pipeline now enriches the general profile and citizen-segment predictors with available service-context evidence when applicable: health background variables for Health Services, education background variables for Support to Education, and crime, disaster, corruption, and citizen-attitude evidence for Governance and Response. Feature selection remains part of the model search, while chi-square is kept in the citizen segment evidence area as profile-cluster support.

Model comparison: Recommended model comparison: keep Decision Tree as the official explanation model, then add Random Forest as a performance benchmark and Logistic Regression as a simple baseline. If another model improves ROC AUC or recall, report it as supporting evidence while keeping the decision tree for readable rules.

What the Model Found

For Environmental Management - Awareness, the summary combines 5 indicator-specific decision-tree model(s). Mean F1 is 64.1% and mean ROC AUC is 54.1%, so the result should be read as an overall tendency across indicators. The indicator-level rows remain the main evidence for decision-support use.

Use the mean scores for the general story; use the indicator rows for the actual evidence.

Stage eligibility is handled before modeling: Awareness uses all valid Yes/No responses; Availment uses Awareness = Yes; Satisfaction and Need for Action use Awareness = Yes and Availment = Yes. Skip-pattern values such as 95-99 are excluded from the target class.

  • Mean precision is 73.7%, indicating moderate when an indicator model predicts the positive service outcome.
  • Mean recall is 58.5%, meaning some indicator models may still miss actual positive cases, especially when recall is lower than precision.
  • Mean F1 score is 64.1%, which balances precision and recall across the indicator models.
  • Mean ROC AUC is 54.1%, showing how well the indicator models separate outcome groups across thresholds on average.
  • Top predictors currently include MCA Dim2, House Ownership, HH Toilet Type, Source of Drinking Water, Sex. These variables are useful signals for explaining which respondent profiles are linked to the selected service outcome.
  • Interpretation: the model has limited separation power. Use the predictors as exploratory clues and validate findings with descriptive charts and local service context.

Key Influencing Factors

These factors contributed most strongly to how the model separated the survey responses. They show association, not proof of cause.
  • Community-based greening projects
    MCA Dim2
    0.2448
  • Community-based greening projects
    House Ownership
    0.18
  • Community-based greening projects
    HH Toilet Type
    0.1509
  • Air Pollution Control Program
    MCA Dim2
    0.4094
  • Air Pollution Control Program
    Source of Drinking Water
    0.4052
  • Air Pollution Control Program
    Sex
    0.1854
  • Solid Waste Management
    MCA Dim2
    0.4024
  • Solid Waste Management
    Source of Electricty
    0.2746

Key-Factor Strength Chart

Show how strongly each available factor influenced the model result.

Optional detail

Key Influencing Factors

Decision Tree Interpretation

Read the tree together with its plain-language insights.

Predictors shown in the simplified tree MCA Dim2 House Ownership HH Toilet Type 4Ps Beneficiary
Simplified decision tree visualization

Evidence Tables

Show readiness review, indicator metrics, rule reference, and diagnostics.

Optional detail

Model Readiness Review

This table explains whether each indicator has enough signal for decision-support use and why some results should remain exploratory.
Indicator Signal Quality (F1 / ROC AUC / Recall / Baseline) Meaning Majority Response (Baseline Class) Eligible Records Baseline Accuracy (Majority Guess) Model Accuracy Gain (Model - Baseline) Possible Cause Suggested Data Improvement
I1_IEMii
Air Pollution Control Program
Limited signal The model can be reviewed as an exploratory clue, but F1, ROC AUC, or baseline gain is not strong enough for confident prediction. Yes / Positive (66.1%) 3600 66.1% 59.8% -6.3 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Environmental Management.
I1_IEMv
Clean-up Programs/Projects
Moderate signal The model has some useful signal based on F1 and ROC AUC, but separation between outcome groups is still limited. Yes / Positive (82.6%) 4350 82.6% 56.2% -26.4 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Environmental Management.
I1_IEMi
Community-based greening projects
Moderate signal The model has some useful signal based on F1 and ROC AUC, but separation between outcome groups is still limited. Yes / Positive (76.8%) 4350 76.8% 55.1% -21.7 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Environmental Management.
I1_IEMiii
Solid Waste Management
Needs more predictors The model has difficulty separating respondents based on ROC AUC, recall, or F1. Yes / Positive (86.9%) 4350 86.9% 49.1% -37.9 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Environmental Management.
I1_IEMiv
Waste Water Management
Needs more predictors The model has difficulty separating respondents based on ROC AUC, recall, or F1. No / Negative (50.3%) 3150 50.3% 51.1% +0.9 pts The result may be close to the majority-class baseline, meaning the model adds limited separation beyond the most common response. Add or review awareness-source, barangay information channel, distance, and program availability variables for Environmental Management.

Indicator-Level Metrics

How the mean scores are formed

The AVG values summarize 5 indicator model(s) for Environmental Management - Awareness. They describe the overall pattern across indicators, not the result of one specific indicator.

Average F1 is 64.1%, which gives the most balanced quick reading because it considers both correct positive predictions and missed positive cases.

Average ROC AUC is 54.1%, so the model should be read as decision-support evidence. Values closer to 50% mean the predictors have limited ability to separate the outcome groups.

Average accuracy is 54.2%, precision is 73.7%, and recall is 58.5%. Compare the indicator rows below to see which indicators are stronger or weaker than the AVG.

Target Indicator Accuracy Precision Recall F1 ROC AUC CV F1 Best CV F1 Selected Features Base Predictors Service Context Total Predictors Depth Leaf Criterion
I1_IEMii Air Pollution Control Program 59.8% 67.3% 76.1% 71.4% 54.9% 61.3% 67.6% all 17 0 17 3 35 gini
I1_IEMv Clean-up Programs/Projects 56.2% 83.8% 58.1% 68.6% 56.0% 71.3% 73.4% all 17 0 17 6 10 entropy
I1_IEMi Community-based greening projects 55.1% 80.8% 54.4% 65.0% 57.1% 51.7% 72.7% 16 17 0 17 3 10 gini
I1_IEMiii Solid Waste Management 49.1% 85.8% 49.7% 62.9% 50.0% 73.7% 77.4% 8 17 0 17 3 10 gini
I1_IEMiv Waste Water Management 51.1% 50.8% 54.1% 52.4% 52.2% 49.0% 53.5% all 17 0 17 5 35 gini

Decision Rule Reference

Some tree rules use coded profile values. Read the tree from top to bottom, then use this reference to translate the rule into respondent-friendly meaning.
Code Meaning Code Values / Variable Type How to Read the Split
B2 House Ownership 1=OWNER, OWNER-LIKE POSSESSION OF HOUSE AND LOT; 2=RENT HOUSE/ROOM, INCLUDING LOT; 3=OWN HOUSE, RENT-FREE LOT WITH OWNER’S CONSENT; 4=OWN HOUSE, RENT-FREE LOT WITHOUT OWNER’S CONSENT; 5=RENT-FREE HOUSE AND LOT WITH OWNER’S CONSENT; 6=RENT-FREE HOUSE AND LOT WITHOUT OWNER’S CONSENT; 99=OTHERS (Specify) <= 1.5 means OWNER, OWNER-LIKE POSSESSION OF HOUSE AND LOT; > 1.5 means RENT HOUSE/ROOM, INCLUDING LOT, OWN HOUSE, RENT-FREE LOT WITH OWNER’S CONSENT, OWN HOUSE, RENT-FREE LOT WITHOUT OWNER’S CONSENT, RENT-FREE HOUSE AND LOT WITH OWNER’S CONSENT, RENT-FREE HOUSE AND LOT WITHOUT OWNER’S CONSENT, OTHERS (Specify).
Dim2 MCA profile dimension 2 A combined respondent-profile score from MCA. It is not a single survey question. Dim2 <= -0.373 follows one side of the profile map; values above -0.373 follow the other side.
B1 4Ps Beneficiary 1=Yes; 2=No <= 1.5 means Yes; > 1.5 means No.

Gini Split Diagnostics

Node Type Rule Gini Samples Not Aware Aware Prediction
0 Split B2 <= 1.500 0.5 4350 0.5 0.5 Aware
1 Split Dim2 <= -0.373 0.4989 3140 0.5 0.5 Aware
2 Split Dim2 <= -1.104 0.4939 1175 0.4 0.6 Aware
3 Leaf Prediction 0.4999 617 0.5 0.5 Aware
4 Leaf Prediction 0.4723 558 0.4 0.6 Aware
5 Split Dim2 <= -0.251 0.4999 1965 0.5 0.5 Aware
6 Leaf Prediction 0.49 143 0.6 0.4 Not Aware
7 Leaf Prediction 0.4997 1822 0.5 0.5 Aware
8 Split Dim2 <= -0.316 0.4938 1210 0.6 0.4 Not Aware
9 Split B2 <= 3.500 0.4999 548 0.5 0.5 Aware
10 Leaf Prediction 0.4912 335 0.4 0.6 Aware
11 Leaf Prediction 0.4885 213 0.6 0.4 Not Aware
12 Split B1 <= 1.500 0.4797 662 0.6 0.4 Not Aware
13 Leaf Prediction 0.4983 197 0.5 0.5 Not Aware
14 Leaf Prediction 0.4674 465 0.6 0.4 Not Aware