Add new experiments and analysis scripts for dropzero features

- Introduced `fused_importance_with_axial.py` to evaluate the importance of Axial_Length in the fused-head model. - Created JSON configurations for various experiments excluding zero-importance clinical features: - `cd_solo_bilateral_dropzero.json`: Bilateral clinical-only evaluation. - `cd_solo_single_dropzero.json`: Single-eye clinical-only evaluation. - `ensemble_refugelike_ckpt_dropzero.json`: Ensemble model with dropped zero-importance features. - `ensemble_single_refugelike_dropzero.json`: Single-eye ensemble model with dropped features.
2026-08-24 12:26:16 +02:00
parent 708fbc70ce
commit 3d7777f010
29 changed files with 1236 additions and 352 deletions
@@ -0,0 +1,20 @@
+[
+  {
+    "_note": "Bilateral cd-only (eval at hb) with the four zero-importance clinical features dropped (astigmatism, dioptre_1, dioptre_2, Phakic/Pseudophakic). Pairs seed-for-seed with experiments/phase4_v4/cd_solo_bilateral so a rep-paired comparison quantifies the effect of the pruned panel at the bilateral clinical-only stage. Feeds the clinical column of the new F4 with matched features to the bilateral fusion column (ensemble_refugelike_ckpt_dropzero).",
+    "run_name": "experiments/explainability/cd_solo_bilateral_dropzero",
+    "reps": 10,
+    "overrides": {
+      "data": {
+        "args": {
+          "exclude_cols": [
+            "Axial_Length",
+            "astigmatism",
+            "dioptre_1",
+            "dioptre_2",
+            "Phakic/Pseudophakic"
+          ]
+        }
+      }
+    }
+  }
+]
@@ -0,0 +1,20 @@
+[
+  {
+    "_note": "Single-eye clinical-only (no img tower, eval at cd_fuse) with the four zero-importance clinical features dropped (astigmatism, dioptre_1, dioptre_2, Phakic/Pseudophakic). Pairs seed-for-seed with experiments/phase2_v4/cd_solo_single so a rep-paired comparison quantifies the effect of the pruned panel at the clinical-only stage. Feeds the clinical column of the new F3 with matched features to the fusion column.",
+    "run_name": "experiments/explainability/cd_solo_single_dropzero",
+    "reps": 10,
+    "overrides": {
+      "data": {
+        "args": {
+          "exclude_cols": [
+            "Axial_Length",
+            "astigmatism",
+            "dioptre_1",
+            "dioptre_2",
+            "Phakic/Pseudophakic"
+          ]
+        }
+      }
+    }
+  }
+]
@@ -0,0 +1,21 @@
+[
+  {
+    "_note": "Same 10-rep checkpointed R50 ensemble as ensemble_refugelike_ckpt, but with the four clinical features that scored ~0 fused-head permutation importance dropped from the input matrix (astigmatism, dioptre_1, dioptre_2, Phakic/Pseudophakic). eyeID is not listed here because the PAPILA profile also uses it as the OD/OS index level and dropping it via exclude_cols crashes downstream indexing; since eyeID's L2 importance is exactly 0.0 in the current CSV (fused head always sees both eyes, so eyeID carries zero information at that layer), leaving it in has no measurable effect on AUC. Same seed / fold_seed defaults as the main ckpt run so results are rep-paired for direct comparison.",
+    "run_name": "experiments/explainability/ensemble_refugelike_ckpt_dropzero",
+    "reps": 10,
+    "overrides": {
+      "save_checkpoints": true,
+      "data": {
+        "args": {
+          "exclude_cols": [
+            "Axial_Length",
+            "astigmatism",
+            "dioptre_1",
+            "dioptre_2",
+            "Phakic/Pseudophakic"
+          ]
+        }
+      }
+    }
+  }
+]
@@ -0,0 +1,20 @@
+[
+  {
+    "_note": "Single-eye Hadamard L1 img+cd ensemble (refugelike R50 backbone, eval at nt) with the four zero-importance clinical features dropped (astigmatism, dioptre_1, dioptre_2, Phakic/Pseudophakic). Pairs seed-for-seed with experiments/refuge_v2m_baseline/ensemble_single_refugelike so a rep-paired comparison quantifies the effect of the pruned panel at the L1 stage. Feeds the L1 Hadamard column of the new F3.",
+    "run_name": "experiments/explainability/ensemble_single_refugelike_dropzero",
+    "reps": 10,
+    "overrides": {
+      "data": {
+        "args": {
+          "exclude_cols": [
+            "Axial_Length",
+            "astigmatism",
+            "dioptre_1",
+            "dioptre_2",
+            "Phakic/Pseudophakic"
+          ]
+        }
+      }
+    }
+  }
+]