π³οΈ Model Performance
Voting triage analytics β 998 detections analyzed by 11 models
π Vote Outcomes
Total Voted
998
β
Unanimous
353
π΅ Majority
551
β οΈ Split
90
Agreement Rate
35%
π€ Active Models
qwen3.5:4b
813 votes
deepseek-r1:8b
377 votes
deepseek-r1:16b
333 votes
qwen3:4b
275 votes
qwen3.5:35b
274 votes
gemma3:4b
139 votes
gemini-cli
139 votes
dgx-35b
119 votes
qwen3.5:122b
105 votes
dgx-122b
6 votes
deepseek-r1:14b
2 votes
Voting Mode
Enabled
π― Auto-Actions Triggered
π’ Auto-Close FP
241
π΄ Escalate to IR
23
π’ Auto-Close Benign
2
β οΈ Manual Review
631
π§βπ» Analyst Verdict Classifications
267
True Positive
1080
False Positive
16
Suspicious
25
Benign
AI Accuracy (TP+TN / Total)
80%
Total Classified
1388
π Vote Agreement Distribution
π― Per-Model Verdict Comparison
πΈοΈ Model Confidence Comparison
π Model Verdict Rates (%)
π― Model Accuracy vs Analyst Verdicts β LIVE
Overall AI Accuracy: 80%
(1388
analyst-reviewed detections)
π Per-Model Breakdown
| Model | Votes | True Positive | False Positive | Suspicious | Benign | Avg Confidence | Avg Risk Score |
|---|---|---|---|---|---|---|---|
| qwen3.5:4b | 813 | 93% | 37 | ||||
| deepseek-r1:8b | 377 | 84% | 35 | ||||
| deepseek-r1:16b | 333 | 78% | 50 | ||||
| qwen3:4b | 275 | 94% | 15 | ||||
| qwen3.5:35b | 274 | 0% | 50 | ||||
| gemma3:4b | 139 | 95% | 50 | ||||
| gemini-cli | 139 | 91% | 50 | ||||
| dgx-35b | 119 | 74% | 50 | ||||
| qwen3.5:122b | 105 | 0% | 50 | ||||
| dgx-122b | 6 | 95% | 50 | ||||
| deepseek-r1:14b | 2 | 92% | 50 |
π Recent Votes (Last 20)
| Detection | Case | qwen3.5:4b | deepseek-r1: | deepseek-r1: | qwen3:4b | qwen3.5:35b | gemma3:4b | gemini-cli | dgx-35b | qwen3.5:122b | dgx-122b | deepseek-r1: | Result |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| general.fusionsoc-t1547-boot-logon-autos | #5093 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5092 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5091 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5090 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5079 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5078 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5077 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5076 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5065 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5064 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5063 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5062 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5051 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5050 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5049 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5048 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5037 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5036 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5035 | true_p | majority | ||||||||||
| general.fusionsoc-t1547-boot-logon-autos | #5034 | true_p | majority |