π³οΈ Model Performance
Voting triage analytics β 1122 detections analyzed by 11 models
π Vote Outcomes
Total Voted
1122
β
Unanimous
353
π΅ Majority
675
β οΈ Split
90
Agreement Rate
31%
π€ Active Models
qwen3.5:4b
813 votes
qwen3.5:35b
398 votes
deepseek-r1:8b
377 votes
deepseek-r1:16b
333 votes
qwen3:4b
275 votes
gemma3:4b
139 votes
gemini-cli
139 votes
dgx-35b
119 votes
qwen3.5:122b
105 votes
dgx-122b
6 votes
deepseek-r1:14b
2 votes
Voting Mode
Enabled
π― Auto-Actions Triggered
π’ Auto-Close FP
241
π΄ Escalate to IR
23
π’ Auto-Close Benign
2
β οΈ Manual Review
755
π§βπ» Analyst Verdict Classifications
267
True Positive
1443
False Positive
16
Suspicious
25
Benign
AI Accuracy (TP+TN / Total)
72%
Total Classified
1751
π Vote Agreement Distribution
π― Per-Model Verdict Comparison
πΈοΈ Model Confidence Comparison
π Model Verdict Rates (%)
π― Model Accuracy vs Analyst Verdicts β LIVE
Overall AI Accuracy: 72%
(1751
analyst-reviewed detections)
π Per-Model Breakdown
| Model | Votes | True Positive | False Positive | Suspicious | Benign | Avg Confidence | Avg Risk Score |
|---|---|---|---|---|---|---|---|
| qwen3.5:4b | 813 | 93% | 37 | ||||
| qwen3.5:35b | 398 | 0% | 50 | ||||
| deepseek-r1:8b | 377 | 84% | 35 | ||||
| deepseek-r1:16b | 333 | 78% | 50 | ||||
| qwen3:4b | 275 | 94% | 15 | ||||
| gemma3:4b | 139 | 95% | 50 | ||||
| gemini-cli | 139 | 91% | 50 | ||||
| dgx-35b | 119 | 74% | 50 | ||||
| qwen3.5:122b | 105 | 0% | 50 | ||||
| dgx-122b | 6 | 95% | 50 | ||||
| deepseek-r1:14b | 2 | 92% | 50 |
π Recent Votes (Last 20)
| Detection | Case | qwen3.5:4b | qwen3.5:35b | deepseek-r1: | deepseek-r1: | qwen3:4b | gemma3:4b | gemini-cli | dgx-35b | qwen3.5:122b | dgx-122b | deepseek-r1: | Result |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| service.NIX-Touch_Timestomping | #8236 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6777 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6776 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6775 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6774 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6747 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6574 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6573 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6572 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6571 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6568 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6567 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6566 | true_p | majority | ||||||||||
| service.NIX-Host_Based_Firewall_Disabled | #6565 | true_p | majority | ||||||||||
| service.windows_process_creation/proc_cr | #5521 | true_p | majority | ||||||||||
| service.windows_process_creation/proc_cr | #5520 | true_p | majority | ||||||||||
| service.windows_process_creation/proc_cr | #5519 | true_p | majority | ||||||||||
| service.windows_process_creation/proc_cr | #5518 | true_p | majority | ||||||||||
| service.windows_process_creation/proc_cr | #5517 | true_p | majority | ||||||||||
| service.windows_process_creation/proc_cr | #5516 | true_p | majority |