π³οΈ Model Performance
Voting triage analytics β 504 detections analyzed by 7 models
π Vote Outcomes
Total Voted
504
β
Unanimous
271
π΅ Majority
148
β οΈ Split
81
Agreement Rate
54%
π€ Active Models
qwen3.5:4b
485 votes
deepseek-r1:8b
381 votes
qwen3:4b
280 votes
gemini-cli
139 votes
dgx-122b
5 votes
gemma3:4b
2 votes
deepseek-r1:14b
1 votes
Voting Mode
Enabled
π― Auto-Actions Triggered
π’ Auto-Close FP
241
π΄ Escalate to IR
23
π’ Auto-Close Benign
3
β οΈ Manual Review
134
π§βπ» Analyst Verdict Classifications
49
True Positive
498
False Positive
16
Suspicious
30
Benign
AI Accuracy (TP+TN / Total)
88%
Total Classified
593
π Vote Agreement Distribution
π― Per-Model Verdict Comparison
πΈοΈ Model Confidence Comparison
π Model Verdict Rates (%)
π― Model Accuracy vs Analyst Verdicts β LIVE
Overall AI Accuracy: 88%
(593
analyst-reviewed detections)
π Per-Model Breakdown
| Model | Votes | True Positive | False Positive | Suspicious | Benign | Avg Confidence | Avg Risk Score |
|---|---|---|---|---|---|---|---|
| qwen3.5:4b | 485 | 94% | 27 | ||||
| deepseek-r1:8b | 381 | 84% | 35 | ||||
| qwen3:4b | 280 | 94% | 15 | ||||
| gemini-cli | 139 | 91% | 50 | ||||
| dgx-122b | 5 | 95% | 50 | ||||
| gemma3:4b | 2 | 96% | 50 | ||||
| deepseek-r1:14b | 1 | 90% | 50 |
π Recent Votes (Last 20)
| Detection | Case | qwen3.5:4b | deepseek-r1: | qwen3:4b | gemini-cli | dgx-122b | gemma3:4b | deepseek-r1: | Result |
|---|---|---|---|---|---|---|---|---|---|
| service.NIX-Host_Based_Firewall_Disabled | #592 | false_ | majority | ||||||
| service.NIX-Host_Based_Firewall_Disabled | #593 | false_ | false_ | false_ | unanimous | ||||
| service.NIX-Host_Based_Firewall_Disabled | #587 | false_ | majority | ||||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #582 | false_ | false_ | unanimous | |||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #581 | false_ | majority | ||||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #575 | true_p | false_ | false_ | majority | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #574 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #573 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #566 | true_p | false_ | false_ | majority | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #565 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #564 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #572 | true_p | false_ | false_ | majority | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #571 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #570 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #557 | true_p | false_ | false_ | majority | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #558 | true_p | false_ | false_ | majority | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #569 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #560 | true_p | false_ | false_ | majority | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #559 | false_ | false_ | false_ | unanimous | ||||
| general.NEW FILE WRITE BYTES SAMPLE GRAB | #568 | false_ | false_ | false_ | unanimous |