Table 12 Overview of classification results and precision
Tool | TP | PTP | FP | PFP | TN | PTN | FN | PFN | UNC | Total | Prec_incl | Prec_excl |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
Check For AI | 23 | 1 | 1 | 9 | 7 | 1 | 10 | 2 | 54 | 96% | 100% | |
Compilatio | 23 | 2 | 17 | 1 | 9 | 1 | 1 | 54 | 100% | 100% | ||
Content at Scale | 18 | 12 | 13 | 11 | 54 | –- | –- | |||||
Crossplag | 22 | 1 | 3 | 15 | 11 | 2 | 54 | 88% | 88% | |||
DetectGPT | 11 | 12 | 14 | 3 | 7 | 6 | 1 | 54 | 100% | 100% | ||
Go Winston | 22 | 2 | 14 | 2 | 4 | 3 | 7 | 54 | 100% | 100% | ||
GPT Zero | 20 | 13 | 9 | 9 | 3 | 54 | 79% | 100% | ||||
GPT-2 Output Detector Demo | 23 | 1 | 2 | 16 | 10 | 1 | 1 | 54 | 92% | 92% | ||
OpenAI Text Classifier | 12 | 8 | 17 | 1 | 2 | 4 | 10 | 54 | 100% | 100% | ||
PlagiarismCheck | 9 | 8 | 12 | 5 | 1 | 10 | 9 | 54 | 100% | 100% | ||
TurnItIn | 23 | 3 | 18 | 4 | 3 | 3 | 54 | 100% | 100% | |||
Writeful GPT Detector | 7 | 11 | 1 | 16 | 1 | 13 | 3 | 2 | 54 | 95% | 100% | |
Writer | 11 | 6 | 1 | 16 | 13 | 3 | 4 | 54 | 94% | 92% | ||
Zero GPT | 18 | 5 | 14 | 3 | 3 | 11 | 54 | 100% | 100% |