Source | Detection tools used | Dataset | Evaluation metrics |
---|---|---|---|
Gewirtz 2023 | 3 GPT-2 Output Detector, Writer, Content at Scale | • 3 human-generated texts • 3 ChatGPT-generated texts | N/A |
van Oijen 2023 | 7 Content at Scale, Copyleaks, Corrector App, Crossplag, GPTZero, OpenAI, Writer | • 10 generated passages based on prompts (factual info, rewrites of existing test, fictional scenarios, advice, explanations at different levels, impersonation of a specified character, Dutch translation) • 5 human-generated text from different sources (Wikipedia, SURF, Alice in Wonderland, Reddit post) | Accuracy |
Compilatio 2023 | 11 Compilatio, Draft and Goal, GLTR, GPTZero, Content at Scale, DetectGPT, Crossplag, Kazan SEO, AI Text Classifier, Copyleaks, Writer AI Content Detector | • 50 human-written texts • 75 texts generated by ChatGPT and YouChat | Reliability (the number of correctly classified/the total number of text passages) |
Demers 2023 | 16 Originality AI, Writer, Copyleaks, Open AI Text Classifier, Crossplag, GPTZero, Sapling, Content At Scale, Zero GPT, GLTR, Hugging Face, Corrector, Writeful, Hive Moderation, Paraphrasing tool AI Content Detector, AI Writing Check | • Human writing sample • ChatGPT 4 writing sample • ChatGPT 4 writing sample with the additional prompt "beat detection" | N/A |