Skip to main content

Table 3 Related work: other publications

From: Testing of detection tools for AI-generated text

Source

Detection tools used

Dataset

Evaluation metrics

Gewirtz 2023

3

GPT-2 Output Detector, Writer, Content at Scale

• 3 human-generated texts

• 3 ChatGPT-generated texts

N/A

van Oijen 2023

7

Content at Scale, Copyleaks, Corrector App, Crossplag, GPTZero, OpenAI, Writer

• 10 generated passages based on prompts (factual info, rewrites of existing test, fictional scenarios, advice, explanations at different levels, impersonation of a specified character, Dutch translation)

• 5 human-generated text from different sources (Wikipedia, SURF, Alice in Wonderland, Reddit post)

Accuracy

Compilatio 2023

11

Compilatio, Draft and Goal, GLTR, GPTZero, Content at Scale, DetectGPT, Crossplag, Kazan SEO, AI Text Classifier, Copyleaks, Writer AI Content Detector

• 50 human-written texts

• 75 texts generated by ChatGPT and YouChat

Reliability (the number of correctly classified/the total number of text passages)

Demers 2023

16

Originality AI, Writer, Copyleaks, Open AI Text Classifier, Crossplag, GPTZero, Sapling, Content At Scale, Zero GPT, GLTR, Hugging Face, Corrector, Writeful, Hive Moderation, Paraphrasing tool AI Content Detector, AI Writing Check

• Human writing sample

• ChatGPT 4 writing sample

• ChatGPT 4 writing sample with the additional prompt "beat detection"

N/A