AI-Generated Text Detection: ContentDetector.AI vs Writer's AI Content Detector

Results of a face-off between ContentDetector.AI and Writer's AI Content Detector at the AI-Generated Text Detection Trial.

Accuracy: ContentDetector.AI ⋙ Writer's AI Content Detector

• ContentDetector.AI overperforms across all qualitative metrics.
• Writer's AI Content Detector disclaimer makes it clear that the tool is optimized to reduce the false positive rate, which is confirmed by our findings.
• Full metrics breakdown:
  • F1-score: 60% for ContentDetector.AI. Not available for Writer's AI Content Detector
  • Accuracy: 69% (ContentDetector.AI) vs 47% (Writer's AI Content Detector)
  • False Positive Rate: 26% (ContentDetector.AI) vs 0% (Writer's AI Content Detector)
  • False Negative Rate: 35% (ContentDetector.AI) vs 100% (Writer's AI Content Detector)

Robustness: ContentDetector.AI ⋙ Writer's AI Content Detector

• ContentDetector.AI: the best-performing categories are casual writing, creative writing, and product descriptions.
• ContentDetector.AI: worst performance is seen in the technical writing category

Explainability: ContentDetector.AI ≫ Writer's AI Content Detector

• ContentDetector.AI highlights specific sentences that it deems AI-generated
• The two tools surface the results of detection differently: Writer shows the percentage of text that it deems human-generated, while ContentDetector.AI surfaces a probability score of content being AI-generated.

Conclusion: ContentDetector.AI ⋙ Writer's AI Content Detector

ContentDetector.AI by Content at Scale emerges as the clear prevailing AI in this trial. While Writer's AI Content Detector achieves its stated goal of eliminating false positives (reaching a 0% false-positive rate in our tests), this comes at a significant cost: the tool struggles to identify genuine AI-generated content. Both tools offer free access without usage limits or paywalls during our testing period.