AI Field Trials

Word of Lore Field Trials are tournament-style, one-on-one competitions between AI technologies solving real-world problems.

A modern take on Lady Justice statue, with a digital or holographic blindfold, holding the scales and a sword

Trial: AI Judgement—Evaluating an AI Arbitrator

In this AI Trial, we assess how generative instruct models perform as judging entities. Human evaluators examine AI's capacity for rational, impartial, and ethical decision-making. The study aims to identify the most effective models and tools for AI-driven arbitration in complex scenarios.

Person at a Computer as the central figure working on a computer, representing the active task of summarizing

Trial: Summarizing Articles with AI-Powered Content Condensation

Discover how AI is revolutionizing content consumption through advanced summarization tools. Explore ongoing trials across diverse domains as researchers assess these time-saving technologies, potentially transforming how we absorb information in our fast-paced digital world.

An email with subject "Action Required: Please Write an Email" from work@as.usual to "You". A single "Reply" button alongside

Trial: Email Generation for Work

An assessment of AI tools for work-related email composition. This analysis evaluates solutions across six key criteria to identify which tools best enhance professional communications.

It looks like a duck, swims like a duck, and quacks like a duck, but it is a mechanical/robotic duck masked for a duck

Trial: AI-Generated Text Detection

This Field Trial examines tools and techniques for detecting AI-authored content, focusing on accuracy, robustness, and explainability—essential factors in maintaining content quality in the digital age.