The Test Harness

Overview

The Test Harness is a rich collection of standardized information delivery and data capture methods that provide experimenters and evaluators a wide array of tools and metrics. These methods can be adjusted and tuned to suit the specific capabilities of the Human-Radar System being examined. Stimuli are timed, interactive, and embedded across a wide range of tightly knit tasks. The world structure and collection of input files allows tasks and task modifiers to be supplied in many ways, thus enabling use by a variety of learning technologies. For example, email detailing a constraint on a task can be sent at a pre-set time for processing by classifiers, knowledge bases, and task specialists. Likewise, important knowledge can be embedded in a web page and learned in the wild during human use of Radar. The Test Harness also includes Radar-specific data collection and post-processing tools in order to streamline data reduction and evaluation score computation efforts.

For additional detail on the Test Harness, please contact Aaron Steinfeld.