Advanced Video Activity Analytics (AVAA): Human Factors Evaluation

Report No. ARL-TR-7286
Authors: Patricia L McDermott; Beth M Plott; Anthony J Ries; Jonathan Touryan; Michael Barnes; Kristin Schweitzer
Date/Pages: May 2015; 68 pages
Abstract: A Human Systems Integration evaluation of the Advanced Video Activity Analytics (AVAA) system was conducted to capture baseline performance and workload with the AVAA system and compare it to performance with advanced AVAA features. This first-year assessment focused on the impact of V-NIIRS (Video National Imagery Interpretability Rating Scale), a widely used scale to evaluate video imagery quality. Experienced analysts searched for targets in full-motion video using AVAA software, both with and without V-NIIRS filter capabilities. Measures of performance included percent of primary targets found, time to find primary target, total targets found, and buttons clicked. Traditional subjective assessments of workload were augmented with continuous physiological and behavioral measurements in order to capture more accurate cognitive state fluctuations during human-system interaction. The findings suggest that analysts were able to identify more targets with the V-NIIRS filter than in the baseline condition in time-pressured situations. The study also developed and implemented a multiaspect approach to estimate operator functional state during system evaluation.
Distribution: Approved for public release
  Download Report ( 1.979 MBytes )
If you are visually impaired or need a physical copy of this report, please visit and contact DTIC.

Last Update / Reviewed: May 1, 2015