High-Bandwidth Tactical-Network Data Analysis in a High-Performance-Computing (HPC) Environment: Data Marshalling

Report No. ARL-TR-7410
Authors: Kenneth D Renard; Joseph D Rivera; James R Adametz; Jordan R Franssen
Date/Pages: September 2015; 18 pages
Abstract: Teams from the Aberdeen Test Center and the US Army Research Laboratory collaborated to design and build a system-of-processes with a goal of reliably marshalling data from a large-scale remote tactical network field test, shuttling the data cross-country, and performing reduction and analysis. The progression of going from terabytes of raw collected field data to a data product that can be used by analysts and evaluators required coordination of people and hardware from several cross-country sites. This system-of-processes reliably worked over a 2-month time span, processing an average of 1.5 TB of raw field-collected data a day. This report describes methods, processes, and systems employed to go from raw data to a finished data product in a short time period (several days) to facilitate Army decision making on a major communications system production.
Distribution: Approved for public release
  Download Report ( 0.422 MBytes )
If you are visually impaired or need a physical copy of this report, please visit and contact DTIC.

Last Update / Reviewed: September 1, 2015