TSA - Test Suite Analyzer

To download TSA, click here.

Analysis codes such as TRACE, RELAP5 and MELCOR each contain several distinct component types ranging from pipes, valves, pumps and vessels to heat structures and control systems. Each of these components may include several input options which control the behavior of the component along with it's input requirements.

The Test Suite Analysis Tool (TSA) is designed to analyze a large set of input models for a given analysis code in order to provide a means of assessing the test suite coverage. TSA builds an embedded SQL databases customized to each analysis code from a metrics specification file which identifies all of the components, attributes and enumerations specific to the analysis code. TSA then imports a set of metrics files, each containing a snapshot of the testable component options for a given model.

The Symbolic Nuclear Analysis Package (SNAP), can be used to generate the metrics specification file as well as the metrics data files. The procedure for generating these files is described below:

TSA analyzes a set of metrics data files generated by SNAP. These include the following:

• a Plug-in specific metrics specification file which identifies the structure of the data being analyzed
• a series of metrics files each containing a snapshot of the testable parameters for a model

SNAP contains two batch commands that are used to create these files:

PLUGIN_NAME EXPORT METRICS_SPEC filename

where:

PLUGIN_NAME is the identifier for the code plug-in such as "TRACE"
filename is the name of the file being created (This name should be contained in quotes.)

example:

TRACE EXPORT METRICS_SPEC "TraceMetricsSpec.xml"

PLUGIN_NAME EXPORT METRICS filename

where:

PLUGIN_NAME is the identifier for the code plug-in such as "TRACE"
filename is the name of the file being created (This name should be contained in quotes.)

example:

TRACE EXPORT METRICS "TypPwrMetrics.xml"

A shell script can be created that will loop through a series of series of models, generating the batch commands required to import each into SNAP and then export the a metrics file.

Once the metrics data has been loaded, TSA can be used to generate summary and detailed reports detaining the options that are included in the test suite. In addition, custom and freeform queries may be used to explore the data.

UPDATE 2/17/2006: The TSA distribution has been updated.

Changes in version 1.0.1 include:

• Corrected a problem in the generation of project statistics reports.