Test assessment in TPT

There are a lot of different assessment methods in TPT that are aimed at specific problems.
The spectrum extends from simple signal value comparisons at a certain point in time
to comparisons of signals with a given curve as reference
up to freely configurable assessment rules that are written in a Python based language.

TPT automatically logs each assessment result and each deviation from the expected behavior.
Finally, TPT presents the assessment in a neatly arranged report.

Tests in TPT can be assessed...


Manually

You can use the Dashboard by PikeTec for manual testing whilst executing the test. To assess tests manually after the test execution, the Signal Viewer by PikeTec is the right choice.

By assessment rules

Tests can be assessed based on the recorded test data. Graphical user interfaces, so-called "assesslets", for standardized checks like back-to-back analysis are available. For more complex analyses, you can use an elaborated specific script language.

Assess tests manually

TPT supports manual assessment with the Signal Viewer. With this tool, you can assess individual test runs graphically.
Functions like zooming, scaling of the view, several parallel windows, managing of display configurations,
as well as several cursors at the same time, and the display of differences are part of the Signal Viewer.

As an alternative, you can create graphical interfaces with the Dashboard by PikeTec
to interact with the system under test and to receive immediately optical feedback.


TPT Signal Viewer

The Signal Viewer in TPT can handle test and measurement data in different file formats like *.mat, *.mdf, *.dat, or *.csv. Browsing the different data and its dependencies is easy and allows debugging and test evaluation.

You can use several filter options, several windows, signal display modes, and two cursors in the Test Data Viewer for the manual evaluation.

Dashboard

The Dashboard by PikeTec enables you to create customized interfaces, interact with the system under test and observe the system behavior graphically. This way, the test assessment is easy and problem-oriented.

With the Dashboard, you can stimulate a system by using grafical elements and also observe the behavior of the system during runtime.

Assess tests rule-based with assesslets

You can set up several rules for assessing your tests. For typical and standardized assessments, predefined graphical forms, called in TPT "assesslets", are available.


Min/Max comparison

The Min/Max comparison assesslet is used to check if a signal lies in a pre-defined value range or if values always occur between two other signals.

  • Min/Max Comparison assesslet

Signal comparison

The signal comparison assesslet makes it possible to compare one or more signals in consideration of possible tolerances. The tolerances can be absolute, relative, or temporal. Tolerances can also depend on signal scaling.

  • Signal Comparison assesslet

Equivalence classes check

The equivalence classes check assesslet is used to inspect if the executed tests have been sufficient to cover all defined equivalence classes. The coverage of the equivalence classes is document in a statistical overview

  • Equivalence Classes assesslet

Check causal rules

Using the trigger rule assesslet, if-then rules with temporal and logical marginal conditions can be checked. The check itself is activated or deactivate by specific activation /deactivation conditions. Restrictions in time and stop criteria can be set.

  • Trigger Rule assesslet

Sequence check

The sequence check assesslet can inspect consecutive phases based on signal characteristics.

  • Sequence Check assesslet

Assess tests using a script

In TPT, a very powerful and flexible script language can be used for the test assessment. With this so-called TPT assessment script, it’s possible to calculate signals deduced from recorded test data, to identify test phases, to assess signals and their dependencies, to document the analysis in a report, and to reuse repetitive assessment rules as libraries.

The TPT assessment script is based on Python, so that besides the TPT-specific functions,
all other Python functions can be used.

Test assessments can be test case specific or they can represent universal rules that are run in all test cases
to observe the fulfillment or non-fulfillment of the rules.


Signal preprocessing

To extract interesting information from signals, often a preprocessing is necessary. In TPT, calculations can be performed with single or more signals. To run these calculations, mathematic operators and signal processing functions like filter functions are available.

In the script assesslet, you can use special TPT filter functions. The context menu helps you to find out how and for what to use them.

Extracting phases

Test phases can be found in signals by setting up temporal example descriptions. In the identified test phases, further restrictions of phases can be calculated or characteristics can be checked.

Script assesslet with TPT assessment functions.

Assessment

To assess tests, the TPT assessment provides a multitude of options. Among other things, runtime, gradients, signal leaps, differences, and chronological orders can be inspected.

In the script assesslet, you can use a bunch of special TPT functions for the assessment. The context help will show you how and when to use them.

Run regression tests

If test results from former tests are available, a regression or back-to-back test is an option. That is, the new test results are compared with the old ones. This way, it can be automatically verified if the system still behaves the same. If differences are detected, TPT will document these deviations as well as their location of occurrence during the test run.

TPT can handle regression tests with fault-tolerant signal comparison. A tolerant range for the reference data can be specified. Temporal, absolute, or relative tolerance is definable in TPT as well as tolerances depending on the scaling of the signals. This scaling-dependent tolerance is especially useful for the comparison of physical tests as Model-in-the-Loop (MIL) with data from Software-in-the-Loop (SIL) tests.


TPT is able to run regression tests.

Follow us