Test assessment in TPT
In TPT, test results can be automatically assessed by using assessment rules (assesslets).
Manual assessment can be done with the Signal Viewer by PikeTec.
By using the Dashboard by PikeTec you can, thanks to visual feedback, even assess test cases during the test run.
Assess tests manually
TPT supports manual assessment with the Signal Viewer. With this tool, you can assess individual test runs graphically.
Functions like zooming, scaling of the view, several parallel windows, managing of display configurations,
as well as several cursors at the same time, and the display of differences are part of the Signal Viewer.
As an alternative, you can create graphical interfaces with the Dashboard by PikeTec
to interact with the system under test and to receive immediately optical feedback.
Assess tests rule-based with assesslets
You can set up several rules for assessing your tests. For typical and standardized
assessments, predefined graphical forms, called in TPT "assesslets", are available.
The Min/Max comparison assesslet
is used to check if a signal lies in a predefined value range or if values always occur between two other signals.
The signal comparison assesslet makes it possible to compare one or more signals in consideration of possible tolerances. The tolerances can be absolute, relative, or temporal. Tolerances can also depend on signal scaling.
Equivalence classes check
The equivalence classes check assesslet is used to inspect if the executed tests have been sufficient to cover all defined equivalence classes. The coverage of the equivalence classes is document in a statistical overview
Check causal rules
Using the trigger rule assesslet, if-then rules with temporal and logical marginal conditions can be checked. The check itself is activated or deactivate by specific activation /deactivation conditions. Restrictions in time and stop criteria can be set.
Assess tests using a script
In TPT, a very powerful and flexible script language can be used for the test assessment. With this so-called TPT assessment script, it’s possible to calculate signals deduced from recorded test data, to identify test phases, to assess signals and their dependencies, to document the analysis in a report, and to reuse repetitive assessment rules as libraries.
The TPT assessment script is based on Python, so that besides the
TPT-specific functions, all other Python functions can be used.
Test assessments can be test case specific or they can represent universal
rules that are run in all test cases to observe the fulfillment or non-fulfillment of the rules.
To extract interesting information from signals, often a preprocessing is necessary. In TPT, calculations can be performed with single or more signals. To run these calculations, mathematic operators and signal processing functions like filter functions are available.
Test phases can be found in signals by setting up temporal example descriptions. In the identified test phases, further restrictions of phases can be calculated or characteristics can be checked.
Run regression tests
If test results from former tests are available, a regression or back-to-back test is an option. That is, the new test results are compared with the old ones. This way, it can be automatically verified if the system still behaves the same. If differences are detected, TPT will document these deviations as well as their location of occurrence during the test run.
TPT can handle regression tests with fault-tolerant signal comparison. A tolerant range for the reference data can be specified. Temporal, absolute, or relative tolerance is definable in TPT as well as tolerances depending on the scaling of the signals. This scaling-dependent tolerance is especially useful for the comparison of physical tests as Model-in-the-Loop (MIL) with data from Software-in-the-Loop (SIL) tests.
Copyright © www.piketec.com All rights reserved