Test assessment in TPT
There are a lot of different assessment methods in TPT that are aimed at specific problems.
The spectrum extends from simple signal value comparisons at a certain point in time
to comparisons of signals with a given curve as reference
up to freely configurable assessment rules that are written in a Python based language.
TPT automatically logs each assessment result and each deviation from the expected behavior.
Finally, TPT presents the assessment in a neatly arranged report.
Tests in TPT can be assessed...
You can use the Dashboard by PikeTec for manual testing whilst executing the test. To assess tests manually after the test execution, the Signal Viewer by PikeTec is the right choice.
By assessment rules
Tests can be assessed based on the recorded test data. Graphical user interfaces, so-called "assesslets", for standardized checks like back-to-back analysis are available. For more complex analyses, you can use an elaborated specific script language.
Assess tests manually
TPT supports manual assessment with the Signal Viewer. With this tool, you can assess individual test runs graphically.
Functions like zooming, scaling of the view, several parallel windows, managing of display configurations,
as well as several cursors at the same time, and the display of differences are part of the Signal Viewer.
As an alternative, you can create graphical interfaces with the Dashboard by PikeTec
to interact with the system under test and to receive immediately optical feedback.
Assess tests rule-based with assesslets
You can set up several rules for assessing your tests. For typical and standardized assessments, predefined graphical forms, called in TPT "assesslets", are available.
The Min/Max comparison assesslet is used to check if a signal lies in a pre-defined value range or if values always occur between two other signals.
The signal comparison assesslet makes it possible to compare one or more signals in consideration of possible tolerances. The tolerances can be absolute, relative, or temporal. Tolerances can also depend on signal scaling.
Equivalence classes check
The equivalence classes check assesslet is used to inspect if the executed tests have been sufficient to cover all defined equivalence classes. The coverage of the equivalence classes is document in a statistical overview
Check causal rules
Using the trigger rule assesslet, if-then rules with temporal and logical marginal conditions can be checked. The check itself is activated or deactivate by specific activation /deactivation conditions. Restrictions in time and stop criteria can be set.
Assess tests using a script
In TPT, a very powerful and flexible script language can be used for the test assessment. With this so-called TPT assessment script, it’s possible to calculate signals deduced from recorded test data, to identify test phases, to assess signals and their dependencies, to document the analysis in a report, and to reuse repetitive assessment rules as libraries.
The TPT assessment script is based on Python, so that besides the TPT-specific functions,
all other Python functions can be used.
Test assessments can be test case specific or they can represent universal rules that are run in all test cases
to observe the fulfillment or non-fulfillment of the rules.
To extract interesting information from signals, often a preprocessing is necessary. In TPT, calculations can be performed with single or more signals. To run these calculations, mathematic operators and signal processing functions like filter functions are available.
Test phases can be found in signals by setting up temporal example descriptions. In the identified test phases, further restrictions of phases can be calculated or characteristics can be checked.
Run regression tests
If test results from former tests are available, a regression or back-to-back test is an option. That is, the new test results are compared with the old ones. This way, it can be automatically verified if the system still behaves the same. If differences are detected, TPT will document these deviations as well as their location of occurrence during the test run.
TPT can handle regression tests with fault-tolerant signal comparison. A tolerant range for the reference data can be specified. Temporal, absolute, or relative tolerance is definable in TPT as well as tolerances depending on the scaling of the signals. This scaling-dependent tolerance is especially useful for the comparison of physical tests as Model-in-the-Loop (MIL) with data from Software-in-the-Loop (SIL) tests.
Copyright © www.piketec.com All rights reserved