Does baseline criteria give expected output?

Hello,

I am working on MIL V&V testing for software components. I am using baseline testing in test manager and running test cases using Excel spreadsheet.

But some how we are feeling the capturing baseline criteria and running test case is same way of simulating values in matlab models.

I would like to know Is it correct way to use baseline criteria? Is there any aleternative way to capture expetcted output and then run test cases in test manager?

Answer 1

[Paul Urban]

There are multiple ways to capture expected outputs for a test case. In addition to Excel there are Test Assessment Blocks, verify statements, Temporal Assessment that can also be used. This topic in the documentation provides a summary of the other options available to capture expected outputs:

https://www.mathworks.com/help/sltest/test-sequences-and-assessments.html?s_tid=CRUX_lftnav

Answer 2

[Sunny Jotrao]

Okay let me restructure my question again here - What is difference between running test case from test manager and capturing baseline criteria. Does it run same engine to generate output?

[Paul Urban]

Thanks for the clarification. The Capture baseline operation runs a simulation and saves the output into a file. It is expected to pass without any model or test changes if run immediately after capturing the baseline. One use case for this is to capture the current baseline for future regression testing. Here is an example where a baseline is captured and then there is a change in the model which is detected by the baseline test.

https://www.mathworks.com/help/sltest/ug/compare-model-output-to-baseline-data.html

There is also an example where the baseline is captured and then a parameter is overridden which causes the test to fail.

https://www.mathworks.com/help/sltest/examples/overriding-model-parameters-in-a-test-case.html

You could also use the captured baseline as a starting point to edit the expected test outputs directly in the Excel or MAT file. There is a video here that shows how to do this: https://www.mathworks.com/videos/using-excel-to-define-tests-with-simulink-test-1550492730713.html

Another way to get pass/fail criteria is to use verify statements. There is an example here where a Check Static Upper Bound block is used to check the value of a signal:

https://www.mathworks.com/help/sltest/ug/set-up-a-simulation-test-case.html

There are many different options available for creating tests and test criteria. If you need further assistance then you could contact your sales person or contact Technical Support directly by creating a service request.