Verification Test Results for medver-pytest



Automated Test Summary

Test Run Details

Summary

Requirements Summary
Count Percentage
#Requirements 7 100.0%
Manual Requirements 4 57.1%
Manual & Auto Requirements 1 14.3%
Automated Requirements 4 100.0%
Invalid 0 0.0%
PASS 1 25.0%
FAIL 1 25.0%
Not tested 2 50.0%

Protocol Summary
Count Percentage
#Protocols 11 100.0%
PASS 10 90.9%
FAIL 1 9.1%


Test Run Details

Test Protocols with results

TP-0001: iuv: test no steps Start date : 2024-12-11 12:02:45 MST
At: test_iuv_protocol_steps0.py(66) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
No steps found

Req. Desc.
N/A No requirements found


TP-0002: iuv: test description Start date : 2024-12-11 12:02:45 MST
At: test_iuv_protocol_steps2.py(82) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A step1 None None PASS 2024-12-11 12:02:45
tester: auto
None
2 N/A step2 None None PASS 2024-12-11 12:02:45
tester: auto
None

Req. Desc.
N/A No requirements found


TP-0003: iuv: test steps with results Start date : 2024-12-11 12:02:46 MST
At: test_iuv_protocol_steps_with_results.py(133) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-002 do pass & fail result 1 2 FAIL 2024-12-11 12:02:46
tester: auto
test_iuv_protocol_steps_with_results.py(136)

Req. Desc.
MOCK-002 mock requirement 002


TP-0004: iuv: test headinfo Start date : 2024-12-11 12:02:44 MST
At: test_iuv_protocol_headinfo.py(65) Requirements : see below
Software Version: v99.99.99 Serial number: SN9999
Objectives:
  • obj1
  • obj2
Preconditions:
  • pre1
  • pre2
Deviations:
  • dev1
  • dev2
Step Req. Execution Instructions Expected Actual Pass / Fail Date
No steps found

Req. Desc.
N/A No requirements found


TP-0005: check verify() without a step Start date : 2024-12-11 12:02:45 MST
At: test_iuv_protocol_nostep_verify.py(43) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
No steps found

Req. Desc.
N/A No requirements found


TP-0006: iuv: test comment Start date : 2024-12-11 12:02:46 MST
At: test_iuv_protocol_steps_with_comments.py(66) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A step1 None None PASS 2024-12-11 12:02:46
tester: auto
None
Note: comment1

Req. Desc.
N/A No requirements found


TP-0007: check verify() without a step Start date : 2024-12-11 12:02:45 MST
At: test_iuv_protocol_nostep_comment.py(43) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
No steps found

Req. Desc.
N/A No requirements found


TP-0008: check initial protocol-id Start date : 2024-12-11 12:02:44 MST
At: test_iuv_protocol_duplicateid.py(62) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
No steps found

Req. Desc.
N/A No requirements found


TP-0009: check duplicate protocol-id2 Start date : 2024-12-11 12:02:44 MST
At: test_iuv_protocol_duplicateid.py(58) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 step1 True True PASS 2024-12-11 12:02:44
tester: auto
test_iuv_protocol_duplicateid.py(60)

Req. Desc.
MOCK-001 mock requirement 001


TP-0010: iuv: test headinfo #2 Start date : 2024-12-11 12:02:44 MST
At: test_iuv_protocol_headinfo2.py(65) Requirements : see below
Software Version: v99.99.98 Serial number: SN9998
Objectives:
  • obj1
Preconditions:
  • pre1
Deviations:
  • dev1
Step Req. Execution Instructions Expected Actual Pass / Fail Date
No steps found

Req. Desc.
N/A No requirements found


TP-0101: test the formatter with expected tag Start date : 2024-12-11 12:02:42 MST
At: test_iuv_formatter_actual_tag.py(67) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 actual_tag is "same" - pass 0x23 same PASS 2024-12-11 12:02:42
tester: auto
test_iuv_formatter_actual_tag.py(75)

Req. Desc.
MOCK-001 mock requirement 001


TP-0113: test the formatter with default hex Start date : 2024-12-11 12:02:43 MST
At: test_iuv_formatter_bytearray.py(119) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 as_hex - bytearray - pass 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F 10 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F 10 PASS 2024-12-11 12:02:43
tester: auto
test_iuv_formatter_bytearray.py(126)

Req. Desc.
MOCK-001 mock requirement 001


TP-0123: test the formatter with default hex Start date : 2024-12-11 12:02:43 MST
At: test_iuv_formatter_bytes.py(117) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 as_hex - bytes - pass 01 02 03 04 05 06 07 08 09 0A 0B 01 02 03 04 05 06 07 08 09 0A 0B PASS 2024-12-11 12:02:43
tester: auto
test_iuv_formatter_bytes.py(124)

Req. Desc.
MOCK-001 mock requirement 001


TP-0131: test the formatter with no formatting Start date : 2024-12-11 12:02:43 MST
At: test_iuv_formatter_dict.py(60) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 normal - dict - pass {'test': 1} {'test': 1} PASS 2024-12-11 12:02:43
tester: auto
test_iuv_formatter_dict.py(63)

Req. Desc.
MOCK-001 mock requirement 001


TP-0143: test the formatter with hex format passed in Start date : 2024-12-11 12:02:43 MST
At: test_iuv_formatter_float.py(115) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 formatter with hex string - pass 1.23 1.23 PASS 2024-12-11 12:02:43
tester: auto
test_iuv_formatter_float.py(121)

Req. Desc.
MOCK-001 mock requirement 001


TP-0155: test the formatter with hex format passed in Start date : 2024-12-11 12:02:43 MST
At: test_iuv_formatter_int.py(175) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 formatter with hex string - pass 0x22 0x22 PASS 2024-12-11 12:02:43
tester: auto
test_iuv_formatter_int.py(181)

Req. Desc.
MOCK-001 mock requirement 001


TP-0161: test the formatter with no formatting Start date : 2024-12-11 12:02:44 MST
At: test_iuv_formatter_list.py(60) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 normal - list - pass [1, 2] [1, 2] PASS 2024-12-11 12:02:44
tester: auto
test_iuv_formatter_list.py(63)

Req. Desc.
MOCK-001 mock requirement 001


TP-0173: test formatter - str with default hex Start date : 2024-12-11 12:02:44 MST
At: test_iuv_formatter_str.py(115) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 as_hex - int - pass 61 62 63 61 62 63 PASS 2024-12-11 12:02:44
tester: auto
test_iuv_formatter_str.py(121)

Req. Desc.
MOCK-001 mock requirement 001


TP-0181: test formatter unicode Start date : 2024-12-11 12:02:44 MST
At: test_iuv_formatter_unicode.py(60) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 MOCK-001 normal - unicode - pass abc abc PASS 2024-12-11 12:02:44
tester: auto
test_iuv_formatter_unicode.py(63)

Req. Desc.
MOCK-001 mock requirement 001


TP-0400: test the logger Start date : 2024-12-11 12:02:44 MST
At: test_iuv_logger.py(38) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A normal - logger None None PASS 2024-12-11 12:02:44
tester: auto
None

Req. Desc.
N/A No requirements found




Trace Matrix

Test Run Details

Trace Matrix

Req. Id Protocol
MOCK-001
(manual)
Desc: mock requirement 001

TP-0009 test_iuv_protocol_duplicateid.py(60)
TP-0101 test_iuv_formatter_actual_tag.py(75)
TP-0113 test_iuv_formatter_bytearray.py(126)
TP-0123 test_iuv_formatter_bytes.py(124)
TP-0131 test_iuv_formatter_dict.py(63)
TP-0143 test_iuv_formatter_float.py(121)
TP-0155 test_iuv_formatter_int.py(181)
TP-0161 test_iuv_formatter_list.py(63)
TP-0173 test_iuv_formatter_str.py(121)
TP-0181 test_iuv_formatter_unicode.py(63)
MOCK-002
(manual)
Desc: mock requirement 002

TP-0003 test_iuv_protocol_steps_with_results.py(135)
TP-0003 test_iuv_protocol_steps_with_results.py(136)
TP-0009 test_iuv_protocol_duplicateid2.py(44)
MOCK-003
(manual)
Desc: mock requirement 003 - only for test_iuv_verify_fails

N/A
SRS-001
(auto)
Desc: The Device shall make every ABC equal

ERR missing test case for this requirement
SRS-002
(auto)
Desc: The Device shall make every DEF equal

ERR missing test case for this requirement
SRS-003
(both)
Desc: The Device shall make every GHI equal

ERR missing test case for this requirement
SRS-005
(auto)
Desc: (not tested) The Device shall make every JKL equal

ERR missing test case for this requirement