Verification Test Results for python-socket-oneline



Automated Test Summary

Test Run Details

Summary

Requirements Summary
Count Percentage
#Requirements 14 100.0%
Manual Requirements 0 0.0%
Manual & Auto Requirements 0 0.0%
Automated Requirements 14 100.0%
Invalid 0 0.0%
PASS 14 100.0%
FAIL 0 0.0%
Not tested 0 0.0%

Protocol Summary
Count Percentage
#Protocols 10 100.0%
PASS 10 100.0%
FAIL 0 0.0%


Test Run Details

Test Protocols with results

TP-001: basic server tests Start date : 2024-09-24 20:14:15 MDT
At: test_tp001_basic.py(40) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A start server None None PASS 2024-09-24 20:14:15
tester: auto
None
2 SRS-001 verify parameters are set correctly not None <bound method VerServer._callback of <ver.core.ver_server.VerServer object at 0x7fe461dab310>> PASS 2024-09-24 20:14:15
tester: auto
test_tp001_basic.py(51)
3 SRS-001 verify server is running True True PASS 2024-09-24 20:14:15
tester: auto
test_tp001_basic.py(55)
4 SRS-011 start client True True PASS 2024-09-24 20:14:15
tester: auto
test_tp001_basic.py(60)
5 SRS-012 client requests shutdown False False PASS 2024-09-24 20:14:15
tester: auto
test_tp001_basic.py(65)
6 SRS-006 verify server is not running False False PASS 2024-09-24 20:14:15
tester: auto
test_tp001_basic.py(68)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not
SRS-006 The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011 The Client shall connect to a given Server when requested
SRS-012 The Client shall disconnect from the Server when requested


TP-002: common commands Start date : 2024-09-24 20:14:15 MDT
At: test_tp002_common_cmds.py(42) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A start server None None PASS 2024-09-24 20:14:15
tester: auto
None
2 SRS-001 verify server is running True True PASS 2024-09-24 20:14:15
tester: auto
test_tp002_common_cmds.py(48)
3 SRS-011 start client True True PASS 2024-09-24 20:14:15
tester: auto
test_tp002_common_cmds.py(53)
4 SRS-004
SRS-013
SRS-015
verify ping works pong pong PASS 2024-09-24 20:14:15
tester: auto
test_tp002_common_cmds.py(57)
5 N/A set the callback function None None PASS 2024-09-24 20:14:15
tester: auto
None
6 SRS-007
SRS-008
SRS-013
SRS-015
verify user cmd with callback works False False PASS 2024-09-24 20:14:15
tester: auto
test_tp002_common_cmds.py(71)
7 SRS-007
SRS-008
SRS-013
SRS-015
verify invalid cmd with callback works abcd abcd PASS 2024-09-24 20:14:15
tester: auto
test_tp002_common_cmds.py(84)
8 SRS-005
SRS-006
SRS-012
client requests disconnect True True PASS 2024-09-24 20:14:15
tester: auto
test_tp002_common_cmds.py(91)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not
SRS-004 The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-005 The Server shall respond to a 'disconnect' command by disconnecting from the current Client
SRS-006 The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-007 The Server shall respond to invalid commands by setting is_invalid parameter to True to callback function
SRS-008 The Server shall respond to other commands by calling the given callback function
SRS-011 The Client shall connect to a given Server when requested
SRS-012 The Client shall disconnect from the Server when requested
SRS-013 The Client shall send a command to the Server when requested
SRS-015 The Client shall receive a response from the Server when requested


TP-003: disconnect then reconnect with a new client Start date : 2024-09-24 20:14:16 MDT
At: test_tp003_new_client.py(39) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A start server None None PASS 2024-09-24 20:14:16
tester: auto
None
2 SRS-001 verify server is running True True PASS 2024-09-24 20:14:16
tester: auto
test_tp003_new_client.py(45)
3 SRS-011 start client True True PASS 2024-09-24 20:14:16
tester: auto
test_tp003_new_client.py(50)
4 SRS-004
SRS-013
SRS-015
verify ping works pong pong PASS 2024-09-24 20:14:16
tester: auto
test_tp003_new_client.py(54)
5 SRS-012 client requests disconnect False False PASS 2024-09-24 20:14:16
tester: auto
test_tp003_new_client.py(58)
6 SRS-011 start new client True True PASS 2024-09-24 20:14:16
tester: auto
test_tp003_new_client.py(63)
7 SRS-004
SRS-013
SRS-015
verify ping works pong pong PASS 2024-09-24 20:14:16
tester: auto
test_tp003_new_client.py(67)
8 SRS-006
SRS-012
client requests shutdown False False PASS 2024-09-24 20:14:16
tester: auto
test_tp003_new_client.py(75)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not
SRS-004 The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-006 The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011 The Client shall connect to a given Server when requested
SRS-012 The Client shall disconnect from the Server when requested
SRS-013 The Client shall send a command to the Server when requested
SRS-015 The Client shall receive a response from the Server when requested


TP-004: basic client tests Start date : 2024-09-24 20:14:16 MDT
At: test_tp004_basic_client.py(37) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A start client None None PASS 2024-09-24 20:14:16
tester: auto
None
2 SRS-002 verify parameters are set correctly True True PASS 2024-09-24 20:14:16
tester: auto
test_tp004_basic_client.py(47)

Req. Desc.
SRS-002 The Client shall check if the current parameters are set and indicate if they are set or not


TP-005: connect a client, attempt to connect with another client Start date : 2024-09-24 20:14:16 MDT
At: test_tp005_two_clients.py(38) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A start server None None PASS 2024-09-24 20:14:16
tester: auto
None
2 SRS-001 verify server is running True True PASS 2024-09-24 20:14:16
tester: auto
test_tp005_two_clients.py(44)
3 SRS-011 start client1 True True PASS 2024-09-24 20:14:16
tester: auto
test_tp005_two_clients.py(49)
4 SRS-004
SRS-006
verify ping works on client1 True True PASS 2024-09-24 20:14:16
tester: auto
test_tp005_two_clients.py(56)
5 N/A start new client2 None None PASS 2024-09-24 20:14:16
tester: auto
None
6 SRS-003 verify client1 is still connected, and client2 is not True True PASS 2024-09-24 20:14:19
tester: auto
test_tp005_two_clients.py(65)
7 SRS-006 client1 requests shutdown False False PASS 2024-09-24 20:14:19
tester: auto
test_tp005_two_clients.py(72)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not
SRS-003 The Server shall allow only one Client to connect at a time
SRS-004 The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-006 The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011 The Client shall connect to a given Server when requested


TP-006: send 2 commands in one string Start date : 2024-09-24 20:14:20 MDT
At: test_tp006_two_cmds.py(42) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 SRS-001 start server True True PASS 2024-09-24 20:14:20
tester: auto
test_tp006_two_cmds.py(46)
2 SRS-001 verify server is running True True PASS 2024-09-24 20:14:20
tester: auto
test_tp006_two_cmds.py(51)
3 N/A start client None None PASS 2024-09-24 20:14:20
tester: auto
None
4 N/A send two commands in one string None None PASS 2024-09-24 20:14:20
tester: auto
None
5 SRS-009
SRS-014
verify 1st response is for ping pong pong PASS 2024-09-24 20:14:20
tester: auto
test_tp006_two_cmds.py(62)
6 SRS-009
SRS-014
verify 1st response is for cmd01 ut_rsp ut_rsp PASS 2024-09-24 20:14:20
tester: auto
test_tp006_two_cmds.py(66)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not
SRS-009 The Server shall define the end of a command to be the 0x0A byte
SRS-014 The Client shall send automatically append an 0x0A byte to a command sent to the Server


TP-007: check server and client arguments Start date : 2024-09-24 20:14:20 MDT
At: test_tp007_check_args.py(38) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 SRS-001 initiate Server with all arguments to start() True True PASS 2024-09-24 20:14:20
tester: auto
test_tp007_check_args.py(53)
2 SRS-001 initiate Server missing ip_address True True PASS 2024-09-24 20:14:22
tester: auto
test_tp007_check_args.py(68)
3 SRS-001 initiate Server missing ip_port True True PASS 2024-09-24 20:14:22
tester: auto
test_tp007_check_args.py(83)
4 SRS-001 initiate Server missing callback True True PASS 2024-09-24 20:14:22
tester: auto
test_tp007_check_args.py(98)
5 SRS-001 initiate Server missing logger True True PASS 2024-09-24 20:14:22
tester: auto
test_tp007_check_args.py(113)
6 SRS-001 initiate Server missing verbose (default False) False False PASS 2024-09-24 20:14:23
tester: auto
test_tp007_check_args.py(127)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not


TP-008: check server and client arguments Start date : 2024-09-24 20:14:24 MDT
At: test_tp008_client_sever_args.py(35) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 SRS-001 initiate Server with all arguments to init() True True PASS 2024-09-24 20:14:24
tester: auto
test_tp008_client_sever_args.py(48)
2 SRS-001 initiate Server missing ip_address True True PASS 2024-09-24 20:14:24
tester: auto
test_tp008_client_sever_args.py(61)
3 SRS-001 initiate Server missing ip_port True True PASS 2024-09-24 20:14:24
tester: auto
test_tp008_client_sever_args.py(74)
4 SRS-001 initiate Server missing logger True True PASS 2024-09-24 20:14:24
tester: auto
test_tp008_client_sever_args.py(87)
5 SRS-001 initiate Server missing verbose (default False) False False PASS 2024-09-24 20:14:24
tester: auto
test_tp008_client_sever_args.py(99)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not


TP-009: connect a client, attempt to reconnect with the same client Start date : 2024-09-24 20:14:24 MDT
At: test_tp009_reconnect.py(38) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A start server None None PASS 2024-09-24 20:14:24
tester: auto
None
2 SRS-001 verify server is running True True PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(44)
3 SRS-011 start client True True PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(49)
4 SRS-004 verify ping works on client pong pong PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(53)
5 SRS-006 verify server is still running True True PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(56)
6 SRS-011 client attempt to reconnect True True PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(60)
7 SRS-004 verify ping still works on client pong pong PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(64)
8 SRS-006 verify server is still running True True PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(67)
9 SRS-006 client requests shutdown False False PASS 2024-09-24 20:14:24
tester: auto
test_tp009_reconnect.py(74)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not
SRS-004 The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-006 The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011 The Client shall connect to a given Server when requested


TP-010: connect and then server exits Start date : 2024-09-24 20:14:24 MDT
At: test_tp010_is_connected.py(43) Requirements : see below
Software Version: N/A Serial number: N/A
Objectives: N/A
Preconditions: N/A Deviations: N/A
Step Req. Execution Instructions Expected Actual Pass / Fail Date
1 N/A check if client is connected before server is started False False PASS 2024-09-24 20:14:24
tester: auto
test_tp010_is_connected.py(48)
2 N/A start server False False PASS 2024-09-24 20:14:24
tester: auto
test_tp010_is_connected.py(52)
3 SRS-001 verify server is running False False PASS 2024-09-24 20:14:25
tester: auto
test_tp010_is_connected.py(56)
4 SRS-011 start client True True PASS 2024-09-24 20:14:25
tester: auto
test_tp010_is_connected.py(61)
5 SRS-007
SRS-008
SRS-013
SRS-015
set the callback function False False PASS 2024-09-24 20:14:25
tester: auto
test_tp010_is_connected.py(90)

Req. Desc.
SRS-001 The Server shall check if the current parameters are set and indicate if they are set or not
SRS-007 The Server shall respond to invalid commands by setting is_invalid parameter to True to callback function
SRS-008 The Server shall respond to other commands by calling the given callback function
SRS-011 The Client shall connect to a given Server when requested
SRS-013 The Client shall send a command to the Server when requested
SRS-015 The Client shall receive a response from the Server when requested




Trace Matrix

Test Run Details

Trace Matrix

Req. Id Protocol
SRS-001
(auto)
Desc: The Server shall check if the current parameters are set and indicate if they are set or not

TP-001 test_tp001_basic.py(46)
TP-001 test_tp001_basic.py(47)
TP-001 test_tp001_basic.py(48)
TP-001 test_tp001_basic.py(49)
TP-001 test_tp001_basic.py(50)
TP-001 test_tp001_basic.py(51)
TP-001 test_tp001_basic.py(55)
TP-002 test_tp002_common_cmds.py(48)
TP-003 test_tp003_new_client.py(45)
TP-005 test_tp005_two_clients.py(44)
TP-006 test_tp006_two_cmds.py(46)
TP-006 test_tp006_two_cmds.py(51)
TP-007 test_tp007_check_args.py(48)
TP-007 test_tp007_check_args.py(49)
TP-007 test_tp007_check_args.py(50)
TP-007 test_tp007_check_args.py(51)
TP-007 test_tp007_check_args.py(52)
TP-007 test_tp007_check_args.py(53)
TP-007 test_tp007_check_args.py(63)
TP-007 test_tp007_check_args.py(64)
TP-007 test_tp007_check_args.py(65)
TP-007 test_tp007_check_args.py(66)
TP-007 test_tp007_check_args.py(67)
TP-007 test_tp007_check_args.py(68)
TP-007 test_tp007_check_args.py(78)
TP-007 test_tp007_check_args.py(79)
TP-007 test_tp007_check_args.py(80)
TP-007 test_tp007_check_args.py(81)
TP-007 test_tp007_check_args.py(82)
TP-007 test_tp007_check_args.py(83)
TP-007 test_tp007_check_args.py(93)
TP-007 test_tp007_check_args.py(94)
TP-007 test_tp007_check_args.py(95)
TP-007 test_tp007_check_args.py(96)
TP-007 test_tp007_check_args.py(97)
TP-007 test_tp007_check_args.py(98)
SRS-001
(auto) (cont'd)
Desc: The Server shall check if the current parameters are set and indicate if they are set or not

TP-007 test_tp007_check_args.py(108)
TP-007 test_tp007_check_args.py(109)
TP-007 test_tp007_check_args.py(110)
TP-007 test_tp007_check_args.py(111)
TP-007 test_tp007_check_args.py(112)
TP-007 test_tp007_check_args.py(113)
TP-007 test_tp007_check_args.py(122)
TP-007 test_tp007_check_args.py(123)
TP-007 test_tp007_check_args.py(124)
TP-007 test_tp007_check_args.py(125)
TP-007 test_tp007_check_args.py(126)
TP-007 test_tp007_check_args.py(127)
TP-008 test_tp008_client_sever_args.py(44)
TP-008 test_tp008_client_sever_args.py(45)
TP-008 test_tp008_client_sever_args.py(46)
TP-008 test_tp008_client_sever_args.py(47)
TP-008 test_tp008_client_sever_args.py(48)
TP-008 test_tp008_client_sever_args.py(57)
TP-008 test_tp008_client_sever_args.py(58)
TP-008 test_tp008_client_sever_args.py(59)
TP-008 test_tp008_client_sever_args.py(60)
TP-008 test_tp008_client_sever_args.py(61)
TP-008 test_tp008_client_sever_args.py(70)
TP-008 test_tp008_client_sever_args.py(71)
TP-008 test_tp008_client_sever_args.py(72)
TP-008 test_tp008_client_sever_args.py(73)
TP-008 test_tp008_client_sever_args.py(74)
TP-008 test_tp008_client_sever_args.py(83)
TP-008 test_tp008_client_sever_args.py(84)
TP-008 test_tp008_client_sever_args.py(85)
TP-008 test_tp008_client_sever_args.py(86)
TP-008 test_tp008_client_sever_args.py(87)
TP-008 test_tp008_client_sever_args.py(95)
TP-008 test_tp008_client_sever_args.py(96)
TP-008 test_tp008_client_sever_args.py(97)
TP-008 test_tp008_client_sever_args.py(98)
SRS-001
(auto) (cont'd)
Desc: The Server shall check if the current parameters are set and indicate if they are set or not

TP-008 test_tp008_client_sever_args.py(99)
TP-009 test_tp009_reconnect.py(44)
TP-010 test_tp010_is_connected.py(55)
SRS-002
(auto)
Desc: The Client shall check if the current parameters are set and indicate if they are set or not

TP-004 test_tp004_basic_client.py(44)
TP-004 test_tp004_basic_client.py(45)
TP-004 test_tp004_basic_client.py(46)
TP-004 test_tp004_basic_client.py(47)
SRS-003
(auto)
Desc: The Server shall allow only one Client to connect at a time

TP-005 test_tp005_two_clients.py(64)
TP-005 test_tp005_two_clients.py(65)
SRS-004
(auto)
Desc: The Server shall respond to a 'ping' command by sending a 'pong' response

TP-002 test_tp002_common_cmds.py(57)
TP-003 test_tp003_new_client.py(54)
TP-003 test_tp003_new_client.py(67)
TP-005 test_tp005_two_clients.py(53)
TP-009 test_tp009_reconnect.py(53)
TP-009 test_tp009_reconnect.py(64)
SRS-005
(auto)
Desc: The Server shall respond to a 'disconnect' command by disconnecting from the current Client

TP-002 test_tp002_common_cmds.py(91)
SRS-006
(auto)
Desc: The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process

TP-001 test_tp001_basic.py(68)
TP-002 test_tp002_common_cmds.py(91)
TP-003 test_tp003_new_client.py(75)
TP-005 test_tp005_two_clients.py(56)
TP-005 test_tp005_two_clients.py(72)
TP-009 test_tp009_reconnect.py(56)
TP-009 test_tp009_reconnect.py(67)
TP-009 test_tp009_reconnect.py(74)
SRS-007
(auto)
Desc: The Server shall respond to invalid commands by setting is_invalid parameter to True to callback function

TP-002 test_tp002_common_cmds.py(71)
TP-002 test_tp002_common_cmds.py(79)
TP-002 test_tp002_common_cmds.py(81)
TP-002 test_tp002_common_cmds.py(84)
TP-010 test_tp010_is_connected.py(71)
SRS-008
(auto)
Desc: The Server shall respond to other commands by calling the given callback function

TP-002 test_tp002_common_cmds.py(68)
TP-002 test_tp002_common_cmds.py(69)
TP-002 test_tp002_common_cmds.py(70)
TP-002 test_tp002_common_cmds.py(80)
TP-010 test_tp010_is_connected.py(68)
TP-010 test_tp010_is_connected.py(69)
TP-010 test_tp010_is_connected.py(70)
SRS-009
(auto)
Desc: The Server shall define the end of a command to be the 0x0A byte

TP-006 test_tp006_two_cmds.py(62)
TP-006 test_tp006_two_cmds.py(66)
SRS-011
(auto)
Desc: The Client shall connect to a given Server when requested

TP-001 test_tp001_basic.py(60)
TP-002 test_tp002_common_cmds.py(53)
TP-003 test_tp003_new_client.py(50)
TP-003 test_tp003_new_client.py(63)
TP-005 test_tp005_two_clients.py(49)
TP-009 test_tp009_reconnect.py(49)
TP-009 test_tp009_reconnect.py(60)
TP-010 test_tp010_is_connected.py(60)
SRS-012
(auto)
Desc: The Client shall disconnect from the Server when requested

TP-001 test_tp001_basic.py(65)
TP-002 test_tp002_common_cmds.py(88)
TP-003 test_tp003_new_client.py(58)
TP-003 test_tp003_new_client.py(71)
SRS-013
(auto)
Desc: The Client shall send a command to the Server when requested

TP-002 test_tp002_common_cmds.py(57)
TP-002 test_tp002_common_cmds.py(69)
TP-002 test_tp002_common_cmds.py(81)
TP-003 test_tp003_new_client.py(54)
TP-003 test_tp003_new_client.py(67)
TP-010 test_tp010_is_connected.py(69)
SRS-014
(auto)
Desc: The Client shall send automatically append an 0x0A byte to a command sent to the Server

TP-006 test_tp006_two_cmds.py(62)
TP-006 test_tp006_two_cmds.py(66)
SRS-015
(auto)
Desc: The Client shall receive a response from the Server when requested

TP-002 test_tp002_common_cmds.py(57)
TP-002 test_tp002_common_cmds.py(68)
TP-002 test_tp002_common_cmds.py(81)
TP-003 test_tp003_new_client.py(54)
TP-003 test_tp003_new_client.py(67)
TP-010 test_tp010_is_connected.py(68)