Verification Test Results for python-socket-oneline

Verification Test Results for python-socket-oneline

Automated Test Summary

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-10-22 14:44:04 MDT
medver-pytest version: v1.0.3

Summary

Requirements Summary
	Count	Percentage
#Requirements	14	100.0%
Manual Requirements	0	0.0%
Manual & Auto Requirements	0	0.0%
Automated Requirements	14	100.0%
Invalid	0	0.0%
PASS	14	100.0%
FAIL	0	0.0%
Not tested	0	0.0%

Protocol Summary
	Count	Percentage
#Protocols	10	100.0%
PASS	10	100.0%
FAIL	0	0.0%

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-10-22 14:44:04 MDT
medver-pytest version: v1.0.3

Test Protocols with results

TP-001: basic server tests	Start date : 2024-10-22 14:43:52 MDT
At: test_tp001_basic.py(40)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	start server	None	None	PASS	2024-10-22 14:43:52 tester: auto None
2	SRS-001	verify parameters are set correctly	not None	<bound method VerServer._callback of <ver.core.ver_server.VerServer object at 0x7ff83dd273d0>>	PASS	2024-10-22 14:43:52 tester: auto test_tp001_basic.py(51)
3	SRS-001	verify server is running	True	True	PASS	2024-10-22 14:43:52 tester: auto test_tp001_basic.py(55)
4	SRS-011	start client	True	True	PASS	2024-10-22 14:43:52 tester: auto test_tp001_basic.py(60)
5	SRS-012	client requests shutdown	False	False	PASS	2024-10-22 14:43:52 tester: auto test_tp001_basic.py(65)
6	SRS-006	verify server is not running	False	False	PASS	2024-10-22 14:43:53 tester: auto test_tp001_basic.py(68)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not
SRS-006	The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011	The Client shall connect to a given Server when requested
SRS-012	The Client shall disconnect from the Server when requested

TP-002: common commands	Start date : 2024-10-22 14:43:53 MDT
At: test_tp002_common_cmds.py(42)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	start server	None	None	PASS	2024-10-22 14:43:53 tester: auto None
2	SRS-001	verify server is running	True	True	PASS	2024-10-22 14:43:53 tester: auto test_tp002_common_cmds.py(48)
3	SRS-011	start client	True	True	PASS	2024-10-22 14:43:53 tester: auto test_tp002_common_cmds.py(53)
4	SRS-004 SRS-013 SRS-015	verify ping works	pong	pong	PASS	2024-10-22 14:43:53 tester: auto test_tp002_common_cmds.py(57)
5	N/A	set the callback function	None	None	PASS	2024-10-22 14:43:53 tester: auto None
6	SRS-007 SRS-008 SRS-013 SRS-015	verify user cmd with callback works	False	False	PASS	2024-10-22 14:43:53 tester: auto test_tp002_common_cmds.py(71)
7	SRS-007 SRS-008 SRS-013 SRS-015	verify invalid cmd with callback works	abcd	abcd	PASS	2024-10-22 14:43:53 tester: auto test_tp002_common_cmds.py(84)
8	SRS-005 SRS-006 SRS-012	client requests disconnect	True	True	PASS	2024-10-22 14:43:53 tester: auto test_tp002_common_cmds.py(91)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not
SRS-004	The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-005	The Server shall respond to a 'disconnect' command by disconnecting from the current Client
SRS-006	The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-007	The Server shall respond to invalid commands by setting is_invalid parameter to True to callback function
SRS-008	The Server shall respond to other commands by calling the given callback function
SRS-011	The Client shall connect to a given Server when requested
SRS-012	The Client shall disconnect from the Server when requested
SRS-013	The Client shall send a command to the Server when requested
SRS-015	The Client shall receive a response from the Server when requested

TP-003: disconnect then reconnect with a new client	Start date : 2024-10-22 14:43:54 MDT
At: test_tp003_new_client.py(39)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	start server	None	None	PASS	2024-10-22 14:43:54 tester: auto None
2	SRS-001	verify server is running	True	True	PASS	2024-10-22 14:43:54 tester: auto test_tp003_new_client.py(45)
3	SRS-011	start client	True	True	PASS	2024-10-22 14:43:54 tester: auto test_tp003_new_client.py(50)
4	SRS-004 SRS-013 SRS-015	verify ping works	pong	pong	PASS	2024-10-22 14:43:54 tester: auto test_tp003_new_client.py(54)
5	SRS-012	client requests disconnect	False	False	PASS	2024-10-22 14:43:54 tester: auto test_tp003_new_client.py(58)
6	SRS-011	start new client	True	True	PASS	2024-10-22 14:43:54 tester: auto test_tp003_new_client.py(63)
7	SRS-004 SRS-013 SRS-015	verify ping works	pong	pong	PASS	2024-10-22 14:43:54 tester: auto test_tp003_new_client.py(67)
8	SRS-006 SRS-012	client requests shutdown	False	False	PASS	2024-10-22 14:43:54 tester: auto test_tp003_new_client.py(75)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not
SRS-004	The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-006	The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011	The Client shall connect to a given Server when requested
SRS-012	The Client shall disconnect from the Server when requested
SRS-013	The Client shall send a command to the Server when requested
SRS-015	The Client shall receive a response from the Server when requested

TP-004: basic client tests	Start date : 2024-10-22 14:43:54 MDT
At: test_tp004_basic_client.py(37)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	start client	None	None	PASS	2024-10-22 14:43:54 tester: auto None
2	SRS-002	verify parameters are set correctly	True	True	PASS	2024-10-22 14:43:54 tester: auto test_tp004_basic_client.py(47)

Req.	Desc.
SRS-002	The Client shall check if the current parameters are set and indicate if they are set or not

TP-005: connect a client, attempt to connect with another client	Start date : 2024-10-22 14:43:54 MDT
At: test_tp005_two_clients.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	start server	None	None	PASS	2024-10-22 14:43:54 tester: auto None
2	SRS-001	verify server is running	True	True	PASS	2024-10-22 14:43:54 tester: auto test_tp005_two_clients.py(44)
3	SRS-011	start client1	True	True	PASS	2024-10-22 14:43:54 tester: auto test_tp005_two_clients.py(49)
4	SRS-004 SRS-006	verify ping works on client1	True	True	PASS	2024-10-22 14:43:54 tester: auto test_tp005_two_clients.py(56)
5	N/A	start new client2	None	None	PASS	2024-10-22 14:43:54 tester: auto None
6	SRS-003	verify client1 is still connected, and client2 is not	True	True	PASS	2024-10-22 14:43:57 tester: auto test_tp005_two_clients.py(65)
7	SRS-006	client1 requests shutdown	False	False	PASS	2024-10-22 14:43:57 tester: auto test_tp005_two_clients.py(72)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not
SRS-003	The Server shall allow only one Client to connect at a time
SRS-004	The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-006	The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011	The Client shall connect to a given Server when requested

TP-006: send 2 commands in one string	Start date : 2024-10-22 14:43:57 MDT
At: test_tp006_two_cmds.py(42)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-001	start server	True	True	PASS	2024-10-22 14:43:57 tester: auto test_tp006_two_cmds.py(46)
2	SRS-001	verify server is running	True	True	PASS	2024-10-22 14:43:57 tester: auto test_tp006_two_cmds.py(51)
3	N/A	start client	None	None	PASS	2024-10-22 14:43:57 tester: auto None
4	N/A	send two commands in one string	None	None	PASS	2024-10-22 14:43:57 tester: auto None
5	SRS-009 SRS-014	verify 1st response is for ping	pong	pong	PASS	2024-10-22 14:43:57 tester: auto test_tp006_two_cmds.py(62)
6	SRS-009 SRS-014	verify 1st response is for cmd01	ut_rsp	ut_rsp	PASS	2024-10-22 14:43:57 tester: auto test_tp006_two_cmds.py(66)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not
SRS-009	The Server shall define the end of a command to be the 0x0A byte
SRS-014	The Client shall send automatically append an 0x0A byte to a command sent to the Server

TP-007: check server and client arguments	Start date : 2024-10-22 14:43:58 MDT
At: test_tp007_check_args.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-001	initiate Server with all arguments to start()	True	True	PASS	2024-10-22 14:43:58 tester: auto test_tp007_check_args.py(53)
2	SRS-001	initiate Server missing ip_address	True	True	PASS	2024-10-22 14:43:59 tester: auto test_tp007_check_args.py(68)
3	SRS-001	initiate Server missing ip_port	True	True	PASS	2024-10-22 14:43:59 tester: auto test_tp007_check_args.py(83)
4	SRS-001	initiate Server missing callback	True	True	PASS	2024-10-22 14:43:59 tester: auto test_tp007_check_args.py(98)
5	SRS-001	initiate Server missing logger	True	True	PASS	2024-10-22 14:43:59 tester: auto test_tp007_check_args.py(113)
6	SRS-001	initiate Server missing verbose (default False)	False	False	PASS	2024-10-22 14:44:00 tester: auto test_tp007_check_args.py(127)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not

TP-008: check server and client arguments	Start date : 2024-10-22 14:44:01 MDT
At: test_tp008_client_sever_args.py(35)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-001	initiate Server with all arguments to init()	True	True	PASS	2024-10-22 14:44:01 tester: auto test_tp008_client_sever_args.py(48)
2	SRS-001	initiate Server missing ip_address	True	True	PASS	2024-10-22 14:44:01 tester: auto test_tp008_client_sever_args.py(61)
3	SRS-001	initiate Server missing ip_port	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp008_client_sever_args.py(74)
4	SRS-001	initiate Server missing logger	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp008_client_sever_args.py(87)
5	SRS-001	initiate Server missing verbose (default False)	False	False	PASS	2024-10-22 14:44:02 tester: auto test_tp008_client_sever_args.py(99)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not

TP-009: connect a client, attempt to reconnect with the same client	Start date : 2024-10-22 14:44:02 MDT
At: test_tp009_reconnect.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	start server	None	None	PASS	2024-10-22 14:44:02 tester: auto None
2	SRS-001	verify server is running	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(44)
3	SRS-011	start client	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(49)
4	SRS-004	verify ping works on client	pong	pong	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(53)
5	SRS-006	verify server is still running	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(56)
6	SRS-011	client attempt to reconnect	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(60)
7	SRS-004	verify ping still works on client	pong	pong	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(64)
8	SRS-006	verify server is still running	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(67)
9	SRS-006	client requests shutdown	False	False	PASS	2024-10-22 14:44:02 tester: auto test_tp009_reconnect.py(74)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not
SRS-004	The Server shall respond to a 'ping' command by sending a 'pong' response
SRS-006	The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process
SRS-011	The Client shall connect to a given Server when requested

TP-010: connect and then server exits	Start date : 2024-10-22 14:44:02 MDT
At: test_tp010_is_connected.py(44)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: N/A
Preconditions: N/A	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	check if client is connected before server is started	False	False	PASS	2024-10-22 14:44:02 tester: auto test_tp010_is_connected.py(49)
2	N/A	start server	False	False	PASS	2024-10-22 14:44:02 tester: auto test_tp010_is_connected.py(53)
3	SRS-001	verify server is running	False	False	PASS	2024-10-22 14:44:02 tester: auto test_tp010_is_connected.py(57)
4	SRS-011	start client	True	True	PASS	2024-10-22 14:44:02 tester: auto test_tp010_is_connected.py(62)
5	SRS-007 SRS-008 SRS-013 SRS-015	set the callback function	False	False	PASS	2024-10-22 14:44:02 tester: auto test_tp010_is_connected.py(96)

Req.	Desc.
SRS-001	The Server shall check if the current parameters are set and indicate if they are set or not
SRS-007	The Server shall respond to invalid commands by setting is_invalid parameter to True to callback function
SRS-008	The Server shall respond to other commands by calling the given callback function
SRS-011	The Client shall connect to a given Server when requested
SRS-013	The Client shall send a command to the Server when requested
SRS-015	The Client shall receive a response from the Server when requested

Trace Matrix

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-10-22 14:44:04 MDT
medver-pytest version: v1.0.3

Trace Matrix

Req. Id	Protocol
SRS-001 (auto)	Desc: The Server shall check if the current parameters are set and indicate if they are set or not TP-001 test_tp001_basic.py(46) TP-001 test_tp001_basic.py(47) TP-001 test_tp001_basic.py(48) TP-001 test_tp001_basic.py(49) TP-001 test_tp001_basic.py(50) TP-001 test_tp001_basic.py(51) TP-001 test_tp001_basic.py(55) TP-002 test_tp002_common_cmds.py(48) TP-003 test_tp003_new_client.py(45) TP-005 test_tp005_two_clients.py(44) TP-006 test_tp006_two_cmds.py(46) TP-006 test_tp006_two_cmds.py(51) TP-007 test_tp007_check_args.py(48) TP-007 test_tp007_check_args.py(49) TP-007 test_tp007_check_args.py(50) TP-007 test_tp007_check_args.py(51) TP-007 test_tp007_check_args.py(52) TP-007 test_tp007_check_args.py(53) TP-007 test_tp007_check_args.py(63) TP-007 test_tp007_check_args.py(64) TP-007 test_tp007_check_args.py(65) TP-007 test_tp007_check_args.py(66) TP-007 test_tp007_check_args.py(67) TP-007 test_tp007_check_args.py(68) TP-007 test_tp007_check_args.py(78) TP-007 test_tp007_check_args.py(79) TP-007 test_tp007_check_args.py(80) TP-007 test_tp007_check_args.py(81) TP-007 test_tp007_check_args.py(82) TP-007 test_tp007_check_args.py(83) TP-007 test_tp007_check_args.py(93) TP-007 test_tp007_check_args.py(94) TP-007 test_tp007_check_args.py(95) TP-007 test_tp007_check_args.py(96) TP-007 test_tp007_check_args.py(97) TP-007 test_tp007_check_args.py(98)
SRS-001 (auto) (cont'd)	Desc: The Server shall check if the current parameters are set and indicate if they are set or not TP-007 test_tp007_check_args.py(108) TP-007 test_tp007_check_args.py(109) TP-007 test_tp007_check_args.py(110) TP-007 test_tp007_check_args.py(111) TP-007 test_tp007_check_args.py(112) TP-007 test_tp007_check_args.py(113) TP-007 test_tp007_check_args.py(122) TP-007 test_tp007_check_args.py(123) TP-007 test_tp007_check_args.py(124) TP-007 test_tp007_check_args.py(125) TP-007 test_tp007_check_args.py(126) TP-007 test_tp007_check_args.py(127) TP-008 test_tp008_client_sever_args.py(44) TP-008 test_tp008_client_sever_args.py(45) TP-008 test_tp008_client_sever_args.py(46) TP-008 test_tp008_client_sever_args.py(47) TP-008 test_tp008_client_sever_args.py(48) TP-008 test_tp008_client_sever_args.py(57) TP-008 test_tp008_client_sever_args.py(58) TP-008 test_tp008_client_sever_args.py(59) TP-008 test_tp008_client_sever_args.py(60) TP-008 test_tp008_client_sever_args.py(61) TP-008 test_tp008_client_sever_args.py(70) TP-008 test_tp008_client_sever_args.py(71) TP-008 test_tp008_client_sever_args.py(72) TP-008 test_tp008_client_sever_args.py(73) TP-008 test_tp008_client_sever_args.py(74) TP-008 test_tp008_client_sever_args.py(83) TP-008 test_tp008_client_sever_args.py(84) TP-008 test_tp008_client_sever_args.py(85) TP-008 test_tp008_client_sever_args.py(86) TP-008 test_tp008_client_sever_args.py(87) TP-008 test_tp008_client_sever_args.py(95) TP-008 test_tp008_client_sever_args.py(96) TP-008 test_tp008_client_sever_args.py(97) TP-008 test_tp008_client_sever_args.py(98)
SRS-001 (auto) (cont'd)	Desc: The Server shall check if the current parameters are set and indicate if they are set or not TP-008 test_tp008_client_sever_args.py(99) TP-009 test_tp009_reconnect.py(44) TP-010 test_tp010_is_connected.py(56)
SRS-002 (auto)	Desc: The Client shall check if the current parameters are set and indicate if they are set or not TP-004 test_tp004_basic_client.py(44) TP-004 test_tp004_basic_client.py(45) TP-004 test_tp004_basic_client.py(46) TP-004 test_tp004_basic_client.py(47)
SRS-003 (auto)	Desc: The Server shall allow only one Client to connect at a time TP-005 test_tp005_two_clients.py(64) TP-005 test_tp005_two_clients.py(65)
SRS-004 (auto)	Desc: The Server shall respond to a 'ping' command by sending a 'pong' response TP-002 test_tp002_common_cmds.py(57) TP-003 test_tp003_new_client.py(54) TP-003 test_tp003_new_client.py(67) TP-005 test_tp005_two_clients.py(53) TP-009 test_tp009_reconnect.py(53) TP-009 test_tp009_reconnect.py(64)
SRS-005 (auto)	Desc: The Server shall respond to a 'disconnect' command by disconnecting from the current Client TP-002 test_tp002_common_cmds.py(91)
SRS-006 (auto)	Desc: The Server shall respond to a 'shutdown' command by disconnecting from the current Client if any and exiting the process TP-001 test_tp001_basic.py(68) TP-002 test_tp002_common_cmds.py(91) TP-003 test_tp003_new_client.py(75) TP-005 test_tp005_two_clients.py(56) TP-005 test_tp005_two_clients.py(72) TP-009 test_tp009_reconnect.py(56) TP-009 test_tp009_reconnect.py(67) TP-009 test_tp009_reconnect.py(74)
SRS-007 (auto)	Desc: The Server shall respond to invalid commands by setting is_invalid parameter to True to callback function TP-002 test_tp002_common_cmds.py(71) TP-002 test_tp002_common_cmds.py(79) TP-002 test_tp002_common_cmds.py(81) TP-002 test_tp002_common_cmds.py(84) TP-010 test_tp010_is_connected.py(72)
SRS-008 (auto)	Desc: The Server shall respond to other commands by calling the given callback function TP-002 test_tp002_common_cmds.py(68) TP-002 test_tp002_common_cmds.py(69) TP-002 test_tp002_common_cmds.py(70) TP-002 test_tp002_common_cmds.py(80) TP-010 test_tp010_is_connected.py(69) TP-010 test_tp010_is_connected.py(70) TP-010 test_tp010_is_connected.py(71)
SRS-009 (auto)	Desc: The Server shall define the end of a command to be the 0x0A byte TP-006 test_tp006_two_cmds.py(62) TP-006 test_tp006_two_cmds.py(66)
SRS-011 (auto)	Desc: The Client shall connect to a given Server when requested TP-001 test_tp001_basic.py(60) TP-002 test_tp002_common_cmds.py(53) TP-003 test_tp003_new_client.py(50) TP-003 test_tp003_new_client.py(63) TP-005 test_tp005_two_clients.py(49) TP-009 test_tp009_reconnect.py(49) TP-009 test_tp009_reconnect.py(60) TP-010 test_tp010_is_connected.py(61)
SRS-012 (auto)	Desc: The Client shall disconnect from the Server when requested TP-001 test_tp001_basic.py(65) TP-002 test_tp002_common_cmds.py(88) TP-003 test_tp003_new_client.py(58) TP-003 test_tp003_new_client.py(71)
SRS-013 (auto)	Desc: The Client shall send a command to the Server when requested TP-002 test_tp002_common_cmds.py(57) TP-002 test_tp002_common_cmds.py(69) TP-002 test_tp002_common_cmds.py(81) TP-003 test_tp003_new_client.py(54) TP-003 test_tp003_new_client.py(67) TP-010 test_tp010_is_connected.py(70)
SRS-014 (auto)	Desc: The Client shall send automatically append an 0x0A byte to a command sent to the Server TP-006 test_tp006_two_cmds.py(62) TP-006 test_tp006_two_cmds.py(66)
SRS-015 (auto)	Desc: The Client shall receive a response from the Server when requested TP-002 test_tp002_common_cmds.py(57) TP-002 test_tp002_common_cmds.py(68) TP-002 test_tp002_common_cmds.py(81) TP-003 test_tp003_new_client.py(54) TP-003 test_tp003_new_client.py(67) TP-010 test_tp010_is_connected.py(69)