Verification Test Results for pyalamake

Automated Test Summary

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-12-11 13:44:52 MST
medver-pytest version: v1.1.0

Summary

Requirements Summary
	Count	Percentage
#Requirements	31	100.0%
Manual Requirements	0	0.0%
Manual & Auto Requirements	0	0.0%
Automated Requirements	31	100.0%
Invalid	0	0.0%
PASS	30	96.8%
FAIL	0	0.0%
Not tested	1	3.2%

Protocol Summary
	Count	Percentage
#Protocols	10	100.0%
PASS	10	100.0%
FAIL	0	0.0%

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-12-11 13:44:52 MST
medver-pytest version: v1.1.0

Test Protocols with results

TP-001: gen for cpp targets	Start date : 2024-12-11 13:44:51 MST
At: test_tp001_cpp_target.py(36)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of a C++ target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-001 SRS-002 SRS-003 SRS-005 SRS-006 SRS-050	create cpp target	{'cpp_name-dir/.o': 1, 'cpp_name-dir/.d': 1, 'cpp_name': 1}	{'cpp_name-dir/.o': 1, 'cpp_name-dir/.d': 1, 'cpp_name': 1}	PASS	2024-12-11 13:44:51 tester: auto test_tp001_cpp_target.py(85)
2	N/A	check make help output	[32;01mhelp [0m this help info	[32;01mhelp [0m this help info	PASS	2024-12-11 13:44:51 tester: auto test_tp001_cpp_target.py(115)

Req.	Desc.
SRS-001	The module shall default to the debug build
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-050	The module shall provide a cpp target

TP-002: common behavior in target base	Start date : 2024-12-11 13:44:51 MST
At: test_tp002_target_base.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check TargetBase functions for setting common args
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-002 SRS-003 SRS-005 SRS-006 SRS-100 SRS-101 SRS-102 SRS-103 SRS-104 SRS-105 SRS-106 SRS-107	create target that uses TargetBase	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-12-11 13:44:51 tester: auto test_tp002_target_base.py(139)

Req.	Desc.
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-100	The initial values in common settings is empty
SRS-101	The module shall generate dependency rules as needed
SRS-102	The module shall generate rules to clean generated files as needed
SRS-103	The module shall check a single or an array of sources given and abort otherwise
SRS-104	The module shall check a single or an array of include directories given and abort otherwise
SRS-105	The module shall check for duplicate target names and abort
SRS-106	The module shall check a single or an array of link libraries given and abort otherwise
SRS-107	The module shall check a single or an array of link files given and abort otherwise

TP-003: logger behavior	Start date : 2024-12-11 13:44:52 MST
At: test_tp003_logger.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check Logger functions as expected
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-120	check() behaviors	ERR check false	ERR check false	PASS	2024-12-11 13:44:52 tester: auto test_tp003_logger.py(55)
2	SRS-120	check_all() behaviors	ERR - false2	ERR - false2	PASS	2024-12-11 13:44:52 tester: auto test_tp003_logger.py(68)
3	SRS-120	check output() behaviors	-- 4] out4	-- 4] out4	PASS	2024-12-11 13:44:52 tester: auto test_tp003_logger.py(81)
4	SRS-120	simple logging behaviors	raw	raw	PASS	2024-12-11 13:44:52 tester: auto test_tp003_logger.py(104)
5	SRS-121	simple logging behaviors	BUG bug	BUG bug	PASS	2024-12-11 13:44:52 tester: auto test_tp003_logger.py(129)

Req.	Desc.
SRS-120	The module shall provide a mechanism to log information to stdout
SRS-121	The module shall provide a mechanism to turn of log information except for errors and bug lines

TP-004: gen for gtest targets	Start date : 2024-12-11 13:44:52 MST
At: test_tp004_gtest_target.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of a C++ gtest target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-002 SRS-003 SRS-005 SRS-006 SRS-130 SRS-131	create gtest target	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-12-11 13:44:52 tester: auto test_tp004_gtest_target.py(126)

Req.	Desc.
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-130	The module shall provide a gtest target
SRS-131	The gtest target shall check a single or an array of include directories given and abort otherwise

TP-005: gen for arduino shared components	Start date : 2024-12-11 13:44:52 MST
At: test_tp005_arduino_shared.py(39)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of an Arduino Shared component
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-150 SRS-151 SRS-152	create arduino shared component, check initial values	/usr/share/arduino/hardware/arduino/avr/variants/standard	/usr/share/arduino/hardware/arduino/avr/variants/standard	PASS	2024-12-11 13:44:52 tester: auto test_tp005_arduino_shared.py(165)
2	SRS-153	set boardid, check changes	/dev/ttyUT	/dev/ttyUT	PASS	2024-12-11 13:44:52 tester: auto test_tp005_arduino_shared.py(55)
3	SRS-154	create core	0	0	PASS	2024-12-11 13:44:52 tester: auto test_tp005_arduino_shared.py(67)
4	N/A	print board list	None	None	PASS	2024-12-11 13:44:52 tester: auto None
5	N/A	ensure check() fails when missing core	ERR arduino: corelib_name is not set	ERR arduino: corelib_name is not set	PASS	2024-12-11 13:44:52 tester: auto test_tp005_arduino_shared.py(95)
6	SRS-155	ensure invalid boardid() fails	0	0	PASS	2024-12-11 13:44:52 tester: auto test_tp005_arduino_shared.py(104)

Req.	Desc.
SRS-150	The module shall provide an arduino_shared component
SRS-151	The initial values of arduino_shared component shall be None for all board, core and derived values
SRS-152	The initial values of arduino_shared component shall be set for platform specific directories
SRS-153	Setting the boardid() shall set all board related values and derived values
SRS-154	Creating an Arduino Core shall set all cored related values
SRS-155	Specifying an invalid boardid shall abort

TP-006: gen for arduino core targets	Start date : 2024-12-11 13:44:52 MST
At: test_tp006_arduino_core_target.py(35)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of an Arduino Core target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	create arduino_shared component	None	None	PASS	2024-12-11 13:44:52 tester: auto None
2	SRS-160 SRS-161	create core	{'core.a': 1, 'core-dir/.o': 1, 'core-dir/.d': 1}	{'core.a': 1, 'core-dir/.o': 1, 'core-dir/.d': 1}	PASS	2024-12-11 13:44:52 tester: auto test_tp006_arduino_core_target.py(65)

Req.	Desc.
SRS-160	The module shall provide an Arduino core target
SRS-161	The arduino_shared component with a boardid and port value shall not abort when core is created and check() is called

TP-007: gen for arduino targets	Start date : 2024-12-11 13:44:52 MST
At: test_tp007_arduino_target.py(36)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of an Arduino target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	create arduino_shared component	None	None	PASS	2024-12-11 13:44:52 tester: auto None
2	SRS-002 SRS-003 SRS-005 SRS-006 SRS-170	create arduino target	{'ino1-dir/.o': 1, 'ino1-dir/.d': 1, 'ino1.eep': 1, 'ino1.elf': 1, 'ino1.hex': 1}	{'ino1.elf': 1, 'ino1.eep': 1, 'ino1.hex': 1, 'ino1-dir/.o': 1, 'ino1-dir/.d': 1}	PASS	2024-12-11 13:44:52 tester: auto test_tp007_arduino_target.py(88)
3	SRS-171	create arduino target without a shared component	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-12-11 13:44:52 tester: auto test_tp007_arduino_target.py(99)

Req.	Desc.
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-170	The module shall provide an Arduino target
SRS-171	The module shall abort without an Arduino shared component

TP-008: remaining pyalamake functions	Start date : 2024-12-11 13:44:52 MST
At: test_tp008_pyalamake.py(36)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the remaining functions in pyalamake main
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-180	check gbl()	release	release	PASS	2024-12-11 13:44:52 tester: auto test_tp008_pyalamake.py(47)
2	SRS-181	check invalid target type	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-12-11 13:44:52 tester: auto test_tp008_pyalamake.py(52)

Req.	Desc.
SRS-180	The module shall provide a method to name the build directory
SRS-181	If given an invalid target type, the module shall abort

TP-009: check osal conversions	Start date : 2024-12-11 13:44:52 MST
At: test_tp009_osal.py(35)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the OSAL functions for cross-platform behavior
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	check OSAL fix_path() for ubuntu	/usr/bin/file2	/usr/bin/file2	PASS	2024-12-11 13:44:52 tester: auto test_tp009_osal.py(46)
2	N/A	check OSAL fix_path() for macos	/usr/bin/file2	/usr/bin/file2	PASS	2024-12-11 13:44:52 tester: auto test_tp009_osal.py(51)
3	N/A	check OSAL fix_path() for win	pre/fix/c/User/bob/file4	pre/fix/c/User/bob/file4	PASS	2024-12-11 13:44:52 tester: auto test_tp009_osal.py(64)

Req.	Desc.
N/A	No requirements found

TP-090: check list_param	Start date : 2024-12-11 13:44:52 MST
At: test_tp090_list_param.py(41)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the handling of parameters for compile/link
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	check parm_type=path no filter, no accum	['src1', 'src2']	['src1', 'src2']	PASS	2024-12-11 13:44:52 tester: auto test_tp090_list_param.py(79)
2	N/A	check parm_type=path with filter, no accum	['src1.h']	['src1.h']	PASS	2024-12-11 13:44:52 tester: auto test_tp090_list_param.py(96)
3	N/A	check parm_type=string no filter, with accum	--opt1 --opt2	--opt1 --opt2	PASS	2024-12-11 13:44:52 tester: auto test_tp090_list_param.py(119)
4	N/A	check remove()	['opt1']	['opt1']	PASS	2024-12-11 13:44:52 tester: auto test_tp090_list_param.py(160)
5	N/A	check bad value type passed	ABRT stuff: accepts only str or list of str, 32 is <class 'int'>	ABRT stuff: accepts only str or list of str, 32 is <class 'int'>	PASS	2024-12-11 13:44:52 tester: auto test_tp090_list_param.py(197)
6	N/A	check bad value type passed	ABRT ListParm stuff: unknown type "junk"	ABRT ListParm stuff: unknown type "junk"	PASS	2024-12-11 13:44:52 tester: auto test_tp090_list_param.py(214)

Req.	Desc.
N/A	No requirements found

Trace Matrix

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-12-11 13:44:52 MST
medver-pytest version: v1.1.0

Trace Matrix

Req. Id	Protocol
SRS-001 (auto)	Desc: The module shall default to the debug build TP-001 test_tp001_cpp_target.py(56)
SRS-002 (auto)	Desc: The module shall provide an add_sources() to add one or more source files TP-001 test_tp001_cpp_target.py(60) TP-001 test_tp001_cpp_target.py(62) TP-002 test_tp002_target_base.py(74) TP-002 test_tp002_target_base.py(76) TP-004 test_tp004_gtest_target.py(59) TP-004 test_tp004_gtest_target.py(61) TP-007 test_tp007_arduino_target.py(61) TP-007 test_tp007_arduino_target.py(63)
SRS-003 (auto)	Desc: The module shall provide an add_include_directories() to add one or more include directories TP-001 test_tp001_cpp_target.py(66) TP-001 test_tp001_cpp_target.py(68) TP-002 test_tp002_target_base.py(89) TP-002 test_tp002_target_base.py(91) TP-002 test_tp002_target_base.py(93) TP-004 test_tp004_gtest_target.py(69) TP-004 test_tp004_gtest_target.py(76) TP-007 test_tp007_arduino_target.py(68) TP-007 test_tp007_arduino_target.py(70)
SRS-004 (auto)	Desc: The module shall provide a method to get the pyalamake version ERR missing test case for this requirement
SRS-005 (auto)	Desc: The module shall provide an add_link_libraries() to add one or more link libraries TP-001 test_tp001_cpp_target.py(73) TP-001 test_tp001_cpp_target.py(75) TP-002 test_tp002_target_base.py(106) TP-002 test_tp002_target_base.py(108) TP-002 test_tp002_target_base.py(109) TP-002 test_tp002_target_base.py(128) TP-002 test_tp002_target_base.py(130) TP-004 test_tp004_gtest_target.py(84) TP-004 test_tp004_gtest_target.py(92) TP-007 test_tp007_arduino_target.py(76) TP-007 test_tp007_arduino_target.py(78)
SRS-006 (auto)	Desc: The module shall provide an add_link_files() to add one or more link paths to a library TP-001 test_tp001_cpp_target.py(78) TP-002 test_tp002_target_base.py(121) TP-002 test_tp002_target_base.py(123) TP-002 test_tp002_target_base.py(124) TP-002 test_tp002_target_base.py(129) TP-002 test_tp002_target_base.py(130) TP-004 test_tp004_gtest_target.py(95) TP-007 test_tp007_arduino_target.py(81)
SRS-050 (auto)	Desc: The module shall provide a cpp target TP-001 test_tp001_cpp_target.py(50)
SRS-100 (auto)	Desc: The initial values in common settings is empty TP-002 test_tp002_target_base.py(50) TP-002 test_tp002_target_base.py(51) TP-002 test_tp002_target_base.py(54) TP-002 test_tp002_target_base.py(59)
SRS-101 (auto)	Desc: The module shall generate dependency rules as needed TP-002 test_tp002_target_base.py(56)
SRS-102 (auto)	Desc: The module shall generate rules to clean generated files as needed TP-002 test_tp002_target_base.py(69)
SRS-103 (auto)	Desc: The module shall check a single or an array of sources given and abort otherwise TP-002 test_tp002_target_base.py(79)
SRS-104 (auto)	Desc: The module shall check a single or an array of include directories given and abort otherwise TP-002 test_tp002_target_base.py(97) TP-002 test_tp002_target_base.py(101)
SRS-105 (auto)	Desc: The module shall check for duplicate target names and abort TP-002 test_tp002_target_base.py(84)
SRS-106 (auto)	Desc: The module shall check a single or an array of link libraries given and abort otherwise TP-002 test_tp002_target_base.py(112) TP-002 test_tp002_target_base.py(116)
SRS-107 (auto)	Desc: The module shall check a single or an array of link files given and abort otherwise TP-002 test_tp002_target_base.py(135) TP-002 test_tp002_target_base.py(139)
SRS-120 (auto)	Desc: The module shall provide a mechanism to log information to stdout TP-003 test_tp003_logger.py(53) TP-003 test_tp003_logger.py(62) TP-003 test_tp003_logger.py(77) TP-003 test_tp003_logger.py(95)
SRS-121 (auto)	Desc: The module shall provide a mechanism to turn of log information except for errors and bug lines TP-003 test_tp003_logger.py(123)
SRS-130 (auto)	Desc: The module shall provide a gtest target TP-004 test_tp004_gtest_target.py(49)
SRS-131 (auto)	Desc: The gtest target shall check a single or an array of include directories given and abort otherwise TP-004 test_tp004_gtest_target.py(101) TP-004 test_tp004_gtest_target.py(121) TP-004 test_tp004_gtest_target.py(126)
SRS-150 (auto)	Desc: The module shall provide an arduino_shared component TP-005 test_tp005_arduino_shared.py(108)
SRS-151 (auto)	Desc: The initial values of arduino_shared component shall be None for all board, core and derived values TP-005 test_tp005_arduino_shared.py(108)
SRS-152 (auto)	Desc: The initial values of arduino_shared component shall be set for platform specific directories TP-005 test_tp005_arduino_shared.py(137) TP-005 test_tp005_arduino_shared.py(158)
SRS-153 (auto)	Desc: Setting the boardid() shall set all board related values and derived values TP-005 test_tp005_arduino_shared.py(170) TP-005 test_tp005_arduino_shared.py(172)
SRS-154 (auto)	Desc: Creating an Arduino Core shall set all cored related values TP-005 test_tp005_arduino_shared.py(66)
SRS-155 (auto)	Desc: Specifying an invalid boardid shall abort TP-005 test_tp005_arduino_shared.py(103)
SRS-160 (auto)	Desc: The module shall provide an Arduino core target TP-006 test_tp006_arduino_core_target.py(51)
SRS-161 (auto)	Desc: The arduino_shared component with a boardid and port value shall not abort when core is created and check() is called TP-006 test_tp006_arduino_core_target.py(58)
SRS-170 (auto)	Desc: The module shall provide an Arduino target TP-007 test_tp007_arduino_target.py(55)
SRS-171 (auto)	Desc: The module shall abort without an Arduino shared component TP-007 test_tp007_arduino_target.py(99)
SRS-180 (auto)	Desc: The module shall provide a method to name the build directory TP-008 test_tp008_pyalamake.py(47)
SRS-181 (auto)	Desc: If given an invalid target type, the module shall abort TP-008 test_tp008_pyalamake.py(52)