Verification Test Results for pyalamake

Automated Test Summary

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-11-08 11:08:21 Pacific Standard Time
medver-pytest version: v1.0.3

Summary

Requirements Summary
	Count	Percentage
#Requirements	31	100.0%
Manual Requirements	0	0.0%
Manual & Auto Requirements	0	0.0%
Automated Requirements	31	100.0%
Invalid	0	0.0%
PASS	31	100.0%
FAIL	0	0.0%
Not tested	0	0.0%

Protocol Summary
	Count	Percentage
#Protocols	8	100.0%
PASS	7	87.5%
FAIL	1	12.5%

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-11-08 11:08:21 Pacific Standard Time
medver-pytest version: v1.0.3

Test Protocols with results

TP-001: gen for cpp targets	Start date : 2024-11-08 11:08:20 Pacific Standard Time
At: test_tp001_cpp_target.py(36)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of a C++ target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-004	check current version	0.0.15	0.0.15	PASS	2024-11-08 11:08:20 tester: auto test_tp001_cpp_target.py(41)
2	SRS-001 SRS-002 SRS-003 SRS-005 SRS-006 SRS-050	create cpp target	{'cpp_name-dir/.o': 1, 'cpp_name-dir/.d': 1, 'cpp_name': 1}	{'cpp_name-dir/.o': 1, 'cpp_name-dir/.d': 1, 'cpp_name': 1}	PASS	2024-11-08 11:08:20 tester: auto test_tp001_cpp_target.py(85)
3	N/A	check make help output	10	12	FAIL	2024-11-08 11:08:20 tester: auto test_tp001_cpp_target.py(97)

Req.	Desc.
SRS-001	The module shall default to the debug build
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-004	The module shall provide a method to get the pyalamake version
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-050	The module shall provide a cpp target

TP-002: common behavior in target base	Start date : 2024-11-08 11:08:20 Pacific Standard Time
At: test_tp002_target_base.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check TargetBase functions for setting common args
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-002 SRS-003 SRS-005 SRS-006 SRS-100 SRS-101 SRS-102 SRS-103 SRS-104 SRS-105 SRS-106 SRS-107	create target that uses TargetBase	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-11-08 11:08:20 tester: auto test_tp002_target_base.py(141)

Req.	Desc.
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-100	The initial values in common settings is empty
SRS-101	The module shall generate dependency rules as needed
SRS-102	The module shall generate rules to clean generated files as needed
SRS-103	The module shall check a single or an array of sources given and abort otherwise
SRS-104	The module shall check a single or an array of include directories given and abort otherwise
SRS-105	The module shall check for duplicate target names and abort
SRS-106	The module shall check a single or an array of link libraries given and abort otherwise
SRS-107	The module shall check a single or an array of link files given and abort otherwise

TP-003: logger behavior	Start date : 2024-11-08 11:08:21 Pacific Standard Time
At: test_tp003_logger.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check Logger functions as expected
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-120	check() behaviors	ERR check false	ERR check false	PASS	2024-11-08 11:08:21 tester: auto test_tp003_logger.py(55)
2	SRS-120	check_all() behaviors	ERR - false2	ERR - false2	PASS	2024-11-08 11:08:21 tester: auto test_tp003_logger.py(68)
3	SRS-120	check output() behaviors	-- 4] out4	-- 4] out4	PASS	2024-11-08 11:08:21 tester: auto test_tp003_logger.py(81)
4	SRS-120	simple logging behaviors	raw	raw	PASS	2024-11-08 11:08:21 tester: auto test_tp003_logger.py(104)
5	SRS-121	simple logging behaviors	BUG bug	BUG bug	PASS	2024-11-08 11:08:21 tester: auto test_tp003_logger.py(129)

Req.	Desc.
SRS-120	The module shall provide a mechanism to log information to stdout
SRS-121	The module shall provide a mechanism to turn of log information except for errors and bug lines

TP-004: gen for gtest targets	Start date : 2024-11-08 11:08:21 Pacific Standard Time
At: test_tp004_gtest_target.py(38)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of a C++ gtest target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-002 SRS-003 SRS-005 SRS-006 SRS-130 SRS-131	create gtest target	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-11-08 11:08:21 tester: auto test_tp004_gtest_target.py(116)

Req.	Desc.
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-130	The module shall provide a gtest target
SRS-131	The gtest target shall check a single or an array of include directories given and abort otherwise

TP-005: gen for arduino shared components	Start date : 2024-11-08 11:08:21 Pacific Standard Time
At: test_tp005_arduino_shared.py(39)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of an Arduino Shared component
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-150 SRS-151 SRS-152	create arduino shared component, check initial values	/usr/share/arduino/hardware/arduino/avr/variants/standard	/usr/share/arduino/hardware/arduino/avr/variants/standard	PASS	2024-11-08 11:08:21 tester: auto test_tp005_arduino_shared.py(156)
2	SRS-153	set boardid, check changes	/dev/ttyUT	/dev/ttyUT	PASS	2024-11-08 11:08:21 tester: auto test_tp005_arduino_shared.py(55)
3	SRS-154	create core	0	0	PASS	2024-11-08 11:08:21 tester: auto test_tp005_arduino_shared.py(67)
4	N/A	print board list	None	None	PASS	2024-11-08 11:08:21 tester: auto None
5	N/A	ensure check() fails when missing core	ERR arduino: corelib_name is not set	ERR arduino: corelib_name is not set	PASS	2024-11-08 11:08:21 tester: auto test_tp005_arduino_shared.py(95)
6	SRS-155	ensure invalid boardid() fails	0	0	PASS	2024-11-08 11:08:21 tester: auto test_tp005_arduino_shared.py(104)

Req.	Desc.
SRS-150	The module shall provide an arduino_shared component
SRS-151	The initial values of arduino_shared component shall be None for all board, core and derived values
SRS-152	The initial values of arduino_shared component shall be set for platform specific directories
SRS-153	Setting the boardid() shall set all board related values and derived values
SRS-154	Creating an Arduino Core shall set all cored related values
SRS-155	Specifying an invalid boardid shall abort

TP-006: gen for arduino core targets	Start date : 2024-11-08 11:08:21 Pacific Standard Time
At: test_tp006_arduino_core_target.py(35)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of an Arduino Core target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	create arduino_shared component	None	None	PASS	2024-11-08 11:08:21 tester: auto None
2	SRS-160 SRS-161	create core	{'core.a': 1, 'core-dir/.o': 1, 'core-dir/.d': 1}	{'core.a': 1, 'core-dir/.o': 1, 'core-dir/.d': 1}	PASS	2024-11-08 11:08:21 tester: auto test_tp006_arduino_core_target.py(65)

Req.	Desc.
SRS-160	The module shall provide an Arduino core target
SRS-161	The arduino_shared component with a boardid and port value shall not abort when core is created and check() is called

TP-007: gen for arduino targets	Start date : 2024-11-08 11:08:21 Pacific Standard Time
At: test_tp007_arduino_target.py(36)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the generation of an Arduino target
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	N/A	create arduino_shared component	None	None	PASS	2024-11-08 11:08:21 tester: auto None
2	SRS-002 SRS-003 SRS-005 SRS-006 SRS-170	create arduino target	{'ino1-dir/.o': 1, 'ino1-dir/.d': 1, 'ino1.eep': 1, 'ino1.elf': 1, 'ino1.hex': 1}	{'ino1.elf': 1, 'ino1.eep': 1, 'ino1.hex': 1, 'ino1-dir/.o': 1, 'ino1-dir/.d': 1}	PASS	2024-11-08 11:08:21 tester: auto test_tp007_arduino_target.py(86)
3	SRS-171	create arduino target without a shared component	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-11-08 11:08:21 tester: auto test_tp007_arduino_target.py(97)

Req.	Desc.
SRS-002	The module shall provide an add_sources() to add one or more source files
SRS-003	The module shall provide an add_include_directories() to add one or more include directories
SRS-005	The module shall provide an add_link_libraries() to add one or more link libraries
SRS-006	The module shall provide an add_link_files() to add one or more link paths to a library
SRS-170	The module shall provide an Arduino target
SRS-171	The module shall abort without an Arduino shared component

TP-008: remaining pyalamake functions	Start date : 2024-11-08 11:08:21 Pacific Standard Time
At: test_tp008_pyalamake.py(36)	Requirements : see below
Software Version: N/A	Serial number: N/A
Objectives: check the remaining functions in pyalamake main
Preconditions: do_install has been run	Deviations: N/A

Step	Req.	Execution Instructions	Expected	Actual	Pass / Fail	Date
1	SRS-180	check gbl()	release	release	PASS	2024-11-08 11:08:21 tester: auto test_tp008_pyalamake.py(47)
2	SRS-181	check invalid target type	<class 'SystemExit'>	<class 'SystemExit'>	PASS	2024-11-08 11:08:21 tester: auto test_tp008_pyalamake.py(52)

Req.	Desc.
SRS-180	The module shall provide a method to name the build directory
SRS-181	If given an invalid target type, the module shall abort

Trace Matrix

Test Run Details

Test Run Type: dev
Test Run ID: dev-001
Document Generated: 2024-11-08 11:08:21 Pacific Standard Time
medver-pytest version: v1.0.3

Trace Matrix

Req. Id	Protocol
SRS-001 (auto)	Desc: The module shall default to the debug build TP-001 test_tp001_cpp_target.py(56)
SRS-002 (auto)	Desc: The module shall provide an add_sources() to add one or more source files TP-001 test_tp001_cpp_target.py(60) TP-001 test_tp001_cpp_target.py(62) TP-002 test_tp002_target_base.py(74) TP-002 test_tp002_target_base.py(76) TP-004 test_tp004_gtest_target.py(55) TP-004 test_tp004_gtest_target.py(57) TP-007 test_tp007_arduino_target.py(61) TP-007 test_tp007_arduino_target.py(63)
SRS-003 (auto)	Desc: The module shall provide an add_include_directories() to add one or more include directories TP-001 test_tp001_cpp_target.py(67) TP-001 test_tp001_cpp_target.py(69) TP-002 test_tp002_target_base.py(90) TP-002 test_tp002_target_base.py(92) TP-002 test_tp002_target_base.py(94) TP-004 test_tp004_gtest_target.py(62) TP-004 test_tp004_gtest_target.py(64) TP-007 test_tp007_arduino_target.py(68) TP-007 test_tp007_arduino_target.py(70)
SRS-004 (auto)	Desc: The module shall provide a method to get the pyalamake version TP-001 test_tp001_cpp_target.py(41)
SRS-005 (auto)	Desc: The module shall provide an add_link_libraries() to add one or more link libraries TP-001 test_tp001_cpp_target.py(74) TP-001 test_tp001_cpp_target.py(76) TP-002 test_tp002_target_base.py(108) TP-002 test_tp002_target_base.py(110) TP-002 test_tp002_target_base.py(111) TP-002 test_tp002_target_base.py(130) TP-002 test_tp002_target_base.py(132) TP-004 test_tp004_gtest_target.py(74) TP-004 test_tp004_gtest_target.py(82) TP-007 test_tp007_arduino_target.py(75) TP-007 test_tp007_arduino_target.py(77)
SRS-006 (auto)	Desc: The module shall provide an add_link_files() to add one or more link paths to a library TP-001 test_tp001_cpp_target.py(78) TP-002 test_tp002_target_base.py(123) TP-002 test_tp002_target_base.py(125) TP-002 test_tp002_target_base.py(126) TP-002 test_tp002_target_base.py(131) TP-002 test_tp002_target_base.py(132) TP-004 test_tp004_gtest_target.py(85) TP-007 test_tp007_arduino_target.py(79)
SRS-050 (auto)	Desc: The module shall provide a cpp target TP-001 test_tp001_cpp_target.py(50)
SRS-100 (auto)	Desc: The initial values in common settings is empty TP-002 test_tp002_target_base.py(50) TP-002 test_tp002_target_base.py(51) TP-002 test_tp002_target_base.py(54) TP-002 test_tp002_target_base.py(59)
SRS-101 (auto)	Desc: The module shall generate dependency rules as needed TP-002 test_tp002_target_base.py(56)
SRS-102 (auto)	Desc: The module shall generate rules to clean generated files as needed TP-002 test_tp002_target_base.py(69)
SRS-103 (auto)	Desc: The module shall check a single or an array of sources given and abort otherwise TP-002 test_tp002_target_base.py(79)
SRS-104 (auto)	Desc: The module shall check a single or an array of include directories given and abort otherwise TP-002 test_tp002_target_base.py(98) TP-002 test_tp002_target_base.py(102)
SRS-105 (auto)	Desc: The module shall check for duplicate target names and abort TP-002 test_tp002_target_base.py(85)
SRS-106 (auto)	Desc: The module shall check a single or an array of link libraries given and abort otherwise TP-002 test_tp002_target_base.py(114) TP-002 test_tp002_target_base.py(118)
SRS-107 (auto)	Desc: The module shall check a single or an array of link files given and abort otherwise TP-002 test_tp002_target_base.py(137) TP-002 test_tp002_target_base.py(141)
SRS-120 (auto)	Desc: The module shall provide a mechanism to log information to stdout TP-003 test_tp003_logger.py(53) TP-003 test_tp003_logger.py(62) TP-003 test_tp003_logger.py(77) TP-003 test_tp003_logger.py(95)
SRS-121 (auto)	Desc: The module shall provide a mechanism to turn of log information except for errors and bug lines TP-003 test_tp003_logger.py(123)
SRS-130 (auto)	Desc: The module shall provide a gtest target TP-004 test_tp004_gtest_target.py(49)
SRS-131 (auto)	Desc: The gtest target shall check a single or an array of include directories given and abort otherwise TP-004 test_tp004_gtest_target.py(91) TP-004 test_tp004_gtest_target.py(111) TP-004 test_tp004_gtest_target.py(116)
SRS-150 (auto)	Desc: The module shall provide an arduino_shared component TP-005 test_tp005_arduino_shared.py(108)
SRS-151 (auto)	Desc: The initial values of arduino_shared component shall be None for all board, core and derived values TP-005 test_tp005_arduino_shared.py(108)
SRS-152 (auto)	Desc: The initial values of arduino_shared component shall be set for platform specific directories TP-005 test_tp005_arduino_shared.py(132) TP-005 test_tp005_arduino_shared.py(151)
SRS-153 (auto)	Desc: Setting the boardid() shall set all board related values and derived values TP-005 test_tp005_arduino_shared.py(161) TP-005 test_tp005_arduino_shared.py(163)
SRS-154 (auto)	Desc: Creating an Arduino Core shall set all cored related values TP-005 test_tp005_arduino_shared.py(66)
SRS-155 (auto)	Desc: Specifying an invalid boardid shall abort TP-005 test_tp005_arduino_shared.py(103)
SRS-160 (auto)	Desc: The module shall provide an Arduino core target TP-006 test_tp006_arduino_core_target.py(51)
SRS-161 (auto)	Desc: The arduino_shared component with a boardid and port value shall not abort when core is created and check() is called TP-006 test_tp006_arduino_core_target.py(58)
SRS-170 (auto)	Desc: The module shall provide an Arduino target TP-007 test_tp007_arduino_target.py(55)
SRS-171 (auto)	Desc: The module shall abort without an Arduino shared component TP-007 test_tp007_arduino_target.py(97)
SRS-180 (auto)	Desc: The module shall provide a method to name the build directory TP-008 test_tp008_pyalamake.py(47)
SRS-181 (auto)	Desc: If given an invalid target type, the module shall abort TP-008 test_tp008_pyalamake.py(52)