diff --git a/doc/source/manual_tests/index.rst b/doc/source/manual_tests/index.rst index 62bde71..2ddd5d6 100644 --- a/doc/source/manual_tests/index.rst +++ b/doc/source/manual_tests/index.rst @@ -20,3 +20,4 @@ For more information about StarlingX, see https://docs.starlingx.io/. security/index maintenance/index backup_restore/index + installation_and_configuration/index diff --git a/doc/source/manual_tests/installation_and_configuration/index.rst b/doc/source/manual_tests/installation_and_configuration/index.rst new file mode 100644 index 0000000..d601068 --- /dev/null +++ b/doc/source/manual_tests/installation_and_configuration/index.rst @@ -0,0 +1,560 @@ +============================== +Installation and Configuration +============================== + +This test plan covers Installation and Configuration regression. It covers +basic functionality for the following features: + +- License +- Installation and commissioning +- Secure Boot +- tboot +- IPv4 and IPv6 installation + +-------------------- +Overall Requirements +-------------------- + +IP4 & IP6 system installed successful. + +---------- +Test Cases +---------- + +.. contents:: + :local: + :depth: 1 + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_INSTALL_01 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_INSTALL_01 +:Test Title: test_AIO-DX https ipv4 install +:Tags: P1, Installation and configuration, Regression, AUTOMATED + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure DX https ipv4 installation working well on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +Install IPv4 DX system. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Installation successfully. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_INSTALL_02 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_INSTALL_02 +:Test Title: test_AIO-DX https ipv4 low-latency pxeboot_setup install +:Tags: P1, Installation and configuration, Regression, AUTOMATED + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure DX https ipv4 low-latency installation working well on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +Install DX https ipv4 low-latency system. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Installation successfully. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_INSTALL_03 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_INSTALL_03 +:Test Title: test_Standard https ipv4 install +:Tags: P1, Installation and configuration, Regression, AUTOMATED + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure standard https ipv4 installation working well on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +Install IPv4 standard system. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Installation successfully. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_INSTALL_04 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_INSTALL_04 +:Test Title: test_Standard https ipv6 install +:Tags: P1, Installation and configuration, Regression, AUTOMATED + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure standard https ipv6 installation working well on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +Install IPv6 standard system. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Installation successfully. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_LICENSE_05 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_LICENSE_05 +:Test Title: test_Post install license-install with corrupted license file +:Tags: P3, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure Post install license-install with corrupted license file working +as expected on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +After config-controller, run "system license-install " with +corrupted license file + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Verification should fail and Error msg should be clearly addressed. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_LICENSE_06 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_LICENSE_06 +:Test Title: test Post install license-install with expired license file +:Tags: P2, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure Post install license-install with expired license file working as +expected on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +After config-controller, run "system license-install " with +expired license file. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Verification should fail and Error msg should be clearly addressed. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_LICENSE_07 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_LICENSE_07 +:Test Title: test_Run lab_setup with missing license file +:Tags: P2, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure running lab_setup with missing license file working as expected on +StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +1. run config_controller without license file + config complete + +2. run lab_setup.sh without license operation: + "proper warning popup like "license missing..." + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +As above. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_LICENSE_08 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_LICENSE_08 +:Test Title: test_Verify License configuration on configui tool +:Tags: P1, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To Verify License configuration on configui tool working as expected on +StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +Using config_gui to generate config file. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +There is no license related questions asked. + + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_LICENSE_09 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_LICENSE_09 +:Test Title: test_Verify post install license-install +:Tags: P1, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To test_Verify post install license file working as expected on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +1. Run "config-controller" without config.ini. Config process should run + through. +2. Run "system license-install ". License installed as expected. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +As above. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_INSTALLATION_10 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_INSTALLATION_10 +:Test Title: test Installation and Commissioning: Attempt to add hosts prior to controller-0 unlock (negative test) +:Tags: P4, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To test Attempting to add hosts prior to controller-0 unlock working +as expected on StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +1. Install controller-0. Controller-0 should show offline very briefly and then + show locked-online. + +2. While controller-0 is locked, attempt to add hosts via system + host-bulk-add(CLI). This should fail with "Bulk_add requires enabled + controller. Please unlock controller-0, wait for it to enable and then + retry. + +3. While controller-0 is locked, attempt to add hosts via horizon. This should + fail with Provisioning request for new host ' is not permitted + while there is no unlocked-enabled controller. Unlock controller-0, wait + for it to enable and then retry. + +4. While controller-0 is locked, attempt to add hosts via CLI via system + host-update. This should fail with: + + Provisioning request for new host is not permitted while + there is no unlocked-enabled controller. + +5. Unlock controller-0, wait for it to enable and then retry. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +As above. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_INSTALLATION_11 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_INSTALLATION_11 +:Test Title: test_Installation and Commissioning: Validate controller-0 state after unlock +:Tags: P4, Installation and configuration, Regression, AUTOMATED + +++++++++++++++ +Test Objective +++++++++++++++ + +To test Validating controller-0 state after unlock working as expected on +StarlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +1. Install controller-0 (on an AIO-SX or AIO-DX system). The controller should + be locked-online. + +2. Unlock controller-0. Validate the host status in horizon reports: + "Unlocking active controller" please stand-by while it reboots. + +3. Validate that the controller only reboots once after unlock + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +As above. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_TBOOT_12 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_TBOOT_12 +:Test Title: test_01: SB(Dis) ESP(En) Con0(UEFI,TXT on) Con1(UEFI TXT on) Com(UEFI TXT on) Stg(UEFI TXT on) +:Tags: P4, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure the tboot configuration as title shown working well on StartlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +01: SB(Dis) ESP(En) Con0(UEFI,TXT on) Con1(UEFI TXT on) Com(UEFI TXT on) +Stg(UEFI TXT on). +All nodes: TBoot functional + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +System boot successfully. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_SECURITYBOOT_13 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_SECURITYBOOT_13 +:Test Title: test_UEFI Secure Boot enabled TiS WRS Cert in firmware install compute successful +:Tags: P2, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure the security boot configuration as title shown working well on +StartlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +1. Enable UEFI secure boot on compute host. +2. Install TiS WRS cert from firmware of compute host. +3. Attempt to install compute host from controller-0 + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Compute host must install successfully from controller-0 when TiS WRS cert is +present in compute host's firmware. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_SECURITYBOOT_14 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_SECURITYBOOT_14 +:Test Title: test_UEFI Secure Boot enabled TiS WRS Cert in firmware install controller-1 successful +:Tags: P2, Installation and configuration, Regression + +++++++++++++++++++ +Testcase Objective +++++++++++++++++++ + +To ensure the security boot configuration as title shown working well on +StartlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +1. Enable UEFI secure boot on controller-1. +2. Install TiS WRS cert from firmware of controller-1. +3. Attempt to install controller-1 from controller-0. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Controller-1 must install successfully from controller-0 when TiS WRS cert is +present in controller-1 firmware. + +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ +INSTALLATION_AND_CONFIGURATION_SECURITYBOOT_15 +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:Test ID: INSTALLATION_AND_CONFIGURATION_SECURITYBOOT_15 +:Test Title: test_UEFI Secure Boot enabled TiS WRS Cert in firmware install low latency CPE controller-0 successful +:Tags: P2, Installation and configuration, Regression + +++++++++++++++ +Test Objective +++++++++++++++ + +To ensure the security boot configuration as title shown working well on +StartlingX. + ++++++++++++++++++++ +Test Pre-Conditions ++++++++++++++++++++ + +NA + +++++++++++ +Test Steps +++++++++++ + +1. Enable UEFI secure boot on CPE controller-0 host. +2. Install TiS WRS cert into firmware. +3. Attempt to install a low latency controller-0 CPE host. + +++++++++++++++++++ +Expected Behaviour +++++++++++++++++++ + +Low latency CPE controller-0 host must install successfully in UEFI secure +boot mode when TiS WRS cert is present in firmware.