Release Test Plan 1.5.3

Issues targeted for this release - List of Github issues

Contributor is testing: Chris, Yang, Roger, Nitendra, Khushboo

Testing Version: v1.5.3-rc1

e2e Pipelines

✅ - Analyze test result of SLES on 1.5.x (AMD) - Roger

v1.5.3-rc1: 1 failure.

Failed test case passed after rerun

✅ - Analyze test result of SLES on 1.5.x (ARM) - Roger

v1.5.3-rc1: 2 failures.

Failed test case passed after rerun

✅ - Analyze upgrade test result of SLES on 1.5.x (AMD) - Chris

v1.5.3-rc1: 1 failure

Failed test case passed after rerun

✅ - Analyze upgrade test result of SLES on 1.5.x (ARM) - Chris

v1.5.3-rc1: 3 failures

All failed test case passed after rerun

Non-e2e Pipelines

✅❌ - Benchmark (compare with 1.4.4) - Chris

✅❌ - Air-Gap (manifest, helm chart) - Chris

✅ - Vulnerability scanning - Yang

v1.5.3-rc1: 72 HIGH, 0 CRITICAL

✅❌ - Negative Testing - Yang

v1.5.3-rc1 ❌ https://github.com/longhorn/longhorn/issues/7106

v1.5.x-head ✅

Manual Tests

✅- Failing to mount encrypted volumes v1.5.2

• Expansion of encrypted volume.
• Attaching/detaching of encrypted volume. e.g. - Killing IM pod, rebooting attached node.
• Restoring of encrypted volumes and crashing the IM pod when the restore is in progress.
• v1.5.3-rc1

Chart Testing

✅ - v2.7.x Rancher - Khushboo, Roger

   Prereq: Set Concurrent Automatic Engine Upgrade Per Node Limit to 0
   Test steps:
   1. Fresh installation
   2. Uninstallation
   3. Upgrade from v1.4.4
   4. Upgrade from v1.5.1

✅ - v2.8.x Rancher - Khushboo, Roger

   Prereq: Set Concurrent Automatic Engine Upgrade Per Node Limit to greater than 0
   Test steps:
   1. Fresh installation
   2. Uninstallation
   3. Upgrade from v1.4.4
   4. Upgrade from v1.5.1

✅ - Longhorn Chart - Chris

   Prereq: Set Concurrent Automatic Engine Upgrade Per Node Limit to greater than 0
   Test steps:
   1. Fresh installation
   2. Uninstallation
   3. Upgrade from v1.4.4
   4. Upgrade from v1.5.2

v1.5.3-rc1 ✅