testing: updated test report generation to use csv and not autosearh for results

Signed-off-by: IonutMuthi <[email protected]>

Author: IonutMuthi

tools/testing/README.md

@@ -1,6 +1,6 @@
 # Scopy Testing Tools
 
-A comprehensive set of Python tools for managing Scopy's manual testing workflow. These tools automate test environment setup, result parsing, and Excel report generation for release testing processes.
+A comprehensive set of Python tools for managing Scopy's manual testing workflow. These tools automate test environment setup, result parsing, and CSV template generation for release testing processes.
 
 ## Quick Start
 
@@ -25,9 +25,9 @@ Edit the generated RST files in `testing_results/testing_results_v3.0.0/` and fi
 - **Comments:** Test execution notes
 - **Result:** PASS or FAIL
 
-### 3. **Generate Excel Report**
+### 3. **CSV Template Auto-Generated**
+The CSV template is automatically created during step 1. You can also generate it manually:
 ```bash
-# Parse completed test results and create Excel report
 python3 parseTestResults.py v3.0.0
 ```
 
@@ -74,9 +74,9 @@ python3 setup_test_environment.py v3.0.0 --new-since v2.5.0
 - Contains filtered RST files ready for manual testing
 - Preserves RST structure for documentation compilation
 
-### `parseTestResults.py` - Excel Report Generation
+### `parseTestResults.py` - CSV Template Generation
 
-**Purpose:** Parses completed test results and generates Excel reports with execution statistics.
+**Purpose:** Generates CSV templates from testing directories for manual test execution tracking.
 
 **Basic Usage:**
 ```bash
@@ -97,9 +97,9 @@ python3 parseTestResults.py v3.0.0 --output /path/to/custom_results.xlsx
 ```
 
 **Output:**
-- Creates/updates `testing_results/scopy_test_results.xlsx`
-- Each version gets its own worksheet
-- Columns: Test UID | Component | RBP | Result | Tested OS | Comments | File
+- Creates `testing_results/testing_results_{version}.csv`
+- Template with empty result fields for manual completion
+- Columns: Test UID | Component | RBP | Result | Tested OS | Comments | Tester | File
 
 ### `generateTestsTable.py` - Source Documentation Tracking
 
@@ -153,24 +153,17 @@ cd testing_results/testing_results_v3.0.0/
 **Result:** PASS
 ```
 
-**3. Generate Report**
-```bash
-# Parse results and create Excel report
-python3 parseTestResults.py v3.0.0
-```
+**3. Track Test Execution**
+- Edit the auto-generated CSV template: `testing_results/testing_results_v3.0.0.csv`
+- Fill in Result, Tested OS, Comments, and Tester columns for each test
 
 **4. Review Results**
-- Open `testing_results/scopy_test_results.xlsx`
-- Check "v3.0.0" worksheet for complete test execution summary
+- Open `testing_results/testing_results_v3.0.0.csv`
+- Use spreadsheet software for analysis and reporting
 
 
 ##  Requirements
 
-### Dependencies
-```bash
-pip install openpyxl  # For Excel file generation
-```
-
 ### Git Requirements
 - Git repository (required for `--new-since` functionality)
 - Proper git tags for version references
@@ -183,21 +176,22 @@ scopy/
 └── tools/testing/        # This toolset
 ```
 
-## Excel Report Format
+## CSV Template Format
 
 ### Columns
 - **Test UID** - Unique test identifier
 - **Component** - Test component (adc, dac, m2k, core, etc.)
 - **RBP** - Risk-based priority (P0, P1, P2, P3)
-- **Result** - Test outcome (PASSED, FAILED, SKIPPED)
-- **Tested OS** - Operating system used for testing
-- **Comments** - Test execution notes
+- **Result** - Test outcome (empty template field for PASSED/FAILED/SKIPPED)
+- **Tested OS** - Operating system used for testing (empty template field)
+- **Comments** - Test execution notes (empty template field)
+- **Tester** - Person executing the tests (empty template field)
 - **File** - Source RST filename
 
 ### Multiple Versions
-- Each version gets its own worksheet in the Excel file
+- Each version gets its own CSV file: `testing_results_{version}.csv`
 - Historical test data preserved across versions
-- Easy comparison between releases
+- Easy import into spreadsheet tools for analysis
 
 ## Troubleshooting
 

tools/testing/file_filters.py

@@ -15,6 +15,10 @@
 
 def _should_include_file(test_file, component_filter, new_uids):
     """Determine if file should be included based on filters."""
+    # Skip all index files - they're not needed for CSV workflow
+    if 'index.rst' in test_file['relative_path']:
+        return False
+
     # Include files from specified components
     if test_file['component'] in component_filter:
         return True
@@ -23,12 +27,6 @@ def _should_include_file(test_file, component_filter, new_uids):
     if new_uids and any(test['uid'] in new_uids for test in test_file['tests']):
         return True
 
-    # Include only top-level index files, not component-specific ones
-    if 'index.rst' in test_file['relative_path']:
-        path_parts = test_file['relative_path'].split('/')
-        # Include plugins/index.rst, general/index.rst but not plugins/m2k/index.rst
-        return len(path_parts) == 2 and path_parts[1] == 'index.rst'
-
     return False
 
 

tools/testing/file_operations.py

@@ -12,66 +12,12 @@
 
 import os
 import shutil
-import re
 from file_filters import filter_rst_content
 
 
-def get_copied_components(filtered_files):
-    """Track which components were actually copied."""
-    copied_components = set()
-    for tf in filtered_files:
-        if tf['component'] not in ['other', 'general']:
-            copied_components.add(tf['component'])
-    return copied_components
-
-
-def extract_component_from_toctree_entry(entry):
-    """Extract component name from toctree entry."""
-    # "   adc/index" → "adc"
-    # "   core/hp_tests" → "core"
-    entry = entry.strip()
-    if '/' in entry:
-        return entry.split('/')[0]
-    return entry
-
-
-def filter_index_content(file_path, copied_components):
-    """Filter toctree entries in index files based on copied components."""
-
-    with open(file_path, 'r', encoding='utf-8') as f:
-        content = f.read()
-
-    # Find toctree section
-    toctree_pattern = r'(\.\. toctree::\n(?:\s+:[^\n]+\n)*\s*\n)(.*?)(\n\n|\.\.|$)'
-    match = re.search(toctree_pattern, content, re.DOTALL)
-
-    if not match:
-        return content  # No toctree found
-
-    header = match.group(1)
-    entries = match.group(2)
-    footer = content[match.end():]
-
-    # Filter toctree entries
-    filtered_entries = []
-    for line in entries.split('\n'):
-        if line.strip():
-            # Extract component from entry like "adc/index" → "adc"
-            component = extract_component_from_toctree_entry(line)
-            if component in copied_components:
-                filtered_entries.append(line)
-
-    # Reconstruct content
-    before_toctree = content[:match.start()]
-    new_entries = '\n'.join(filtered_entries)
-
-    return f"{before_toctree}{header}{new_entries}\n{footer}"
-
-
 def copy_files_unchanged(test_files, dest_dir, component_filter=None):
     """Copy files without content modification."""
     copied_count = 0
-    copied_components = get_copied_components(test_files) if component_filter else None
 
     for test_file in test_files:
         src_path = test_file['file_path']
@@ -80,15 +26,8 @@ def copy_files_unchanged(test_files, dest_dir, component_filter=None):
         # Create destination directory
         os.makedirs(os.path.dirname(dest_path), exist_ok=True)
 
-        # Filter index files when component filtering is active
-        if component_filter and 'index.rst' in test_file['relative_path']:
-            filtered_content = filter_index_content(src_path, copied_components)
-            with open(dest_path, 'w', encoding='utf-8') as f:
-                f.write(filtered_content)
-        else:
-            # Copy file unchanged
-            shutil.copy2(src_path, dest_path)
-
+        # Copy file unchanged
+        shutil.copy2(src_path, dest_path)
         copied_count += 1
 
     return copied_count
@@ -101,7 +40,6 @@ def filter_by_rbp_content(test_files, rbp_filter, dest_dir, component_filter=Non
         return copy_files_unchanged(test_files, dest_dir, component_filter)
 
     copied_count = 0
-    copied_components = get_copied_components(test_files) if component_filter else None
 
     # Filter active - parse and modify content
     for test_file in test_files:
@@ -114,12 +52,7 @@ def filter_by_rbp_content(test_files, rbp_filter, dest_dir, component_filter=Non
             filtered_content = filter_rst_content(test_file['file_path'], rbp_filter, new_uids)
             with open(dest_path, 'w', encoding='utf-8') as f:
                 f.write(filtered_content)
-        elif component_filter and 'index.rst' in test_file['relative_path']:
-            # Filter index files when component filtering is active
-            filtered_content = filter_index_content(test_file['file_path'], copied_components)
-            with open(dest_path, 'w', encoding='utf-8') as f:
-                f.write(filtered_content)
-        else:  # File has no tests (index, docs, etc.)
+        else:  # File has no tests (docs, etc.)
             shutil.copy2(test_file['file_path'], dest_path)
 
         copied_count += 1