[feature]A testing framework based on pytest that supports multi-level testing, platform tagging, performance data collection, and Allure report generation.

Author: Potterluo

test/.gitignore

@@ -0,0 +1,7 @@
+reports/
+dataset/
+logs/
+*__pycache__/
+.*
+start.bat
+!.gitignore

test/README.md

@@ -0,0 +1,183 @@
+# UCM Pytest Testing Framework
+
+A pytest-based testing framework that supports multi-level testing, platform tagging, performance data collection, and Allure report generation.
+[Chinese Documentation](README_zh.md)
+## Framework Features
+
+- [x] 🏗️ **Multi-level Testing**: Unit(0) → Smoke(1) → Regression(2) → Release(3)
+- [x] 🏷️ **Flexible Tagging**: Supports feature tags and platform tags
+- [ ] 📊 **Data Collection**: Integrates InfluxDB performance data push
+- [ ] 📋 **Beautiful Reports**: Allure test report integration
+- [ ] 🔧 **Convenient Tools**: Rich testing tools and common methods
+
+## Test Level Definitions
+
+| Level | Name | Description | Execution Timing |
+|-------|------|-------------|------------------|
+| 0 | Unit | Unit tests | Each code commit |
+| 1 | Smoke | Smoke tests | Build verification |
+| 2 | Regression | Regression tests | Before version release |
+| 3 | Release | Release tests | Production environment verification |
+
+## Directory Structure
+
+```
+project/
+├── tests/
+│   ├── config.yaml              # Testing framework configuration file
+│   ├── conftest.py              # pytest configuration and fixtures, main entry point
+│   ├── common/                  # Common utility library
+│   │   ├── __init__.py
+│   │   ├── config_utils.py      # Configuration file reading utility
+│   │   ├── influxdb_utils.py    # InfluxDB writing utility
+│   │   ├── allure_utils.py      # Allure report utility
+│   ├── suites/                  # Test case directory
+│   │   ├── unit/                # Unit tests (stage 0)
+│   │   ├── smoke/               # Smoke tests (stage 1)
+│   │   ├── regression/          # Regression tests (stage 2)
+│   │   └── release/             # Release tests (stage 3)
+├── requirements.txt             # Dependencies
+├── pytest.ini                   # pytest configuration
+└── README.md                    # User guide
+```
+
+## Test Case Standards
+
+### Basic Structure
+
+```python
+import pytest
+from tests.common.influxdb_utils import push_to_influx
+from tests.common.test_utils import setup_test_env
+
+class TestExample:
+    """Test example class"""
+
+    @pytest.mark.stage(2)
+    @pytest.mark.feature("accuracy")
+    def test_calculation_accuracy(self):
+        """Test calculation accuracy"""
+        # Arrange
+        input_data = 1 + 1
+
+        # Act
+        result = calculate(input_data)
+
+        # Assert
+        assert result == 2
+
+        # Collect performance data (to be implemented)
+        push_to_influx("calculation_time", 0.001, {
+            "test_name": "test_calculation_accuracy",
+            "feature": "accuracy"
+        })
+```
+
+### Tag Usage Specifications
+
+#### 1. Level Tags (Required)
+```python
+@pytest.mark.stage(0)    # Unit test
+@pytest.mark.stage(1)    # Smoke test
+@pytest.mark.stage(2)    # Regression test
+@pytest.mark.stage(3)    # Release test
+```
+
+#### 2. Feature Tags (Recommended)
+```python
+@pytest.mark.feature("performance")     # Performance test
+@pytest.mark.feature("accuracy")        # Accuracy test
+```
+
+#### 3. Platform Tags (Optional)
+```python
+@pytest.mark.platform("gpu")  # Only execute on GPU platform
+@pytest.mark.platform("npu")  # Only execute on NPU platform
+# Default no tag, execute on all platforms
+```
+
+#### 4. Combined Usage
+```python
+@pytest.mark.stage(2)
+@pytest.mark.feature("performance")
+@pytest.mark.gpu
+def test_gpu_performance(self):
+    """GPU Performance Test"""
+    pass
+```
+
+### Test Method Naming Convention
+
+```python
+def test_[scenario]_[expected_result]:
+    """Test scenario description"""
+    pass
+
+# Example:
+def test_calculation_returns_correct_result():
+    """Test calculation returns correct result"""
+    pass
+
+```
+
+### Assertion Specification
+
+```python
+# Recommended: Clear assertion messages
+assert result == expected, f"Expected {expected}, actual {result}"
+
+# Recommended: Use pytest built-in assertions
+assert isinstance(result, dict)
+assert len(items) > 0, "Result list should not be empty"
+
+# Data validation
+assert 0 <= accuracy <= 1.0, "Accuracy should be in the range of 0-1"
+assert response.status_code == 200
+```
+
+## Usage
+
+### Install Dependencies
+```bash
+pip install -r requirements.txt
+```
+
+### Run Tests
+
+#### 1. Run by Levels
+```bash
+# Run all tests
+pytest
+
+# Run specific levels
+    pytest --stage=1              # Only run smoke tests
+    pytest --stage=2,3           # Run regression and release tests
+    pytest --stage=1+            # Run smoke and all higher level tests
+```
+
+#### 2. Run by Features
+```bash
+# Run specific feature tests
+pytest --feature=accuracy
+pytest --feature=performance,accuracy
+```
+
+#### 3. Run by Platforms
+```bash
+# Run all tests (default)
+pytest
+
+# Only run GPU-related tests
+    pytest --platform=gpu
+
+    # Exclude NPU tests
+    pytest --platform=!npu
+```
+
+#### 4. Combined Filtering
+```bash
+# Run performance regression tests on GPU platform
+pytest --stage=2 --platform=gpu --feature=performance
+```
+
+

test/README_zh.md

@@ -0,0 +1,97 @@
+# UCM Pytest 测试框架
+
+基于pytest的测试框架，支持多级别测试、平台标记、性能数据收集和Allure报告生成。
+
+## 框架特性
+
+- [x] 🏗️ **多级别测试**: Unit(0) → Smoke(1) → Regression(2) → Release(3)
+- [x] 🏷️ **灵活标记**: 支持功能标签和平台标记
+- [ ] 📊 **数据收集**: 集成InfluxDB性能数据推送
+- [ ] 📋 **精美报告**: Allure测试报告集成
+- [ ] 🔧 **便捷工具**: 丰富的测试工具和公共方法
+
+## 测试级别定义
+
+| 级别 | 名称 | 说明 | 执行时机 |
+|-----|------|------|----------|
+| 0 | Unit | 单元测试 | 每次代码提交 |
+| 1 | Smoke | 冒烟测试 | 构建验证 |
+| 2 | Regression | 回归测试 | 版本发布前 |
+| 3 | Release | 发布测试 | 生产环境验证 |
+
+## 目录结构
+
+```
+project/
+├── tests/
+│   ├── config.yaml              # 测试框架配置文件
+│   ├── conftest.py              # pytest配置和fixtures，程序主入口
+│   ├── common/                  # 通用工具库
+│   │   ├── __init__.py
+│   │   ├── config_utils.py      # 配置文件读取工具
+│   │   ├── influxdb_utils.py    # InfluxDB写入工具
+│   │   ├── allure_utils.py      # Allure报告工具
+│   ├── suites/                  # 测试用例目录
+│   │   ├── unit/                    # 单元测试 (stage 0)
+│   │   ├── smoke/                   # 冒烟测试 (stage 1)
+│   │   ├── regression/              # 回归测试 (stage 2)
+│   │   └── release/                 # 版本测试 (stage 3)
+├── requirements.txt             # 依赖包
+├── pytest.ini                  # pytest配置
+└── README.md                    # 用户指南
+```
+
+## 测试用例标准
+
+### 基本结构
+
+```python
+import pytest
+from tests.common.influxdb_utils import push_to_influx
+from tests.common.test_utils import setup_test_env
+
+class TestExample:
+    """测试示例类"""
+
+    @pytest.mark.stage(2)
+    @pytest.mark.feature("accuracy")
+    def test_calculation_accuracy(self):
+        """测试计算准确性"""
+        # Arrange
+        input_data = 1 + 1
+
+        # Act
+        result = calculate(input_data)
+
+        # Assert
+        assert result == 2
+
+        # 收集性能数据(待实现)
+        push_to_influx("calculation_time", 0.001, {
+            "test_name": "test_calculation_accuracy",
+            "feature": "accuracy"
+        })
+```
+
+### 标记使用规范
+
+#### 1. 级别标记 (必需)
+```python
+@pytest.mark.stage(0)    # 单元测试
+@pytest.mark.stage(1)    # 冒烟测试
+@pytest.mark.stage(2)    # 回归测试
+@pytest.mark.stage(3)    # 发布测试
+```
+
+#### 2. 功能标记 (推荐)
+```python
+@pytest.mark.feature("performance")     # 性能测试
+@pytest.mark.feature("accuracy")        # 准确性测试
+```
+
+#### 3. 平台标记 (可选)
+```python
+@pytest.mark.platform("gpu")  # 仅GPU平台执行
+@pytest.mark.platform("npu")  # 仅NPU平台执行
+# 默认无标记，所有平台都执行
+```

test/common/__init__.py

@@ -0,0 +1,4 @@
+"""
+Allure Report Integration Utility
+Provides convenient Allure report generation and customization functions
+"""

test/common/allure_utils.py

@@ -0,0 +1,77 @@
+"""
+Configuration File Utility
+Provides functionality to read and parse configuration files
+"""
+import yaml
+import os
+from typing import Dict, Any, Optional
+
+
+class ConfigUtils:
+    """
+    Configuration File Utility Class
+    Provides functionality to read and parse configuration files
+    """
+    _instance = None
+    _config = None
+
+    def __new__(cls):
+        if cls._instance is None:
+            cls._instance = super(ConfigUtils, cls).__new__(cls)
+        return cls._instance
+
+    def __init__(self, config_file=None):
+        if not hasattr(self, 'initialized'):
+            if config_file is None:
+                # Default configuration file path
+                current_dir = os.path.dirname(os.path.abspath(__file__))
+                self.config_file = os.path.join(current_dir, "..", "config.yaml")
+            else:
+                self.config_file = config_file
+            self.initialized = True
+
+    def read_config(self) -> Dict[str, Any]:
+        """Read configuration file"""
+        if self._config is None:
+            try:
+                with open(self.config_file, 'r', encoding='utf-8') as file:
+                    self._config = yaml.safe_load(file) or {}
+            except FileNotFoundError:
+                print(f"Configuration file {self.config_file} not found")
+                self._config = {}
+            except yaml.YAMLError as e:
+                print(f"Failed to parse configuration file: {e}")
+                self._config = {}
+        return self._config
+
+    def get_config(self, key: str, default: Any = None) -> Any:
+        """Get configuration item"""
+        config = self.read_config()
+        return config.get(key, default)
+
+    def get_nested_config(self, key_path: str, default: Any = None) -> Any:
+        """Get nested configuration item, supports dot-separated paths like 'influxdb.host'"""
+        config = self.read_config()
+        keys = key_path.split('.')
+        value = config
+
+        try:
+            for key in keys:
+                value = value[key]
+            return value
+        except (KeyError, TypeError):
+            return default
+
+
+# Global configuration instance
+config_utils = ConfigUtils()
+
+
+if __name__ == "__main__":
+    # Read configuration file
+    influxdb_config = config_utils.get_config("influxdb")
+    print("InfluxDB configuration:", influxdb_config)
+
+    # Get configuration using nested path
+    host = config_utils.get_nested_config("influxdb.host", "localhost")
+    print(f"InfluxDB host: {host}")