XDevice, a core module of the OpenHarmony test framework, provides services on which test case execution depends.
XDevice consists of the following sub-modules:
- command: enables command-based interactions between users and the test platform. It parses and processes user commands.
- config: sets test framework configurations and provides different configuration options for the serial port connection and USB connection modes.
- driver: functions as a test case executor, which defines main test steps, such as test case distribution, execution, and result collection.
- report: parses test results and generates test reports.
- scheduler: schedules various test case executors in the test framework.
- environment: configures the test framework environment, enabling device discovery and device management.
- testkit: provides test tools to implement JSON parsing, network file mounting, etc.
- resource: provides the device connection configuration file and report template definitions.
xdevice ├── config # XDevice configuration │ ├── user_config.xml # XDevice environment configuration ├── resource # XDevice resources │ ├── tools # Burning tools ├── src # Source code │ ├── xdevice ├── extension # XDevice extension │ ├── src # Source code of the extension │ └── setup.py # Installation script of the extension
The environment requirements for using this module are as follows:
- Python version: 3.7.5 or later
- pySerial version: 3.3 or later
- Paramiko version: 2.7.1 or later
- RSA version: 4.0 or later
Go to the installation directory of XDevice.
Open the console window and run the following command:
python setup.py install
Installing the extension
Go to the installation directory of the XDevice extension.
Open the console and run the following command:
python setup.py install
Modifying the user_config.xml file
Configure information about your environment in the user_config.xml file.
1. Configure the environment.
For devices that support hdc connection, refer to the following note to configure the environment.
NOTE: ip/port: IP address and port of a remote device. By default, the parameter is left blank, indicating that the local device (IP address: 127.0.0.1; port: the one used for hdc startup) is used as the test device. sn: SN of the test devices specified for command execution. If this parameter is set to SN1, only device SN1 can execute the subsequent run commands. In this case, other devices are set as Ignored and not involved in the command execution. You can run the list devices command and check the value of Allocation to view the sn values. You can set multiple SNs and separate each two of them with a semicolon (;).
For devices that support serial port connection, refer to the following note to configure the environment.
- serial/com: serial port for local connection, for example, COM20
- serial/type: serial port type. The value can be cmd (serial port for test case execution) or deploy (serial port for system upgrade). For the open-source project, the cmd and deploy serial ports are the same, and their com values are the same too. serial/baud_rate, data_bits, stop_bits and timeout: serial port parameters. You can use the default values.
2. Set the test case directory.
dir: test case directory
3. Mount the NFS.
NOTE: server: NFS mounting configuration. Set the value to NfsServer. server/ip: IP address of the mounting environment server/port: port number of the mounting environment server/username: user name for logging in to the server server/password: password for logging in to the server server/dir: external mount path server/remote: whether the NFS server and the XDevice executor are deployed on different devices. If yes, set this parameter to true. Otherwise, set it to false.
Specify the task type.
Start the test framework.
Execute test commands.
Test framework commands can be classified into three groups: help, list, and run. Among them, run commands are most commonly used in the instruction sequence.
Queries help information about test framework commands.
help: use help to get information. usage: run: Display a list of supported run command. list: Display a list of supported device and task record. Examples: help run help list
Displays device information and related task information.
list: This command is used to display device list and task record. usage: list list history list <id> Introduction: list: display device list list history: display history record of a serial of tasks list <id>: display history record about task what contains specific id Examples: list list history list 6e****90
Executes test tasks.
run: This command is used to execute the selected testcases. It includes a series of processes such as use case compilation, execution, and result collection. usage: run [-l TESTLIST [TESTLIST ...] | -tf TESTFILE [TESTFILE ...]] [-tc TESTCASE] [-c CONFIG] [-sn DEVICE_SN] [-rp REPORT_PATH [REPORT_PATH ...]] [-respath RESOURCE_PATH [RESOURCE_PATH ...]] [-tcpath TESTCASES_PATH [TESTCASES_PATH ...]] [-ta TESTARGS [TESTARGS ...]] [-pt] [-env TEST_ENVIRONMENT [TEST_ENVIRONMENT ...]] [-e EXECTYPE] [-t [TESTTYPE [TESTTYPE ...]]] [-td TESTDRIVER] [-tl TESTLEVEL] [-bv BUILD_VARIANT] [-cov COVERAGE] [--retry RETRY] [--session SESSION] [--dryrun] [--reboot-per-module] [--check-device] [--repeat REPEAT] action task Specify tests to run. positional arguments: action Specify action task Specify task name,such as "ssts", "acts", "hits"
run [task name] -l module1;moudle2
task name: task type. This parameter is optional. Generally, the value is ssts, acts, or hits. -l: test cases to execute. Use semicolons (;) to separate each two test cases. module: module to test. Generally, there is a .json file of the module in the testcases directory. In addition, other parameters can be attached to this command as constraints. Common parameters are as follows: -sn: specifies the devices for test case execution. If this parameter is set to SN1, only device SN1 executes the test cases. -c: specifies a new user_config.xml file. -rp: indicates the path where the report is generated. The default directory is xxx/xdevice/reports. Priority of a specified directory is higher than that of the default one. -tcpath: indicates the environment directory, which is xxx/xdevice/testcases by default. Priority of a specified directory is higher than that of the default one. -respath: indicates the test suite directory, which is xxx/xdevice/resource by default. Priority of a specified directory is higher than that of the default one. --reboot-per-module: restarts the device before test case execution.
View the execution result.
After executing the run commands, the test framework displays the corresponding logs on the console, and generates the execution report in the directory specified by the -rp parameter. If the parameter is not set, the report will be generated in the default directory.
Structure of the report directory (the default or the specified one) ├── result # Test case execution results of the module │ ├── module name.xml │ ├── ... ... │ ├── log # Running logs of devices and tasks │ ├── device 1.log │ ├── ... ... │ ├── task.log ├── summary_report.html # Visual report ├── summary_report.html # Statistical report └── ... ...