# Dxplaination of time spent on a test task

The cloud test service performs the test task on the real . The execution flow diagram is shown below:

Specifically:

  1. Account Check : Check if the account is free, start testing when free
  2. Assigning test machines : The cloud test service assigns idle machine tests as much as possible
  3. Environment initialization includes preparations such as installing WeChat package, logging in to WeChat, and pulling up Weixin Mini Program. Generally takes 8-12 minutes
  4. Perform the user test task : This step takes 20 minutes when the user submits the task parameters, such as selecting the Monkey task for 20 minutes
  5. Results processing : collecting results to report to the cloud testing background, the cloud tester background processes test results, output reports, general takes 2-4 minutes around

As can be seen, in addition to the time spent on the tasks specified by user submitting parameters, the environment initialization and results processing takes an additional 10-15 minutes ** and is generally longer than the maximum test time.

NOTE:

  • Environmental initialization and result processing are one-time for each machine and occupancy time is fixed, and does not increase as the number of use cases increases.
  • does not include user time spent , and does not deduct user time
  • For users who purchase additional time for [, the rapid test mode can greatly reduce the environmental initialization time

If you encounter the following scenarios, the task will take longer (it cannot be estimated):

  • Account Occupied : Test account cannot be run simultaneously on the same Weixin Mini Program .So when the running account is occupied, the system will automatically wait in a queue
  • Real machine queuing : The underlying cloud test service uses WeTest real machine to execute, when the real machine is occupied, you need to queue up and wait
  • Execution exception : Due to live testing, there is no 100% guarantee of success.When a test task encounters an exception, such as a offline connection, it is automatically retried by default. Test time increases if the first time an exception results in a retry of a task

# Dxplaination of expected completion time

To facilitate users to keep track of the current test progress, the cloud test service will automatically estimate the task completion time in the test based on the historical execution of the machine. The user can see the test progress panel by moving the mouse to test .

Special Note: All tasks are estimated according to the maximum test duration **at the time of submission.The estimated test time is based only on the historical experience of **and does not equal the actual task completion time .

Note that does not show the estimated time of completion in the following cases:

  • Have an account or machine in queue?
  • The task has an exception, is in retry, and the machine or account to retry is still in queue

In addition, it is recommended that users can configure the mobile phone number / email address **and the specified account will be notified first when the task ends, so as to avoid waiting. For more details, refer to the task notification configuration guidelines

# Dxplaination of the test progress

The cloud testing service calculates the real-time progress percentage based on the expected completion time of each machine. The calculation progress rules are as follows:

  1. Calculate the percentage of completed progress per machine based on the expected time. Note that if the machine is in the queue, the completion progress is 0
  2. The average completion is calculated based on the percentage of completion per machine, showing the real-time progress of the task.
  3. In case of special circumstances, such as the machine fails to restart automatically, progress will be retracted .This is because the machine that goes back needs to recalculate the percentage of progress from zero.

Note Similar to the estimated completion time, the test schedule is The estimated schedule , is not equal to the actual execution schedule



View cloud testing related questions and answers >

To WeChat Open Community Questions >