GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Product Name

Security Level

GENEX Probe

INTERNAL

Product Version

Page

V300R014

Total 14 pages

GENEX Probe V300R014 Voice Quality Evaluation (MOS) Test Guide

2015-4-4

Huawei confidential. No spreading without permission.

Page 1. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Prepared

Liu Yanan (employee

By

ID: 00290893)

Reviewed

Li Xuge (employee

By

ID: 00190089)

Approved

Date

2014-11-07

Date

2014-11-07

Date

By Approved

Date

By

Huawei Technologies Co., Ltd. All rights reserved

2015-4-4

Huawei confidential. No spreading without permission.

Page 2. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

1 Purpose This document describes the usage method and precautions of the newly added MOSCard synchronization MOS test Sync SQE (MAYA44 USB+) of the Probe V300R014C00 version.

2 Preparations for Test 2.1 Hardware Preparations (1) One PC. (2) Two terminals: applicable terminals include Mate7, P7, and U8860 mobile phones. (3) One MAYA44 USB+ audio adapter. The method for obtaining the MAYA44 USB and audio adapter is as follows: (a) Product introduction: http://www.esi-audio.cn/?action=products&title=maya44usb%2B (b) Purchase mode: Authorization website: http://www.esi-audio.cn/?action=company&page=store Contact: Manager Mr. Deng, telephone number: 13761118718 (4) Two MOS audio cables used for testing Obtaining mode: contact Xiao Yongmao (employee ID: 00218250) Telephone number: 13892834144

2.2 (1) (2) (3) (4) (5)

Software Preparations Probe V300R014C00 installation package MAYA44 USB+ audio adapter driver Corresponding drivers of terminals (The drivers of P7 and Mate7 are the same.) PESQ and POLQA algorithm licenses HiSilicon Agent MAYA Driver.rar

Install package P7 Driver.rar

HUA_7.2.2.exe

2.3 Environment Preparations (1) (2) (3) (4)

Install the terminal driver to ensure that the terminal can be properly connected to the PC. Install the HiSilicon Agent. Install the Probe. Start the Probe and import the POLQA license (Without a POLQA license, you cannot

perform the POLQA NB and SWB algorithm tests. The license must be purchased.). 2015-4-4

Huawei confidential. No spreading without permission.

Page 3. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

As shown in the preceding figure, click Update POLQA License and select POLQA License. After a successful import, the system displays a message indicating that the POLQA license is successfully imported. (5) Install the audio adapter driver and then start the audio adapter console on the taskbar, as shown in the following figure.

After connecting to the audio adapter, the console is displayed as shown in the following figure indicating that the audio adapter driver is installed successfully. Otherwise, reinstall the driver.

2015-4-4

Huawei confidential. No spreading without permission.

Page 4. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

3 Sync

SQE

(MAYA44

USB+)

Operation

Description 3.1

Connecting to Terminals Properly

This document uses the terminal Mate7 as an example to describe the test operation, and similar operations apply to P7 terminals. (1) Start the HiSilicon Agent. (2) Enter *#*#2846579159#*#* in the dialer interface of the terminal and choose Background setting > Usb ports setting. In the USB mode switch interface, touch Switch to AP. In the USB Ports Setting interface, select Balong Debug mode. (3) Connect the terminals to the PC in turn and ensure that all ports on the Agent can be read (You are advised to record the corresponding AT ports and mobile phone numbers of the terminals to ensure that you will not confuse the ports and mobile phone numbers of different terminals in the following configuration test plans.), as shown in the following figure.

2015-4-4

Huawei confidential. No spreading without permission.

Page 5. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

(4) Connect the MAYA44 USB+ MOSCard to the PC. (5) Start the Probe and connect the Probe to the terminals and MOSCard.

Record the corresponding port and mobile phone numbers of the terminals when you configure the terminals, facilitating the subsequent configuration test plans. In the following part of this document, the MS1 functions as the MOC and the MS2 functions as the MTC.

2015-4-4

Huawei confidential. No spreading without permission.

Page 6. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

(6) Audio cable connection: Each audio cable has one 3.5 mm headset connector and two RCA connectors (a red one and a black one). Insert the headset connectors (3.5 mm) of two audio cables into two terminals, respectively. Then, connect the red RCA connector to the out port of the audio adapter, and the black one to the in port (This connection mode is only used as an example. In actual use, refer to the instructions of the audio cables for correct connection. Improper connection may lead to low MOSs.). In this document, the MS1 functions as the MOC and the MS2 functions as the MTC. Connect the MS1 terminal to the out port of the MOSCard through an audio cable, serving as the voice playing end. Connect the MS2 terminal to the in port of the MOSCard through an audio cable, serving as the voice recording

2015-4-4

Huawei confidential. No spreading without permission.

Page 7. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

end. The final connection diagram is as follows.

(7) After the configuration is complete, click the Connect icon. The results are shown as follows.

3.2 1.

Configuring Test Plans Properly Configure the test plan on the MOC, as shown in the following figure.

2015-4-4

Huawei confidential. No spreading without permission.

Page 8. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Main parameter description (For details, see the help document): Destination MS: indicates the name of the MTC. MOS Card: indicates the name of the MOSCard. Destination Number: indicates the phone number of the MTC. MOS Algorithm: indicates the speech quality evaluation algorithm. The Probe supports the PESQ and POLQ algorithms. You must install the POLQA license if you select the POLQA algorithm. Save All Result File: indicates whether to save the result speech file settings. Play Channel [OUT]: indicates the voice playing channel. Each OUT RCA interface on the audio adapter is numbered (such as 1, 2, 3, and 4). The configured number must be the same as that on the red RCA connector of the real connected MOC. Record Channel [IN]: indicates the voice recording channel. Each IN RCA interface on the audio adapter is numbered (such as 1, 2, 3, and 4). The configured number must be the same as that on the black RCA connector of the real connected MTC. Speech Sample File: indicates the sample speech file path. Currently, the PESQ algorithm enables users to manually select the corpora path. If you need to replace the corpora when using the POLQA algorithm, you must rename the corpora to be replaced in the corresponding installation 2015-4-4

Huawei confidential. No spreading without permission.

Page 9. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

directory. The corpora name is modified according to the test plan default name. Delete the corpora containing the wav48000 field when you replace a corpus. Otherwise, the obtained MOS score is low.

Delete the corpora containing the wav48000 field when you replace a corpus.

Speech Result File: indicates the result speech file path. 2.

Do not configure any test plan to the MTC and MOSCard.

3.3 Adjusting Attenuation Before the actual test, the audio adapter output volume must be adjusted based on the test terminal model to ensure the accuracy of MOS result. Set the in-call volumes of the two test mobile phones to the maximum. Currently, the Probe does not support the MOS self-check function and the attenuation value cannot be automatically adjusted. Before the formal test, you need to select a stable and optimal attenuation value. Configure and execute the test plan. Start the Probe and choose View > MOS > Voice Call > Speech Quality Evaluation to view the MOS. Adjust the attenuation value of the out port configured in the test plan. Start from 0, test about 10 values for each attenuation adjustment, record the optimal attenuation value, and use the optimal value as the formal test attenuation value. Do not modify the gain and muting settings of the INPUT and MONITOR during the attenuation adjustment. After you complete the settings, the console is shown as follows:

2015-4-4

Huawei confidential. No spreading without permission.

Page 10. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Because of terminal differences, you need to readjust the attenuation value when replacing the terminals. However, the attenuation value range does not differ much. When replacing the test corpora, you also need to readjust the attenuation value.

3.4 Querying Results You can view the speech quality evaluation results by choosing View > MOS > Voice Call > Speech Quality Evaluation.

2015-4-4

Huawei confidential. No spreading without permission.

Page 11. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

Test results are displayed in the corresponding interface of the MOC and MS1 data is displayed on the interface by default. If MS1 is not the MOC, you can perform handover by right-click on the interface, as shown in the following figure.

2015-4-4

Huawei confidential. No spreading without permission.

Page 12. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

4 Precautions If the test MOS is low (if the MOS test score is between 1 and 2), do as follows: (1) Check method: When executing the test plan, enable the hands-free function of the MTC to check whether you can hear the sample speech corpus. If any speech is heard, it indicates that the MOC is connected to the MOSCard properly. (2) Check whether the audio cable is properly connected to the MTC: set Save All Result File to yes, check whether you can hear any sound by playing the result speech files and whether the sound is consistent with that in the sample speech files. (3) Check the actual network quality: Call each other from two terminals and hear the actual voice quality. The audio cable is connected properly. However, after replacing the test corpus, the MOS is low. Check method:

2015-4-4

Huawei confidential. No spreading without permission.

Page 13. Total 14 Pages

INTERNAL

GENEX Probe V300R014Voice Quality Evaluation (MOS) Test Guide

(1) Check whether corpora files including the field wav48000 exist in the corpora path. If any files exist, delete them. (2) If the MOS remains low after resolving the preceding problem, you are advised to adjust the attenuation value of the out port. Because the sensitivities of different corpora are different, you need to readjust the attenuation value. (3) Check the attenuation and gain values of the MOSCard to ensure that the gain values of the INPUT and MONITOR are 0 and the INPUT and MONITOR are set to muting. When you test the VoLTE, if the MOS is low or fluctuates greatly, open the VoLTE Parameters interface under the LTE node and check whether the jitter, delay, and packet loss values are great.

2015-4-4

Huawei confidential. No spreading without permission.

Page 14. Total 14 Pages