A Rohde & Schwarz Company
QualiPoc Android 12.1.2 Manual February 2013
SwissQual® License AG Allmendweg 8 CH-4528 Zuchwil Switzerland t +41 32 686 65 65 f +41 32 686 65 66 e
[email protected] www.swissqual.com
Part Number: 16-100-201135-1
SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and free of errors and omissions. SwissQual will, if necessary, explain issues which may not be covered by the documents. SwissQual’s liability for any errors in the documents is limited to the correction of errors and the aforementioned advisory services. Copyright 2000 - 2013 SwissQual AG. All rights reserved. No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated into any human or computer language without the prior written permission of SwissQual AG. Confidential materials. All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and is provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material. When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademark somewhere in your text. SwissQual®, Seven.Five®, SQuad®, QualiPoc®, NetQual®, VQuad®, Diversity® as well as the following logos are registered trademarks of SwissQual AG.
Diversity Explorer™, Diversity Ranger™, Diversity Unattended™, NiNA+™, NiNA™, NQAgent™, NQComm™, NQDI™, NQTM™, NQView™, NQWeb™, QPControl™, QPView™, QualiPoc Freerider™, QualiPoc iQ™, QualiPoc Mobile™, QualiPoc Static™, QualiWatch-M™, QualiWatch-S™, SystemInspector™, TestManager™, VMon™, VQuad-HD™ are trademarks of SwissQual AG. SwissQual acknowledges the following trademarks for company names and products: Adobe®, Adobe Acrobat®, and Adobe Postscript® are trademarks of Adobe Systems Incorporated. Apple is a trademark of Apple Computer, Inc. DIMENSION®, LATITUDE®, and OPTIPLEX® are registered trademarks of Dell Inc. ELEKTROBIT® is a registered trademark of Elektrobit Group Plc. Google® is a registered trademark of Google Inc. i.Scan is a trademark of CommScope, Inc. Intel®, Intel Itanium®, Intel Pentium®, and Intel Xeon™ are trademarks or registered trademarks of Intel Corporation. INTERNET EXPLORER®, SMARTPHONE®, TABLET® are registered trademarks of Microsoft Corporation. Java™ is a U.S. trademark of Sun Microsystems, Inc. Linux® is a registered trademark of Linus Torvalds. Microsoft®, Microsoft Windows®, Microsoft Windows NT®, and Windows Vista® are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries U.S. NOKIA® is a registered trademark of Nokia Corporation. Oracle® is a registered US trademark of Oracle Corporation, Redwood City, California. SAMSUNG® is a registered trademark of Samsung Corporation. SIERRA WIRELESS® is a registered trademark of Sierra Wireless, Inc. TRIMBLE® is a registered trademark of Trimble Navigation Limited. U-BLOX® is a registered trademark of u-blox Holding AG. UNIX® is a registered trademark of The Open Group.
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Contents 1
Product Overview ................................................................................................................................ 5 Service Tests ......................................................................................................................................... 5 Device Support ...................................................................................................................................... 5 Post-Processing Software ..................................................................................................................... 5 QualiPoc Monitors ................................................................................................................................. 5 Related Documents ............................................................................................................................... 6
2
Installing QualiPoc Android ............................................................................................................... 7 GPS Configuration ................................................................................................................................. 7 Date and Time Configuration ................................................................................................................. 7 Updating QualiPoc Android ................................................................................................................... 7
3
QualiPoc Settings ................................................................................................................................ 8 Map Settings .......................................................................................................................................... 8 BTS Information ..................................................................................................................................... 8 Layer 3 ................................................................................................................................................... 9 IP Monitor .............................................................................................................................................. 9 Customization ......................................................................................................................................10 Notifications .........................................................................................................................................10 Technology Forcing .............................................................................................................................11 WCDMA Preferred Channel Forcing .............................................................................................. 11 Unit Configuration ................................................................................................................................12 Advanced Analysis Settings ................................................................................................................12 Exporting and Importing Configuration Settings ..................................................................................13 Exporting a Configuration File ........................................................................................................ 13 Importing a Configuration File ........................................................................................................ 14
4
Measurement Job Types ...................................................................................................................16 Single CALL Job – Answering Station .................................................................................................16 Single CALL Job – Call 2 Any Number................................................................................................16 Single CALL Job – Speech MOC ........................................................................................................16 Single CALL Job - Speech Double Ended ..........................................................................................17 Supported Measurement Scenarios ............................................................................................... 18 Creating and Running the Job on a QualiPoc Phone .................................................................... 19 Starting the Job on the QualiPoc Phone .............................................................................................. 24 Stopping the Job on the QualiPoc Phone ............................................................................................ 24 Creating and Running the Job in Diversity NQView ...................................................................... 24 Creating a Voice Call Server in NQView .............................................................................................. 25 Creating the Measurement Task in NQView ........................................................................................ 27 ii
Contents | CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Starting the Measurement Task in NQView ......................................................................................... 29 Single DATA Job – Capacity DL ..........................................................................................................29 Single DATA Job – Email Send and Receive ......................................................................................30 Single DATA Job – FTP DL and UL ....................................................................................................30 Single DATA Job – HTTP Browser ......................................................................................................31 Single DATA Job – HTTP Transfer DL and UL ...................................................................................31 Single DATA Job – Ping ......................................................................................................................32 Single DATA Job - Upload ...................................................................................................................32 Single DATA Job - Iperf UDP ..............................................................................................................34 Single MESSAGE Job – MMS Send and Receive ..............................................................................36 Single MESSAGE Job – SMS Send and Receive ...............................................................................36 Multiple Jobs – Multi-Data / Multi-Mix / Multi-RAB / Parallel ...............................................................37 Advanced Settings ...............................................................................................................................37 5
Using QualiPoc ..................................................................................................................................38 Help Menu ...........................................................................................................................................38 Main Toolbar ........................................................................................................................................38 Creating and Running Basic Jobs .......................................................................................................39 Creating and Running Advanced Jobs ................................................................................................40 Exporting and Importing Advanced Measurement Jobs ................................................................ 41 Running an Advanced Measurement Job ...................................................................................... 41 Viewing Results ...................................................................................................................................42 Automatically Uploading Result Files to a Server .......................................................................... 42 Cell Info Banner ...................................................................................................................................43 Status and Log Monitors ......................................................................................................................44 Technology Monitors ...........................................................................................................................45 Serving Cell Monitor ....................................................................................................................... 45 Data Monitors ................................................................................................................................. 45 Cells and Coverage Monitors ......................................................................................................... 46 Layer 3 Monitors ............................................................................................................................. 47 Viewing and Saving Layer 3 Messages ............................................................................................... 47 Map Monitors .......................................................................................................................................48 Outdoor Map Monitor ..................................................................................................................... 48 Offline Positioning with Open Street Map ............................................................................................ 48 Saving a Selection of an Open Street Map .......................................................................................... 49 Exporting and Importing Open Street Map Tiles .................................................................................. 49 Using BTS information on the Map Monitor ......................................................................................... 49 Indoor Map Monitor ........................................................................................................................ 50 IP and PCAP Logging Monitors ...........................................................................................................51 iii
Contents | CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Test and Events Monitors ....................................................................................................................51 6
Measurement Files Post-Processing ...............................................................................................53 Measurement File Logging ..................................................................................................................53 Replaying Measurements on the Phone .............................................................................................53 Transferring the Measurement Files to a PC ......................................................................................53 Replaying Measurement Files in NetQual NQView .............................................................................54 Analysing Measurement Data with NetQual NQDI ..............................................................................54
Figures Figure 3-1 Export configuration settings .......................................................................................................... 14 Figure 4-1 Create a QualiPoc Speech Double Ended measurement job ........................................................ 20 Figure 4-2 Advanced settings for a speech double ended job ........................................................................ 20 Figure 4-3 Timings and scheduling for a Speech Double Ended job .............................................................. 21 Figure 4-4 Window Timings for a speech double ended job ........................................................................... 21 Figure 4-5 Set call direction ............................................................................................................................. 22 Figure 4-6 Speech Double Ended test settings ............................................................................................... 22 Figure 4-7 Select the algorithm for the test ..................................................................................................... 23 Figure 4-8 Additional Speech Double Ended test settings .............................................................................. 24 Figure 4-9 Add PC unit to system configuration .............................................................................................. 25 Figure 4-10 Create a voice call server ............................................................................................................. 25 Figure 4-11 Add a device to the voice call server ........................................................................................... 26 Figure 4-12 Add a measurement task ............................................................................................................. 27 Figure 4-13 Add an intrusive job to the measurement task ............................................................................. 28 Figure 4-14 Add a speech test to the intrusive job .......................................................................................... 29 Figure 4-15 Job settings for the Upload measurement job ............................................................................. 33 Figure 4-16 Results file settings ...................................................................................................................... 34 Figure 4-17 Iperf DATA job settings and Advanced settings ........................................................................... 34 Figure 4-18 Iperf test settings and parameters ............................................................................................... 35 Figure 4-19 Iperf log ........................................................................................................................................ 35 Figure 4-20 Iperf log ........................................................................................................................................ 36 Figure 5-1 Help videos for QualiPoc ................................................................................................................ 38 Figure 5-2 Automatically upload result files ..................................................................................................... 43 Figure 5-3 Cell Info banner .............................................................................................................................. 43 Figure 5-4 Title values in Cell Info banner ....................................................................................................... 44 Figure 5-5 Customizing a Cell Info banner ...................................................................................................... 44 Figure 5-6 Saving Layer 3 messages .............................................................................................................. 48
iv
Contents | CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Product Overview
1
QualiPoc Android has been designed for handheld radio network optimization and quality assessment. This software supports a variety of devices and technologies including GSM, GPRS, EDGE, WCDMA, HSDPA, HSUPA and LTE. Due to the ease of use, you can use QualiPoc to collect data and voice services statistics. SwissQual offers the following QualiPoc Handheld Android versions:
Android RF: RF optimization and troubleshooting for scenarios where MOS testing is not a consideration. This tool has been designed for indoor and outdoor use for easy and fast data collection on various technologies. Android RF is ideal for field engineers who perform daily tasks such as site verification and commissioning, troubleshooting, and optimization.
Note: QualiPoc Android RF is also available in a Lite version, which does not save the results to a measurement file.
Android QA: Combines the functionality of Android RF with MOS quality testing algorithms such as SQUAD, and P.863 (POLQA). Android QA is a mobile network quality assessment tool that has been designed to allow customers to easily evaluate the quality of services, such as voice calls, while providing the RF parameters and application layer information that are crucial to troubleshooting.
Service Tests QualiPoc Android includes the following test functionality:
CALL: Uses the Call2anynumber test to set up a speech call connection to a number that automatically responds. Uses the Speech MOC test to measure intrusive speech quality (MOS) on speech call connection to a responding station. The answering station job could be used to answer calls for a MOC DL job.
DATA: Sets up a PS data connection to an access point name. This functionality includes FTP UL/DL, HTTP Browser, HTTP Transfer GET/PUT, Ping, Email and Capacity DL testing.
MESSAGE: Test SMS and MMS functionality
Multi-Data, Multi-Mix, Multi-RAB, and Parallel: Execute data and call tests sequential or parallel.
Idle Monitoring: Allows you to monitor RF parameters during normal use of the phone.
Device Support QualiPoc Android is available for several smartphone and tablet models that run on Android OS. For a complete list of the supported devices, see the Release Notes – QualiPoc Android.pdf document.
Post-Processing Software SwissQual offers the following NetQual PC-based products for the post-processing of QualiPoc measurement files:
NetQual NQView: Replay tool useful for post processing data from a QualiPoc Android Handheld.
NetQual NQDI: Database based post-processing tool with in-depth data analysis, mapping, and reporting functionalities. Useful for mass data post processing on files from a fleet of QualiPoc units.
QualiPoc Monitors QualiPoc provides you with the ability to control and to monitor the tests on your QualiPoc Android 5
Chapter 1 | Product Overview CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
smartphone. By default, the QualiPoc Android workspace contains several technology, mapping, and result monitors. However, you can also customize and save personal workspaces.
Table 1-1 Description of the monitors that are available in QualiPoc Android
Monitor
Description
Status
Includes general information about the operator, technology, GPS, and general test results statistics.
Log
Provides test execution information.
WCDMA/GSM/LTE
Displays the main serving cell information based on the actual technology.
HSDPA/HSUPA
Provides details on HSDP and HSUPA data technology information. This monitor is only available for WCDMA technology.
GPRS/EDGE
Provides details on GPRS or EDGE data technology information. This monitor is only available for GSM technology.
LTE DL/LTE UL
Provides details on LTE data technology information. This monitor is only available for LTE technology.
Cells
Provides an overview of serving and neighbour cells status and coverage. The content of this monitor depends on the main technology that the mobile phone is connected to.
Coverage line-chart
Displays serving and neighbour cell coverage. The content of this monitor depends on the main technology that the mobile phone is connected to.
Test
Displays the summary of the on-going tests including KPI bar chart.
Layer3
Displays a list of signalling layer 3 headers including the option to decode each l3 message
IP
Displays the HTTP, FTP, TCP, DNS and ICMP messages that have been captured including the option to decide the messages.
Events
Displays a list of voice and data call related events as well as Wi-Fi scanning results.
Map
Displays the current position, route and BTS information on a map based on Google maps or Open Street Map.
Indoor
Displays a floor plan for indoor marking navigation.
Related Documents
Manual - QualiPoc Android Remote Controlled.pdf Manual - NetQual - NQView.pdf
6
Chapter 1 | Product Overview CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
2
Installing QualiPoc Android
QualiPoc Android arrives pre-installed on a supported smartphone. SwissQual has modified the firmware and the Android operating system to enable the full feature set of the QualiPoc application. The first start is also part of the delivery. However, you need a valid licence key to use QualiPoc, which you can obtain from SwissQual Support. Ensure that you read the Release Notes – QualiPoc Android.pdf document before you use QualiPoc Android and also before you update the software. Note: If you want to add speech testing features to your installation, contact SwissQual.
GPS Configuration QualiPoc Android can use the internal GPS of the smartphone or an external Bluetooth GPS to log the current location and display this location on the outdoor mapping monitor. Important: You need to enable the internal GPS on the phone to use GPS capability in QualiPoc. You can pair Bluetooth GPS device with the phone and then select the device in the Map settings. In this case you can disable the internal GPS to save battery power. Otherwise you can use the internal GPS as a backup location provider in the event that the Bluetooth GPS disconnects or has insufficient coverage.
Date and Time Configuration To ensure that the measurement tests run correctly, you need to disable the automatic date and time update feature on the phone, for example, touch Settings > Date & Time > Automatic, and ensure that the automatic option is greyed out.
Updating QualiPoc Android Before you run an update, ensure that the memory card is correctly installed and recognized on your device.
To update QualiPoc Android 1. Connect your Android phone to your computer with a USB cable. 2. On your phone, select the USB connected option. 3. Copy the *.apk file onto your phone, for example, copy the file to [sdcard]/QualiPoc/. 4. Disconnect the phone from your PC. 5. Open a file manager on the phone and go to the folder that contains the *.apk update file. 6. Start the update application and follow the instructions. Important: If you cannot run the application, touch Settings on the Application menu, and then enable the Unknown Sources option.
7
Chapter 2 | Installing QualiPoc Android CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
3
QualiPoc Settings
You can use the menus on your smartphone to easily configure QualiPoc Android.
To access the QualiPoc settings, press Menu
and touch Settings
.
You can also touch the up arrow and then touch Settings
at the bottom of the screen
on the toolbar.
Map Settings The Map settings page allows you to configure the settings for indoor and outdoor maps.
Map Engine: Select the map source, that is, Google Maps or Open Street Maps
Map Mode (Google Maps only): Enables satellite mode.
Online Mode (Open Street Map only): Enables online or offline mode for Open Street Maps.
BTS monitor: Displays BTS information on the map monitor.
Note: You need to load a BTS list for this feature to work.
GPS Device: Select the internal GPS or an external Bluetooth GPS device
Indoor Map: Select the image file in JPEG or PNG format to use as a floor plan for indoor navigation
Show signal information: Show value label by each indoor marker
BTS Information The BTS Information page allows you to activate the BTS information display and to select your GSM, WCDMA or LTE BTS lists. You can copy the file to any location on the SD card of the phone. The BTS Info File must be in CSV format where each row corresponds to one cell ID. Use the following syntax for a BTS Info File:
8
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
WCDMA: Name,Technology,UARFCN,PSC,Lon,Lat,MCC,MNC,LAC,CellId,Direction
GSM: Name,Technology,BCCH ,BSIC,Lon,Lat,MCC,MNC,LAC,CellId,Direction
LTE: Name,Technology,EARFCN,PhyCID,Lon,Lat,MCC,MNC,LAC,CellId,Direction
Layer 3 The Layer 3 page lists the available Layer 3 filtering options, which you can enable to filter out the layer3 headers, for example, by group or by subgroup.
IP Monitor The IP Monitor page allows you to selectively filter out messages that belong to the HTTP, FTP, DNS, and ICMP protocols.
9
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Customization The customization page allows you to customize the QualiPoc workspace to display your preferred monitors as well as create and save different custom workspace configurations. You can then load different workspaces for different monitoring tasks. To customize your workspace, press Menu the page, select one of the following actions:
and touch Settings > Customization, and at the bottom of
Add: Adds a new monitor
Remove: Deletes the monitor that you select.
Move left: Moves the monitor one position to the left.
Move right: Moves the monitor one position to the right.
The Workspace editor provides you with an overview of the monitors in the current workspace.
To save a custom workspace, press Menu
and touch Save workspace.
To load a custom workspace, press Menu workspace.
and touch Load workspace, and then select a
Notifications You can configure notifications based on layer3 messages or on display values. A standard Android notification informs you about a new QualiPoc notification. You can also use a custom sound or vibration for each QualiPoc notification.
To view the event history of the notification, touch the occurrence of the notification in the list.
10
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Technology Forcing On the Forcing page you can select the technology and bands that you want to force the phone to use.
To enable technology forcing 1. Press Menu
, touch Settings, and then touch Forcing.
2. Touch Technology Forcing. 3. Touch Select Network Type, and then touch a network technology in the list, for example, WCDMA + GSM. Note: The list of available frequency bands for the technology depends on the capabilities of the device.
WCDMA Preferred Channel Forcing On some devices, you can force QualiPoc to use a preferred WCDMA channel when multiple channels are available. This feature is only available for the following devices:
Samsung S III (I747, I747M, T999, T999V, SC-06D) Samung GalaxyTab 8.9 (P-7320, P-7320T, I957, I957D)
Note: After you set the preferred UARFCN channel, QualiPoc immediately restarts the device. The forcing sets the radio modem to scan a ‘priority’ UMTS UARFCN when the phone powers up, before scanning other channels. The radio modem attempts to access the network with the preferred UARFCN even if a cell on another UMTS channel would provide a better connection. Note: Note: If the signal is lost on the preferred UMTS channel, the modem scans for another channel. To force the phone to rescan for the preferred UMTS channel, you must power cycle the modem.
11
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Unit Configuration On the Unit configuration page you can specify the unit name, the connection parameters to the media server, and the structure of the results folder. The unit name is useful for identifying the measurement files of a particular phone during post processing. If you manually upload measurement files from a phone to the media server, that is, with the Results command on the main menu, the unit name is also used for the folder on the media server that contains the file. You can configure the folder structure as flat, for example, 2011-12-10_Custom HD or as a hierarchy, for example, 2011-12-10/Custom HD/. You can use the following types of information for the folder names:
Date (for example, 2011-12-10 System (always “QualiPoc”) Device Task/Job (Task or job name)
Advanced Analysis Settings The Advanced analysis settings page allows you to configure additional QualiPoc settings.
12
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Set max thrpt: Allows you to set the maximum throughput in kbps for different technologies. This value is mostly used for charts and color coding.
ROMES logging: Records additional raw data files that you can replay with ROMES
Raw QC trace logging: Includes whole Qualcomm trace data in the results file
Important: As this option can degrade the measurement performance of the phone, you should only enable Raw QC trace logging for troubleshooting a problem.
Exporting and Importing Configuration Settings You can export and import the following configuration files:
BTS lists
Layer 3 filter
Workspaces
Custom Monitors
Notifications
Job settings
Exporting a Configuration File You export the QualiPoc configuration files over Bluetooth and WiFi, and over the Internet through Email, and Dropbox Note: Some devices do not support WiFi. To use the Email option, you need to configure the Email server settings on your phone. For Dropbox support you need the Dropbox application on your phone.
To export configuration settings 1. Press Menu
and touch Settings > Import/Export configuration.
2. Touch Export configuration. 3. Touch the configuration file types that you want to export. 13
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
4. Export the files. a
To export the files to the SD card, press Menu for the file, and touch Export.
, touch Export to external storage, enter a name
b
To export the files off the phone, touch Send via, touch a service in the list, for example, Email, and follow the instructions.
Figure 3-1 Export configuration settings
Importing a Configuration File QualiPoc can only import a job from an SD card in the phone.
To import a measurement job 1. Copy the XML file of the measurement job, or the Zip file that contains the measurement files that you want to import, to the SD card on the phone: 2. Press Menu
and touch Start Job.
3. Touch Import from SD card, go to the location on the SD card where you stored the job file, and touch 14
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
the file. Important: This process overwrites existing measurement job files on the phone with the same name.
15
Chapter 3 | QualiPoc Settings CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
4
Measurement Job Types
You can create and configure a measurement job in QualiPoc directly on your smartphone, save the job locally, and run the job immediately. This section describes the types of measurement jobs that you can create and run in QualiPoc.
Single CALL Job – Answering Station The single call test - answering station job starts a measurement device in answering station mode. Once in this mode, another device can initiate MOC DL testing to the answering station.
Algorithm: Evaluates speech quality on the calling side.
Reference File: Reference file for speech quality evaluation
Single CALL Job – Call 2 Any Number A Call2AnyNumber job sets up a simple Circuit Switch (CS) call and outputs the main test-related KPIs. This simple test requires you to input the following parameters.
Phone number: Number that you want to call
Call duration: Duration of the call in seconds
Number of cycles: Number of times to repeat a single test before the job ends
Single CALL Job – Speech MOC A Speech MOC job sets up a Circuit Switch (CS) call to an answering station. This station can be part of the network, that is, an automatic voice announcement number in MSC, a Diversity Call Server that is running in a special mode, or another QualiPoc device running in Answering Station mode. Currently, the job outputs the main test-related KPIs and MOS values of the speech in the downlink. This simple test requires you to 16
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
input the following parameters:
Phone number: Number that you want to call
Call duration: Duration of the call in seconds
Max call setup time: Maximum waiting time for the call to be set up
Algorithm: Algorithm to evaluate speech quality
Reference File: Reference file to play for speech quality evaluation
Wave file options: Options for recording wave files during the test
For speech quality tests, you can use the SQUAD08 or POLQA (P.863) algorithm.
Important: You need a valid QualiPoc Android license for the algorithm that you want to use.
Single CALL Job - Speech Double Ended The Speech Double Ended job establishes a CS call between two QualiPoc Android phones, a QualiPoc Android phone and a Diversity Call Server, or QualiPoc Android phone and a Diversity Smartphone without an MCM. Important: The Speech Double Ended job can only run on devices with Snapdragon S3 or S4 processors.
Side: Side of the call, that is, A or B-side
Call direction: A-side to B-side, B-side to A-side, or Alternating Call Sequence
Note: In Diversity, the call direction is in MOC:MTC format, that is, 1:0 for A to B, 0:1 for B to A, and 1:1 for the Alternating Call Sequence.
Phone Number: Number that you want to call
Advanced settings: Specify call timings, algorithm, and sample
Number of cycles: Number of times to repeat a single test before the job ends
Chapter 4 | Measurement Job Types
17 CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Job Name: Name of the job
Note: Diversity ignores this name.
Timing and Scheduling: Settings to configure the duration of the job. The window timings are compatible with Diversity.
Speech Double Ended: Specify the settings for the Speech Double Ended job
Sample Direction: From A to B, B to A, or Half-Duplex
Selected Algorithm: Select the algorithm to calculate quality scores, namely POLQA or SQuad08.
Reference File: Speech sample to use for the call.
Important: You need to re-select the reference file when you change the algorithm. QualiPoc reference files do not have the same names as Diversity reference files.
Supervised Unit: QualiPoc to QualiPoc or with the stop call option where the phone operates as an autonomous B-side answering station.
Important: Do not enable this option if the job involves a call to a Diversity unit.
Remote Job Number: Unlike the job name, the value that you enter is transferred to a Diversity unit during the call.
Sample Frequency: Plays a sample each time that the interval that you specify elapses
Supported Measurement Scenarios QualiPoc Android supports the following speech double ended measurement scenarios:
QualiPoc Android to QualiPoc Android: o
Manually configure the job in QualiPoc on the A-side and B-side phones.
o
Manually start the job in QualiPoc on the B-side and A-side phones, respectively
For more information, see the "Creating and Running the Job on a QualiPoc Phone" section on page 19 and "Starting the Job on the QualiPoc Phone" section on page 24.
QualiPoc Android to Diversity Call Server (PSTN/ISDN): 18
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
o
Add and configure the Diversity voice call server in NQView. For more information, see the "Creating a Voice Call Server in NQView" section on page 25.
o
Export the configuration of the voice call server from NQView and import the configuration on the voice call server.
o
Manually configure the job on the QualiPoc phone. For more information, see the "Creating and Running the Job on a QualiPoc Phone" section on page 19.
o
Add the QualiPoc phone as a mock voice call server in NQView. For more information, see the "Creating a Voice Call Server in NQView" section on page 25.
o
Manually create the task in NQView, export the B-side task configuration file, and import the file on the voice call server. For more information, see the "Creating the Measurement Task in NQView" section on page 27.
o
Manually start the job on the QualiPoc phone. For more information, see the "Starting the Job on the QualiPoc Phone" section on page 24
Important: The QualiPoc phone must be the A-side device.
Diversity Android Smartphone without an MCM/PSM to QualiPoc Android: o
Add and configure the Diversity smartphone. For more information, see the Manual – NetQual – NQView.pdf document.
o
Manually configure the job on the QualiPoc phone. For more information, see the "Creating and Running the Job on a QualiPoc Phone" section on page 19.
Important: Some Diversity settings are slightly different than the QualiPoc counterparts. In such cases, consult the setting information in the Note paragraph below the relevant step. o
Add the QualiPoc phone as a mock DTMF voice call server in NQView. For more information, see the "Creating a Voice Call Server in NQView" section on page 25.
o
Create the measurement task in NQView with the Diversity smartphone as the A-side device and the QualiPoc phone, that is, the mock DTMF voice call server, as the B-side device. For more information, see the "Creating the Measurement Task in NQView" section on page 27.
o
Manually start the job on the QualiPoc phone. For more information, see the "Starting the Job on the QualiPoc Phone" section on page 24.
o
Start the measurement task in NQView. For more information, see the "Starting the Measurement Task in NQView" section on page 29.
Important: A Diversity smartphone only supports the DTMF job transfer method. The Diversity smartphone must be the A-side device and the QualiPoc Android phone must be the B-side device.
Diversity Smartphone in an MCM/PSM to QualiPoc Android: o
Same as the Diversity Android Smartphone without an MCM/PSM to QualiPoc Android scenario except that you need to include an MCM in the NQView hardware configuration
Creating and Running the Job on a QualiPoc Phone The settings that you specify for the measurement job on the A-side device must be identical to the settings on the B-side device, except for the respective phone numbers and test direction.
To create a Speech Double Ended measurement job in QualiPoc 1. Press Menu Ended.
and touch Start job > Selected job type > Single CALL tests > Speech Double
2. Configure the basic job settings. 19
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
a
Touch Selected side and then touch a side, for example, A.
b
Touch Selected phone number > Add new, enter the number for the A-side phone, and then touch OK.
Figure 4-1 Create a QualiPoc Speech Double Ended measurement job
3. Touch Advanced settings > Job name, enter a name for the job, and then touch OK.
Figure 4-2 Advanced settings for a speech double ended job
4. Specify the timing settings for the job. a
Touch Timings and Scheduling.
b
Touch Duration, enter a value, and then touch OK.
Note: For a test that involves a Diversity unit, enter the same duration as you did in Figure 4-12 for the measurement task in NQView. 20
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
c
Touch # of Cycles, enter a value, and then touch OK.
Note: For a test that involves a Diversity unit, enter the same number of cycles as you did in Figure 4-12 for the measurement task in NQView.
Figure 4-3 Timings and scheduling for a Speech Double Ended job
d
Touch Pause time, enter a value and then click OK.
Important: This setting is only available in QualiPoc and must be 0 if the test involves a Diversity unit. e
Touch Window Timings and use the timings picker at the top left to select the parameter that you want to change, and then use the value picker at the top right to select the new value.
Note: For a test that involves a Diversity unit, specify the same Window timings as you did in Figure 4-13 for the intrusive job in NQView.
Figure 4-4 Window Timings for a speech double ended job
f
Press Back
.
5. Specify the test settings. a
On the Job settings page, touch Call Complex Speech in the Test area.
b
Touch Select call direction and touch the call direction.
Note: For a test that involves a Diversity unit, the call direction is the MOC:MTC ratio in Figure 4-13 that 21
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
you specified for the intrusive job in NQView. For a MOC:MTC ratio of 1:0, touch Call A to B, for a MOC:MTC ratio of 0:1, touch Call B to A, and for MOC:MTC ratio of 1:1, touch Alternating Call Sequence.
Figure 4-5 Set call direction
c
Touch Selected sample direction, and then touch an option in the list.
Note: Unlike in Diversity, the half-duplex option in QualiPoc always starts with a B to A sample direction and then alternates the sample direction. Furthermore, unlike in Diversity, you cannot specify the number of samples that a QualiPoc job uses. However, QualiPoc always evaluates the reference samples that the phone receives. For a test that involves a Diversity unit, ensure that the sample direction that you selected in Figure 4-14 for the test in NQView reflects these limitations.
Figure 4-6 Speech Double Ended test settings
d
Touch Selected algorithm and touch one of the following options. 22
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
SQuad08 for a Speech test
SQuad08 (WB): For a Speech-Wideband test
POLQA: For a Speech POLQA test
POLQA (WB): For a Speech-Wideband POLQA test
Note: For a test that involves a Diversity unit, touch the algorithm that you selected in Figure 4-14 for the test in NQView.
Figure 4-7 Select the algorithm for the test
e
Touch Selected reference file and touch a sample file for the test.
Note: For a test that involves a Diversity unit, use same reference sample that you selected in Figure 4-14 for the test in NQView, for example, English (U.S.) IRS for the .AM_fm_IRS.wav reference sample. f
Touch Sample frequency, enter one of the following sample frequencies, and then touch OK:
12.5: For tests that use the SQuad08 and POLQA algorithms.
Note: The sample frequency is the time difference between the start times of the two subsequent samples. A sample frequency of 12.5 seconds in QualiPoc corresponds to the combined 6 second Record hang-over that you specified in Figure 4-13 in NQView and the 6.5 second duration of the SwissQual reference samples.
20: For tests that use the SQuad08 (WB) and POLQA (WB) algorithms.
Note: QualiPoc on slower phones requires the longer time to calculate the MOS results in a wideband Speech Double Ended measurement job.
23
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Figure 4-8 Additional Speech Double Ended test settings
g
Touch Selected wave file option and touch an option.
Starting the Job on the QualiPoc Phone
To start the job, press Menu loaded, and touch Start job.
, touch Start jobs, ensure that the Speech Double Ended job is
Note: To load the job, press Menu job that you created.
, touch Load job, touch Speech Double Ended, and touch the
Stopping the Job on the QualiPoc Phone The B-side QualiPoc device handles a stop command from the Diversity A-side device in the following ways:
Stop command arrives during a configuration call: QualiPoc restarts the measurement job into waiting for configuration mode and does not save a measurement file
Stop command arrives during a normal call: QualiPoc stops the measurement job, and saves a measurement file.
Stop command arrives during a pause in a normal call: Job continues to run until the timeout is reached
Stop command does not arrive: If the call has already been configured and the test is running, the call runs indefinitely; however, if you restart the measurement task in NQView and QualiPoc is configured to receive the call, then QualiPoc restarts the job on the phone after the configuration call.
Creating and Running the Job in Diversity NQView The following sections describe how to use Diversity NQView to configure the following features for a speech double ended test:
Voice Call Server: Required for the QualiPoc Android to Diversity Call Server (PSTN/ISDN), Diversity Android Smartphone without an MCM/PSM to QualiPoc Android, and Diversity Smartphone in an MCM/PSM to QualiPoc Android scenarios Speech Double Ended Measurement Task: Required for the Diversity Android Smartphone without an MCM/PSM to QualiPoc Android, and Diversity Smartphone in an MCM/PSM to QualiPoc 24
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Android scenarios Starting the Measurement Task in NQView
Creating a Voice Call Server in NQView This section describes how to configure a physical Diversity voice call server with PSTN or ISDN cards in NQView as well as a mock Diversity voice call server. The mock call server represents the QualiPoc unit when you configure a mixed environment Diversity and QualiPoc speech double ended task in NQView. Important: For the Diversity smartphone to QualiPoc phone scenario, the following sections assume that have already configured the Diversity smartphone for the test. For the QualiPoc to Voice Call Server scenario, the following procedure assumes that you have already installed the ISDN or PSTN devices and the respective Windows drivers on the PC that hosts the voice call server.
To create a voice call server in NQView 1. On the Navigation panel of the Control console, click System configuration. 2. Add a PC unit. a
Right-click Hardware, point to Add unit, and then click PC.
Figure 4-9 Add PC unit to system configuration
b
Type a Name and Computer name for the unit, for example, QPAndroid.
Figure 4-10 Create a voice call server
c
In the Time synchronization list, click Internal sync. 25
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
d
e
In the following lists, click No connection/DTMF:
NQComm control
Unit control
Job transfer send
Job transfer listen
Click Apply and click OK.
3. Create a subscriber profile for the phone device or PSTN or ISDN card. a
Click System configuration on the Navigation panel and click the plus sign (+) beside Subscriber and access points.
b
Click the plus sign (+) beside an operator in the tree, right-click a provider, and then click Add subscriber.
c
Add the subscriber information, click Apply, and then click OK.
4. Add the QualiPoc phone or the PSTN or ISDN card as device to the DTMF voice call server. a
Right-click the unit in the tree, point to Add device, and then click the type of device, for example Mobile for a QualiPoc phone or ISDN for a Diversity device.
b
Type a name for the phone.
c
In the Model list, click the type of phone or ISDN or PSTN model.
d
In the Subscriber list, click the profile that you created in step 3.
Note: If you are creating a mock call server for a QualiPoc phone, the subscriber number is the only value that needs to be identical to the QualiPoc setting. e
Click Apply and click OK.
Figure 4-11 Add a device to the voice call server
5. Transfer the configuration to the voice call server PC. Note: You do not need to perform this action for the QualiPoc mock voice call server. For a description on how to transfer the configuration to the voice call server, see the "Configuring a Voice or Video Call Server in NQView" chapter in the Application Note - Voice and Video Call Server Config.pdf 26
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
document.
Creating the Measurement Task in NQView The following procedure assumes that you have already configured the Diversity device involved in the test, for example, the Diversity smartphone.
To define the measurement task in NQView 1. On the Navigation panel of the Control console, click Tasks and Jobs, right-click Measurement task in the tree, and then click Add task. 2. Type a name for the task.
Figure 4-12 Add a measurement task
3. In the Device A/B side area, select the A-side and B-side devices.
Scenario
A-Side Device
B-Side Device
QualiPoc to Diversity Call Server (PSTN/ISDN) scenario
QualiPoc phone (mock call server)
Diversity call server (PC)
Diversity Android Smartphone without an MCM/PSM to QualiPoc Android
Diversity Android Smartphone
QualiPoc phone (mock call server)
Diversity Smartphone in an MCM/PSM to QualiPoc Android scenarios
Diversity Android Smartphone
QualiPoc phone (mock call server)
4. Add a measurement job to the task. Important: You need to use the same job settings that you manually specified on the QualiPoc phone in the "Creating and Running the Job on a QualiPoc Phone" on page 19. a
In the Job sequence area, click the green plus sign
.
b
Click the yellow asterisk (*) in front of the Job list, and then click Intrusive job. 27
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Figure 4-13 Add an intrusive job to the measurement task
c
In the Name box, type a name for the job in the following DTMF job transfer format:
d
job_xyz
In the Record hang-over [ms] box, type 6000.
Note: QualiPoc does not have a hang-over recording setting. Instead, you need to specify a Record Hang-Over value of 6000ms and a Test Repetition Sequence of 11 in NQView. e
In the MOC:MTC ratio box, specify the call direction, for example, 1:1.
Note: QualiPoc does not use the MOC:MTC ratio to define the call direction, but rather uses A-side and B-side. As a result, a MOC:MTC ratio of 1:0 corresponds to the A to B call direction setting in QualiPoc and a 0:1 ratio corresponds to B to A. However, the MOC:MTC ratio of 1:1 corresponds to the Alternating Call Sequence call direction in QualiPoc. f
In the Timings area, select Use call duration to abort call.
Important: If you do not enable this option, the measurement task will not run correctly g
Specify the remaining timings, click Apply, and then click OK.
5. In the Intrusive test window, specify the settings for the speech test. a
Type a name for the test.
b
In the Test type list, click one of the following types:
Speech
Speech POLQA
Speech-Wideband 28
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
c
Speech-Wideband POLQA
In the Direction area, click a direction for the reference sample.
Note: You need to select the same direction for all of the reference samples that you use. Samples with alternating directions must start with a B to A direction; otherwise NQView does not accept the configuration on the task level. d
In the Reference sample list, click the speech sample that you want to use.
e
In the Save WAV files area, click an option.
f
Click Apply and then click OK
Figure 4-14 Add a speech test to the intrusive job
6. In the Job details in task window, click Save. 7. In the Measurement task window, specify the Duration and the number of Cycles for the task. 8. Click Apply, and then click OK. Note: For a description on how to transfer the task configuration to a Diversity voice call server, see the "Configuring a Voice or Video Call Server in NQView" chapter in the Application Note - Voice and Video Call Server Config.pdf document.
Starting the Measurement Task in NQView This section describes how to start the Speech Double Ended Measurement in NQView and on the QualiPoc phone.
To start the measurement task on NQView 1. On the Control console in NQView, click Tasks and Jobs. 2. Click the Tasks tab in the workspace. 3. Click the green arrow in the Start column in front of the task that you created.
Single DATA Job – Capacity DL Capacity DL tests can execute up to 4 parallel HTTP downloads at once.
29
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
URLs: HTTP address of the site that you want to download
Advanced Settings: Specify advanced timeouts and test options
Number of cycles: Number of times to repeat a single test before the job ends
Note: Ensure that the total download size of the reference files is large enough to last for the duration of the test.
Single DATA Job – Email Send and Receive The email test supports SMTP, POP3, IMAP, and SSL.
Outgoing and Incoming mail server: Address of the email server
Advanced Settings: Specify advanced timeouts and test options
Number of cycles: Number of times to repeat a single test before the job ends
Single DATA Job – FTP DL and UL FTP Transfer DL and UL jobs establish a Packet Switch call, execute an FTP transfer, and measure the testrelated performances. You need to enter the following parameters to configure an FTP job.
30
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Host address: IP address of the host
Note: To add the port number, type a colon (:) at the end of the address, and then type the port number. Only QualiPoc Handheld uses this number.
File: Name of the remote file that you want to download
Credentials: Login credentials for the FTP server
Advanced Settings: Specify advanced timeouts and test options
Number of cycles: Specify the number of times to repeat a single test before the job stops
Single DATA Job – HTTP Browser An HTTP Browsing job establishes a Packet Switch (PS) call and performs a browsing test to output test relevant results. For this test QualiPoc application uses the same web engine as the built in browser does. In order to run the test you need to specify the following parameters for an HTTP Browsing job.
URL: HTTP address of the site that you want to browse
Advanced Settings: Specify advanced timeouts and test options
Number of cycles: Number of times to repeat a single test before the job ends
Single DATA Job – HTTP Transfer DL and UL The HTTP Transfer Download (DL) and Upload (UL) jobs establish a Packet Switch (PS) call, execute an HTTP transfer, and measures the test-related performances. You need to enter the following parameters for these tests.
31
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Host address: IP address of the host server
File: Name of the remote file that you want to transfer
Credentials: Login information for the HTTP server
Advanced settings: Specify advanced timeouts and test options
Number of cycles: Number of times to repeat a single test before the job ends
Single DATA Job – Ping A Ping job establishes a Packet Switch call and pings the host that you specify to evaluate the Round Trip Time (RTT). You need to specify the following parameters for a Ping job.
Host: IP address of the host
Number of pings and interval: Number of pings and interval between pings in milliseconds
Packet size and timeout: Enter the packet size in bytes and the timeout for the ping in seconds
Advanced Settings: Specify advanced timeouts and test options
Number of cycles: Specify number of times to repeat a single test before the job ends
Single DATA Job - Upload The Upload job uploads the results files to the server that you specify in the job settings. Note: This job uploads the files from the results folder that you define in the unit configuration settings.
To create an Upload measurement job 1. Press Menu
and touch Start job > Selected job type > Single DATA tests > Upload.
2. Specify the server for the job. a
Touch Host address.
32
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Figure 4-15 Job settings for the Upload measurement job
b
In the Result files upload connection profile area, touch Select connection type.
c
Touch a connection type in the list, for example, FTP or HTTP.
d
Touch Select host, enter the URL for the server, and then touch OK.
e
Select active or passive mode.
3. Specify the login information for the server. a
Touch Select user name, enter an account name, and touch OK.
b
Touch Password, enter the password for the account, and touch OK.
4. Specify the remaining settings, for example, enable the Auto upload and Auto compression options. Important: You cannot specify timings for an Upload job.
33
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Figure 4-16 Results file settings
Single DATA Job - Iperf UDP The Iperf test allows you to measure network capacity with UDP streams.
To create an Iperf measurement job 1. Press Menu
and touch Start job > Selected job type > Single DATA tests > Iperf.
Figure 4-17 Iperf DATA job settings and Advanced settings
2. Touch Selected server address, touch Add new, enter the name of the server, and then touch OK. 3. Specify the test parameters. a
Touch Iperf in the Test area.
b
To add a command-line parameter, touch Selected additional parameters, enter the parameter, and then touch OK.
34
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Note: To view the list of available parameters, touch Full arguments list
Figure 4-18 Iperf test settings and parameters
The client report in the Iperf log has the following fields:
20130104135043 date/time 10.105.30.236 sender IP address 34548 sender port (UDP) 82.220.1.20 receiver IP address 5001 receiver port 4 ID 1.0-2.0 Interval in seconds 132300 data transferred in Bytes 1058400 bandwidth in bits/s
The final report datagram from the client and server has a total of 14 fields, 9 from the client report, and the following 5 fields:
6.429 Delay jitter 10 quantity of lost packets 893 quantity of received packets 1.120 lost packets in % 0 quantity of packets out of order
Figure 4-19 Iperf log
35
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Figure 4-20 Iperf log
Single MESSAGE Job – MMS Send and Receive You can add up to two attachments to an MMS test.
Receiver number: Number of the receiver
Advanced Settings: Specify advanced timeouts and test options
Number of cycles: Number of times to repeat a single test before the job ends
Single MESSAGE Job – SMS Send and Receive The SMS test allows you to configure the following options.
36
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Receiver number: Number of the receiver
Advanced Settings: Specify advanced timeouts and test options
Number of cycles: Number of times to repeat a single test before the job ends
Multiple Jobs – Multi-Data / Multi-Mix / Multi-RAB / Parallel Multiple jobs allow you to combine Data and Voice jobs into a single job. This option supports all single data and call tests.
Multi-Data: Sequence of data tests in which all the tests occur in one session
Multi-Mix: Sequence of data and call tests in which a new session starts for each test
Multi-RAB: Parallel execution of a call and a multidata test
Parallel: Parallel execution of up to 3 parallel jobs independent from each other (one call job and multiple single or multi-data jobs).
Advanced Settings You can also specify the following advanced parameters for each job.
Timings and scheduling: Time and date on which to start the job, the number of repetitions for the job, and the related timings, for example, duration of the job, pause between the tests, and so on
Test: Settings that are related to the job
Access Point: Network access point for the job
Pcap: Include the PCAP information to the measurement file
37
Chapter 4 | Measurement Job Types CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Using QualiPoc
5
This chapter describes how to use QualiPoc to create, to run, and to control your tests. QualiPoc makes full use of the smartphone touch functionalities so you can easily switch between the monitors, zoom in or out in the map monitors, and scroll easily. The application also has a toolbar, which you can use to access a variety of functions.
Help Menu The QualiPoc Help menu contains instructional videos.
To access the QualiPoc Help menu, press Menu want to watch.
, touch Help, and then touch the video that you
Note: If you do not see the menu, you need to manually copy the video files to the phone.
To enable the QualiPoc Help menu 1. Exit QualiPoc on the phone. 2. Connect the phone to a PC with a USB cable. 3. Create a HelpVideo folder in the QualiPoc folder on the phone. 4. Copy the video files, for example, 1. QualiPoc Android Introduction.mp4, from the Documentation folder on the QualiPoc installation CD to the /QualiPoc/HelpVideo folder on the phone. 5. Start QualiPoc.
Figure 5-1 Help videos for QualiPoc
Main Toolbar You can access the QualiPoc toolbar with the arrow at the bottom of the page.
38
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
The toolbar allows you to quickly perform the following actions when you monitor a test. Table 5-1 Description of the icons for executing tests
Icon
Description Idle Monitoring: Starts recording the information from the active tests in an MF file.
Freezing: Freezes the monitors until you touch the icon again.
Screen Capture: Captures the screen and saves the image to the SD card in PNG format.
Photo Marker: Captures a photograph with the phone camera and saves the photograph on the SD card in the QualiPoc/Results folder. If you are in recording or testing mode, the photo marker is added to the MF file. Settings: Opens the QualiPoc settings page for the monitor that you currently have open.
Creating and Running Basic Jobs This section describes how to quickly configure and run a basic measurement job on your phone. If you want to configure advanced settings and save your job configuration, see the "Creating and Running Advanced Jobs" section on page 40.
To quickly create and run a basic job 1. Press Menu
and touch Start Job.
39
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
2. Touch Select job type, touch a job group, and then touch a job type. 3. Touch and specify the settings for the job. 4. Touch Start Job.
Creating and Running Advanced Jobs This section uses the example of an HTTP Browser job to describe the steps that you need to take to create, save, load, and run an advanced measurement job on your phone.
To create and save an advanced measurement job 1. Press Menu
and touch Start Job > Advanced Settings.
2. Press Menu DATA tests.
, touch Create new job, and then touch a job group in the list, for example, Single
3. On the Select Job Type page, touch the type of job that you want to create, for example HTTP Browser. Note: For a description of the job types, see the "Measurement Job Types" chapter on page 16.
4. Touch and specify the settings for the job.
40
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
5. Press Menu
, touch Save job, type a name for the job in the Save job box, and then touch Save.
Note: QualiPoc stores the new job in in the following location: [sdcard]/QualiPoc/Jobs/
Exporting and Importing Advanced Measurement Jobs For a description on how to import and export job configuration files, see the "Importing a Configuration File" on page 14.
Running an Advanced Measurement Job In QualiPoc, you can perform an active test, such as Call to Any Number or HTTP transfer, or start idle monitoring. In both cases, the default QualiPoc monitors displays network information, RF values, and test results whenever these values are available.
To load and run a measurement job 1. Press Menu
and touch Start Jobs.
2. Press Menu tests.
, touch Load job, and then touch a job group in the list, for example, Single DATA
3. On the Select Job Type page, touch the type of job.
41
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
4. In the list of jobs, touch the job that you want to run. Note: QualiPoc loads a job from the following location on the phone: [sdcard]/QualiPoc/Jobs/ 5. Press the Back key and touch Start Job.
Viewing Results The Results monitor allows you to compress, to upload, and to delete measurement files and crash dumps. You can also filter the files according to type, that is, the .mf, .crashdump, .sqz, and .crashdump.zip. When you compress a measurement file, the entire contents of the file, that is, audio recording, pcap files, photo markers, screen shots, indoor maps, and tab files, are included in the .sqz compressed file.
To access the Results monitor, press Menu
, and touch Results.
Automatically Uploading Result Files to a Server In addition to manually uploading a result file to a server, you can also configure QualiPoc to automatically upload result files to an FTP or HTTP server.
42
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
To configure QualiPoc to automatically upload result files 1. Press Menu
and touch Settings > Unit Configuration.
2. In the Result files upload area, touch Auto upload.
Figure 5-2 Automatically upload result files
Cell Info Banner The Cell Info banner is at the top of the screen and displays the values that you select.
Figure 5-3 Cell Info banner
Note: This banner is only available on Samsung Galaxy SIII, Samsung Galaxy Tab 8.9, HTC One XL mobile devices. If you do not see all of the values that you selected, touch the banner to display the remaining values.
To customize the the Cell Info banner 1. Touch and hold the Cell Info banner. 2. To change the title values, touch Customize title values. Note: You can only have two title values. a
In the list of parameters, touch the parameters for the title of the banner.
b
If the number of Remaining parameters is 0, you need to touch a selected value, for example, Network, to remove the selection.
c
Touch the parameter that you want to display in the title area of the Cell Info banner.
43
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Figure 5-4 Title values in Cell Info banner
3. To change values that appear on the banner, touch Customize banner values. Note: The banner can only display 10 values. a
If the list already contains 10 values, touch and hold the value that you want to remove, and then touch the red X beside the value.
b
At the top of the Add / remove / rearrange screen, touch the green plus sign
c
Touch a value in the list and continue until you have selected 10 values.
.
Figure 5-5 Customizing a Cell Info banner
Status and Log Monitors The Status and Log monitors provide general information about the current QualiPoc Android status and active tests. The status monitor displays information about the network in use, GPS position, and test results. The Log monitor lists the actions that are performed by the active engine, which runs the test.
44
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Technology Monitors The WCDMA, GSM, HSDPA, HSUPA, GPRS/EDGE and LTE monitors automatically display the information that is relevant to the technology in use. For example, when the smartphone performs a GSM to WCDMA handover, the WCDMA monitor automatically replaces the WCDMA monitor.
Serving Cell Monitor The GSM and WCDMA technologies have separate monitors that summarize the technology status, such as serving cell and RF coverage information.
Data Monitors QualiPoc automatically displays the relevant data technology information in the following monitors when HSDPA, HSUPA, GPRS/EDGE, or Wifi technologies are in use. Note: Where available, these monitors also contain PDP context information, that is, APN, IP address 45
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
and NSAPI (only for GSM).
Cells and Coverage Monitors The Cells monitor displays the neighbor cells as well as the related RF parameters so that you can monitor reselections and handovers. QualiPoc also provides a line chart representation of the serving cell and neighbor cell signal levels. The neighbor cell data is displayed as thin lines and the serving cell data as thicker lines.
46
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Layer 3 Monitors The layer 3 trace monitor is a list monitor that displays the header information of layer 3 messages. You can disable protocol or message group items in the monitor settings. QualiPoc writes the layer 3 information to the MF independent of the filter settings. You configure QualiPoc to fully decode Layer 3 information in a pop-up window.
To close the window, double-tap the window or press the back button.
Viewing and Saving Layer 3 Messages You can view and save the contents of a Layer 3 message to a text file.
To view the contents of a Layer 3 message, touch a Layer 3 header.
To save the contents of Layer 3 message, touch and hold the screen, and then touch Save.
QualiPoc saves the file in the following location: /mnt/sdcard/QualiPoc/Layer3 messages
47
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Figure 5-6 Saving Layer 3 messages
Map Monitors This section describes the features of the outdoor and indoor map monitors.
Outdoor Map Monitor The outdoor map monitor allows you to follow the measurement path during a test. In a drive test the map monitor displays the current position, path, and the received signal strength that is traced during the test. If you enable the option, BTS information appears on the map monitor, including the base station that you are connected to.
To customize the signals that you want to trace during a test, touch the position marker. To change the map mode, touch the up arrow () at the base of the map. To center the map on your current location, touch the icon.
Offline Positioning with Open Street Map
To use Open Street Map, touch the up arrow () at the base of the map, touch Map engine, and 48
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
then touch Open Street Maps.
Saving a Selection of an Open Street Map QualiPoc allows you to select a portion of an Open Street Map and save the selection as an image file.
To download part of an map 1. Touch the up arrow () at the base of the map and ensure that your map is in online mode. 2. Touch and hold somewhere on the map. 3. On the Download map area page use the sliders to define the area and touch OK.
Exporting and Importing Open Street Map Tiles You can export an Open Street Map tile from one phone and import the tile on another phone. For more information, see the "Exporting and Importing Configuration Settings" on page 13.
Using BTS information on the Map Monitor You can load and use BTS information for different technologies in the Map monitor.
49
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
To enable BTS information on the Map monitor 1. Press Menu
, touch Settings > BTS Information.
2. Touch the type of BTS file that you want to load, for example, BTS Info File LTE, locate the file, and then touch Select. 3. Return to the map, touch the up arrow () at the base of the map, and then touch Settings
.
4. Touch BTS monitor.
Indoor Map Monitor For indoor testing, the map monitor can display a floor plan, which you can double-tap to mark your current position. QualiPoc links the positions that you mark to create a simple path. By default the color of the indoor positions reflects the current signal strength (RxLev in GSM/EDGE or RSCP in WCDMA).
To customize the tracking value, touch and hold the map. To mark your position on the map, double-tap the map. To delete a marker that you just added to a map, touch the Undo button at the top of the screen. To zoom in and zoom out of the map, use the touch capabilities of the smartphone. To navigate between waypoints, use the left and right arrows in the slide out menu at the bottom. To add a waypoint, tap the plus sign (+).
To automatically center the map on the current waypoint, tap the waypoint marker in the bottom right 50
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
of the screen
.
QualiPoc saves the positions that you mark in the measurement file. You can load these markers in the NQDI post-processing software. If you want, you can load another map during the measurement. When you reload a map, QualiPoc also reloads the previous tracking list.
IP and PCAP Logging Monitors The IP trace monitor is a list monitor that displays header information from HTTP, FTP, TCP, DNS and ICMP packages. If you want, you can disable protocol items in the monitor settings. You can also specify a text filter to customize what you see on the monitor. Touch an item on the screen to view the decoded package. QualiPoc writes the HTTP, FTP, TCP, DNS and ICMP packages to the MF independent of the filter settings.
Test and Events Monitors QualiPoc displays results in the form of KPIs and statistics. KPIs are test-dependent, for example the call setup time for a call to any number test and throughput for an HTTP transfer test. Statistics represent the number of successfully completed tests as well as average, minimum, and maximum KPI results. The Events monitor lists all most important events, for example Call States, that QualiPoc traces during the tests.
51
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
52
Chapter 5 | Using QualiPoc CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Measurement Files Post-Processing
6
QualiPoc creates and stores Measurement Files (MF) on the smartphone. You can replay and analyse the contents of these files on the smartphone with the QualiPoc replay function or on your computer with SwissQual software.
Measurement File Logging QualiPoc creates an MF when a job or idle recording starts and then stores the file on the SD CARD in the [sdcard/QualiPoc/Results] folder.
Replaying Measurements on the Phone
To replay a measurement in QualiPoc on your smartphone, press Menu and touch Replay, slide open the bottom menu, tap the folder icon, select the file that you want to replay, and then tap the Play icon.
Important: You cannot replay an *.sqz file. You can use the remaining controls to perform the following actions:
Return to previous session Advance to next session Pause the playback Step through or fast forward through the replay
While the phone is in this mode, "Replay" appears in a blue bar at the top of the screen.
To return to live mode, press Menu
and touch Live.
Transferring the Measurement Files to a PC You need to connect your phone to your PC as a storage device with a USB cable to transfer the measurement files. The procedure might vary according to the model of the phone. For more information, see the user guide for your phone.
53
Chapter 6 | Measurement Files Post-Processing CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
Replaying Measurement Files in NetQual NQView You can use NetQual NQView to replay multiple measurement files. During the playback, you can open monitors for different quality parameters to observe the progress of a test and search for points of interest in the monitors such as dropped calls, Layer 3 messages, and so on. You can also search for measurement files that contain specific parameters such as technology, operator, KPI thresholds, and RF channel numbers. NQView also allows you to export certain data in CSV, Google Earth, and MapInfo format. For more information, see the Manual – NQView.pdf document.
Analysing Measurement Data with NetQual NQDI NetQual NQDI is designed to help you to perform an in-depth analysis of your measurement data, for example, a detailed analysis of mobile network services and protocols. NQDI can quickly analyse CS and PS calls to help you to determine the main factors for network. NQDI mapping support includes more than 500 pre-defined map plot items in a powerful and fully configurable plot engine that supports MapInfo and Google Earth. This engine also supports configurable binning on grid or latitude-longitude precision. NQDI can generate reports in Excel format based on the measurement data. These reports can contain success rate and average pivot tables with PDF, CDF, and Pie charts. NQDI also has a trending sort function that can group data into time frames from one hour up to a year. In addition to the default extended set of NQDI reports, you can customize your own KPI report with the KPI report generator. For all details about NetQual NQDI please see “Manual – NQDI.pdf”.
54
Chapter 6 | Measurement Files Post-Processing CONFIDENTIAL MATERIALS
QualiPoc Android 12.1.2 Manual © 2000 - 2013 SwissQual AG
55
Chapter 6 | Measurement Files Post-Processing CONFIDENTIAL MATERIALS
