4 NQDI
Short Description
Download 4 NQDI...
Description
Training By Alessandro Esposito
NQDI
20 January © SwissQual 2000-2010 CONFIDENTIAL MATERIALS
Table of Contents • Platform Overview • Database Management • Data Management • Data Analysis • Reports, Queries, KPI and Maps • System Operation – Operation – Practice Session
Confidential
CONFIDENTIAL MATERIALS
Table of Contents • Platform Overview • Database Management • Data Management • Data Analysis • Reports, Queries, KPI and Maps • System Operation – Operation – Practice Session
Confidential
CONFIDENTIAL MATERIALS
Platform Overview Agenda ->
Confidential
CONFIDENTIAL MATERIALS
Post Processing Complete Solution
Confidential
CONFIDENTIAL MATERIALS
NQDI™ NQDI ™ Highlights • • • • • • • • • • • •
NQDI™ me means Ne NetQual® Database Interface Post-processing Post-processing application based on SQL Server™ database Client / Server Architecture for Standalone as well as Enterprise configuration options Import and handling of data from all SwissQual ® platforms Filtering and data mining Inte Intell llig igen entt “dr “dril illl dow down” n” anal analys ysis is Map analysis and export KPI Statistics Historical trending Reporting Database querying / mining New external OPT Optimization module
Confidential
CONFIDENTIAL MATERIALS
Architecture • Layered structure • Different possible deployments – Standalone
NQDI Application
– (Multi) Client – Server
NQDI Database SQL Server Windows Server
Standalone
Client – Server CONFIDENTIAL MATERIALS
External tools • SQL Enterprise Manager™ (MS SQL 2008) – Managing databases – Databases backup
• SQL Query Analyzer™ (MS SQL 2008) – View tables, functions, views, procedures – Workspace for creating queries
• SQL Server Management Studio™ (MS SQL 2008) • MapInfo™ • Google Earth™ Confidential
CONFIDENTIAL MATERIALS
Enhanced Post Processing • “Horizontal” or “Vertical” approach • Horizontal – Call analysis (statistics) and trending analysis available – Rich and powerful report generation tools – Map plots and grid plots generation – Integration with Google Earth
• Vertical – Call quality – Detailed (layers 1, 2 and 3) analysis of calls or data sessions • Analysis of speech quality • Analysis of video quality (for video calls, video streaming and DVB-H) • Analysis of data tests • Analysis of messaging tests Confidential
CONFIDENTIAL MATERIALS
Database Management Agenda ->
Confidential
CONFIDENTIAL MATERIALS
Open Database Structure • The structure of the entire NQDI ® database is described in the Manual NQDI - Database structure.pdf document – Description of all the tables – Description of the relations – Descriptions of views – Description of stored procedures
Confidential
CONFIDENTIAL MATERIALS
NQDI® Database Structure 0..n
NQDI®
Tables
Configuration Tables
1
Tables Position Tables Network Information Table Audio Recordings Table Other Tables
Confidential
0..n 1
NetworkId
Position
FileId
System Tables Measurement Result
PosId
FileList
0..n
1..n Sessions
NetworkInfo
CallSession
SessionId
PosId 1
0..1
1
NetworkId
SessionId
0..1
DataSession
0..n
MNC, MCC, CId, LAC
1
PosId
0..n
SessionId
NetworkId
SessionId
0..n TestInfo 1
1
0..n
SessionId
SampleId
0..1
SampleSettingsInfo
BTSList 0..1 Msg… Msg… Msg… Msg…
TestId 1..n
CONFIDENTIAL MATERIALS
1 TestId 1..n Result…..
Basic Database Management • “sa” user must be used • Startup Auto Log In • Within NQDI – Database creation – Database deletion – Database update
• With the external tools – Database copy – Database backup – Database migration
CONFIDENTIAL MATERIALS
Exporting Databases •
Database export is also possible from within NQDI ® – Creation of historical databases • Possibility to save up to 95% disk space
CONFIDENTIAL MATERIALS
Data Management Agenda ->
Confidential
CONFIDENTIAL MATERIALS
Data Management • Import Data – Manually or automatically defining collection names – Automatically evaluate KPI and other parameters (through SQL scripts) – Possibility to define Event queries and have them run at import time
• Remove Data – Can delete data according to given collection, campaign, file or data scope – Can remove data at different levels
• Maintain data (collection names)
Confidential
CONFIDENTIAL MATERIALS
Sessions I • One session: from CONNECT command until the DISCONNECT/RELEASE – Each measurement file from QualiPoc or Diversity can contain multiple sessions • In QualiPoc there is one measurement file for each Job • In Diversity there is one measurement file for each Task – Sessions can be of different type • CALL - Voice and Video calls • DATA - GPRS, SMS, broadcast (e.g. DVB-H) • IDLE – Time between CALL or DATA sessions – Idle or Scanner Only tests Confidential
CONFIDENTIAL MATERIALS
Sessions II • Tests in multi transfer mode (e.g. Multi-RAB or DTM) involve multiple IDLE and DATA sessions – Sessions are separate but are grouped together – Can be filtered according to the transfer mode
• Sessions can contain one or more Tests – Test can be of different type • Speech, ping, FTP, video streaming, SMS send, DVB-H, etc.
Confidential
CONFIDENTIAL MATERIALS
Choosing the Data to Analyse • Data filtering / selection – – –
Save current selection Load saved selection Manage selections
• Store Data Selection Query in DB –
Used for NQWeb
• Polygon filtering –
Session not considered if not entirely within the polygon
CONFIDENTIAL MATERIALS
Available Selection Criteria •
– – – – – –
•
Campaign name Test description = Job name Task Name Session type Transfer mode Date and time
•
•
Operator – – – –
Confidential
Home or serving operator Cell Location Area Technology
Layer – GSM, GPRS or UMTS L3 messages
•
Map – Polygon regions
•
User – User comments – Alarms – Any SQL script
Device – Measurement device type – IMEI – Firmware
Call – Call status – Call type
Test – Type of test – Test results
•
•
General
•
KPI – Predefined KPI – Custom KPI – Custom events
• AND MUCH MORE!
CONFIDENTIAL MATERIALS
Cockpit View • Summary of current selection (Customize Thresholds)
CONFIDENTIAL MATERIALS
Data Analysis Agenda ->
Confidential
CONFIDENTIAL MATERIALS
Rich Session Specific Data Display • “Vertical” approach • For each different type of test all and only the appropriate or relevant tabs are displayed • Different types of calls/sessions “Test information” – – – –
Data sessions Messaging sessions Voice or Video calls Video streaming and Broadcasting sessions
• Radio information is always displayed – From the measuring device – For traced devices
• Scanner information if available • If calls fulfils the standard requirements, “Call quality” is also shown for voice calls Confidential
CONFIDENTIAL MATERIALS
Analysis Tab Overview • Session overview – Current Selection – Red – Current session and test – White – Other sessions or tests in the current selection – Gray – Other sessions or tests in the scope but not in the current selection
Confidential
CONFIDENTIAL MATERIALS
Information Organization • Information is divided into logical sub tabs • • •
Tabs shown dynamically based on the content in the selected session and test Session info Test results (Service layer) •
• •
Protocol info (IP layer) Scanning (RF layer) •
•
Separated for WCDMA and GSM
Network technology (Layer1 to Layer3) • •
•
Listening quality, FTP, HTTP, etc.
Separated for GSM, GPRS/EDGE and UMTS Separate Tab for B side, GSM (B), UMTS (B)
KPI
Voice Call (GSM) Video Streaming FTP Test Confidential
CONFIDENTIAL MATERIALS
Analysis Details • Graph manipulation • Layer 3 filtering
Confidential
CONFIDENTIAL MATERIALS
Call Status Definition • Completed – Audio connection – Correct counterpart – Intentionally terminated
• Dropped – Audio connection – Correct counterpart
• Failed – No audio connection – Wrong counterpart
• System Release – Call ended by user – Call ended because of equipment constraints Confidential
CONFIDENTIAL MATERIALS
Data Session Status Definition •
Failed – No data connection could be established • • • • •
•
Attach failed PDP context activation failed or rejected PPP authentication failed No network coverage Device hardware issue
Dropped – Data connection established – Connection ended before the end of the defined test session • Network forces a PDP deactivation • Network coverage lost • Device hardware issue (i.e. reboot)
•
Completed – Data connection established – PDP context deactivation (e.g. disconnect) driven by test session
•
System Release – Call ended by user – Call ended because of equipment constraint
Confidential
CONFIDENTIAL MATERIALS
Listening Quality Analysis •
• • • • • • • • • •
SQuad LQ MOS (Narrow and/or Wideband) P.852 MOS (optional) Quality Cause code Signal and Noise levels, SNR Delay Clipping Speech Activity Gain DC offset Frequency shift Clip replay
CONFIDENTIAL MATERIALS
Data Analysis – TCP/IP • • • • • • • •
Timestamps Protocols IP addresses Port numbers Header info IP throughput Packet count Packet sequence
CONFIDENTIAL MATERIALS
Data Analysis – FTP
•
FTP operation
•
File name
•
Throughput
•
Transfered bytes
•
MCC-MNC
CONFIDENTIAL MATERIALS
Video Streaming Analysis • • • • • • • • • • •
•
Video MOS Quality Cause code Frame rate Freezing Matched frames Blurring Blockiness Jerkiness PSNR Lip Sync Player and Protocol Clip replay
CONFIDENTIAL MATERIALS
Analysis Streaming – Media layer
•
Media Codec
•
Protocol analysis
•
Frame-by-Frame analysis
•
Codec parameters
•
Content parameters
•
Frame type display
•
IP throughput
Confidential
CONFIDENTIAL MATERIALS
GSM Scanner Analysis • • • • • • • •
Channel Overview Serving and Neighbour channels Best server Hot channels RxLev, BSIC, C/I Operator filtering Markers Optional CGI decode and multiple BSIC
CONFIDENTIAL MATERIALS
WCDMA Scanner Analysis
•
• • • •
Channel Spectrum (LX only) Top CPICH SC RSCP and Ec/No PSCH and SSCH Ec/No Delay Spread
CONFIDENTIAL MATERIALS
CDMA Scanner Analysis
• SC • Ec/No, RSCP • Best CPICH
CONFIDENTIAL MATERIALS
GSM Network Analysis
• • • • • • • • • • • •
GSM radio RF BCCH and TCH ARFCN RxLev, RxQual, FER, C/I Codec type and rate HSN, MAIO DTX, TxPwr, TA, RLT Measurement report Serving Cell Layer 3 message decode Markers Home and Serving operator Cell-Id and LAC
CONFIDENTIAL MATERIALS
GPRS/EDGE Network Analysis
• • • • • • • • • • •
SNCDP, LLC, RLC info TBF state Coding Scheme TS allocation EDGE BEP Info RLC and LLC throughput RLC BLER TxPwr, BLER, target SIR MAC info GMM and SM Signalling plane CS and TS allocation statistics
CONFIDENTIAL MATERIALS
UMTS Network Analysis
• • • • • • • • • • • • •
WCDMA radio RF IRAT neighbor list UARFCN RRC State RSSI, RSCP, Ec/Io TxPwr, BLER, target SIR Active, Monitor, Detected set Spreading Factor Power Control info RRC and NAS signalling decode Markers Home and Serving operator CellId and LAC
CONFIDENTIAL MATERIALS
Analysis - HSDPA
• • •
• • • • • •
SSCH Scheduling SSCH Allocation Throughputs: Requested, Scheduled, HS-DSCH, MAC-HS UE Category CQI ACK, NACK status HARQ Statistics HS-DSCH Modulation RLC and MAC layer allocation
Confidential
CONFIDENTIAL MATERIALS
Analysis - HSUPA
• • • •
• •
• • •
HSUPA(EUL) Status indication Radio Link Set presentation E-DCH and MAC-e configuration E-DCH Scheduling and Reporting information HARQ Statistics Throughputs: Requested, Scheduled, E-DCH, MAC-E Serving Grant Absolute Grant Relative Grant
Confidential
CONFIDENTIAL MATERIALS
CDMA Network Analysis
•
• •
• •
• •
RLP Throughput Monitor Rx/Tx Vocoder Rate Active, Candidate and Neighbor Set Finger Monitor Layer3 signalling Power Control Info IS-95/IS-2000 MUX Statistics
CONFIDENTIAL MATERIALS
Reports, Queries, KPI and Maps Agenda ->
Confidential
CONFIDENTIAL MATERIALS
Reports • “Horizontal” approach • Wide set of predefined reports and KPI reports • Custom KPI reports – Possibility to generate Trending Analysis
• Custom reports – Multi step process – Advanced functionality – Requires SQL query language, Excel Macro and Pivot Table knowledge
• Custom SQL scripts – For any kind of database data manipulation – Can be set to run during import process CONFIDENTIAL MATERIALS
Map Plot Selection • Map Tab to see Map Plots • Values to plot ordered in a tree structure – GSM Mobile • Mobile Layer 1 Measurements – RxQualFull
• Grids or Points can be used • Favorites Plots can be stored as well –
Needed to include Maps in Reports
CONFIDENTIAL MATERIALS
Map window Plot types • Point plot – Plot values as stored in the database point by point • Best for smaller areas • Needed for detailed analysis • Warning! Huge data sets can take long time to plot
– Radial map plot
• Grid plot – Plot values averaged over grid squares • Best for overview plots over large areas Confidential
CONFIDENTIAL MATERIALS
Map Plot Configurator
•
Predefined shade
•
Customizable shade per value
•
User defined map plots
•
KPI map plot wizard
Confidential
CONFIDENTIAL MATERIALS
Reports including pictures •
Option to add pictures from Favorite Map plots in a report (new sheet for every map w indow)
•
Where: C o n f i g u r a t i o n – R e p o r t C o n f i g u r a t o r
Confidential
CONFIDENTIAL MATERIALS
Export to Google Earth •
Display collected data on satellite maps from Google Earth – Provides 3D views (compared to the standard 2D views of MapInfo – Photo realistic maps offer more details and more information to troubleshoot network issues • I.e. those related to specific geographical circumstances
• Any value can be plotted onto the integrated MapInfo map or exported to Google Earth – Possibility to store the representation in a Google Earth file format (.kmz) – Requires Google Earth installed on the client – Requires the client to have Internet access
Confidential
CONFIDENTIAL MATERIALS
System Operation – Practice Session Agenda ->
Confidential
CONFIDENTIAL MATERIALS
Let’s do it! • • • • •
Create a new database Import some measurement files into the database Explore the Selection tabs and make different selections Test the Cockpit View Select all sessions where HandOverFromUTRANCommand-GSM message was received • Analysis – – – –
•
Open different type of session and tests Study the different sub tabs Drag and drop values to show them on the charts Expand Layer 3 messages
Reports generation – Select all the available sessions – Create some QualiPoc specific report
•
Define and generate a custom KPI report
Confidential
CONFIDENTIAL MATERIALS
View more...
Comments
