Download Keynote SIGOS Product Portfolio...
ot
e SIGO
S
20
RS
YEA
9
Ke y
n
0 19 0 89 - 2
P RO D U C T G U I D E SITE / GlobalRoamer / Professional Ser vices
www.keynote-sigos.com
Keynote SIGOS
Testing is our Competence Keynote SIGOS was
nications itself: we started with testing of
founded under the
fixed line services, expanded our intelligent
name of SIGOS back in
testing solutions towards mobile telecommu-
1989. For two decades
nications in 2G and 3G. Of course we won't
we have been sup-
stop there: we will continuously strengthen
porting the mobile
our customers’ position through providing
networks, including most
more than just basic mobile operator testing
of the World's Top Twenty operators, ensur-
services. Next generation network including
ing and improving their Quality of Service
VoIP quality testing, revenue assurance and
and helping them to both discover new
Drive Service Testing are good examples of
opportunities and launch new services. In
solutions that go beyond the verification
other words, we have helped our network
of standard services.
customers to continuously improve the experience of their own customers, driving
Today, Keynote SIGOS offers the most tho-
up customer satisfaction and retention.
rough active End-to-End Testing solutions in the market.
We are doing this through providing flagship solutions for active End-to-End Testing to
We have a clear business focus, close co-
the telecommunications industry. Since we
operation with our customer base and an
have dedicated ourselves totally to this
established and experienced team. Telecom-
speciality we always have to be top notch
munications is a relatively young business
in what we do.
but we can proudly look back on two decades of success.
The development of our product portfolio K
ey
note SI G O
also reflects the development of telecommu-
S
20
YEA
RS
1
9
89
- 2 0 09
3
Index
Keynote SIGOS Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 6
SITE Test Applications End-to-End Testing Basic Call . . . . . . . . . . . . . . . . . . . . . . . . 16 Supplementary Services . . . . . . . . . . . . . . 16
SITE TEST SYSTEM
SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
SITE Overview (Tools & Features)
MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Open System . . . . . . . . . . . . . . . . . . . . . . . 8
Mobile Instant Messaging . . . . . . . . . . . . . 20
Central Open Databases . . . . . . . . . . . . . . . 8
Digital Rights Management . . . . . . . . . . . . 21
SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . 8
Speech
Test Interfaces . . . . . . . . . . . . . . . . . . . . . . . 8
Interactive Voice Response . . . . . . . . . . . . 22
Graphical User Interface . . . . . . . . . . . . . . . . 9
Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . 24
Modularity & Scalability . . . . . . . . . . . . . . . . 9
Voice Quality . . . . . . . . . . . . . . . . . . . . . . 26
Dynamic Resource Management . . . . . . . . . . 9
Voice over IP . . . . . . . . . . . . . . . . . . . . . 28
Test Case Editor . . . . . . . . . . . . . . . . . . . . . . 10
Data
Test Case Recorder . . . . . . . . . . . . . . . . . . . . 10
GPRS IP (CS / PS) . . . . . . . . . . . . . . . . . . 29
Test Sequences & Control Structures . . . . . . . 10
BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . 30
Data Safety . . . . . . . . . . . . . . . . . . . . . . . . . 10
iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . 32
UTF-8 Character Support . . . . . . . . . . . . . . . . 10
WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Reporting & Alarming . . . . . . . . . . . . . . . . . . 11
Web Browsing, IP . . . . . . . . . . . . . . . . . . . 34
- Service Area Monitoring . . . . . . . . . . . . . . . 12
WLAN . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
- Dashboard . . . . . . . . . . . . . . . . . . . . . . . . 13
Streaming . . . . . . . . . . . . . . . . . . . . . . . . 38
- Matrix Report . . . . . . . . . . . . . . . . . . . . . . 13
Video Telephony . . . . . . . . . . . . . . . . . . . 40
SITE Network Graphic . . . . . . . . . . . . . . . . . . 14
Video Quality . . . . . . . . . . . . . . . . . . . . . . 42
SITE Network Graphic > 14 4
Messaging
Drive Service Testing > 44
> Index
SITE Test Concepts Drive Service Testing . . . . . . . . . . . . . . . . . . 44 Handset Simulation . . . . . . . . . . . . . . . . . . . 46
GlobalRoamer Outbound Roaming . . . . . . . . . . . . . . . . . . . 58
SIM Box Detection . . . . . . . . . . . . . . . . . . . . 48 Revenue Assurance . . . . . . . . . . . . . . . . . . . 50 - CDR Comparison . . . . . . . . . . . . . . . . . . . . 51 - Billing and Rating Verification . . . . . . . . . . . 52 Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Professional Services Professional Services . . . . . . . . . . . . . . . . . . 63
- Inbound Roaming (IREG) . . . . . . . . . . . . . . . 53 - Global Roaming Quality (GRQ) . . . . . . . . . . . 54 SITE Protocol Test Protocol Test . . . . . . . . . . . . . . . . . . . . . . . . 55
Customers Customers . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Core Network Testing . . . . . . . . . . . . . . . . . . 55 Layer 3 Trace . . . . . . . . . . . . . . . . . . . . . . . . 55 IN / CAMEL . . . . . . . . . . . . . . . . . . . . . . . . . 56
Customer Map > 66
Photo © T-Mobile AG
SIM Box Detection > 48
5
Keynote SIGOS > Introduction
SITE TEST SYSTEM Your Own Scalable and Highly Flexible Testing Infrastructure Whether you require a stand-alone test solution or you wish to span your testing facilities around the globe at multiple locations: from Keynote SIGOS solutions you can always expect scalability, integrity and great expertise reflected in our
the existing network infrastructure realities. Interfaces to complementary solutions, e.g. monitoring systems, are provided so that SITE can be exactly matched to your specific requirements.
solutions and professional services. With the Keynote SIGOS SITE Test System –
The SITE Test System’s architecture is completely modular. Only the modules that are needed for
comprising sophisticated hardware and software solutions – network operators are enabled to
the given tasks needs to be purchased. Our Senior Telco Experts will be happy to discuss
host and work with their own testing facilities. Key here is the ability to easily integrate into
your requirements.
GlobalRoamer Keynote SIGOS Managed Global Infrastructure and Test System For Outbound Roaming With GlobalRoamer, Keynote SIGOS offers the most extensive infrastructure for automated outbound roaming testing world-wide. We provide our customers with an extensive network of testing facilities around the globe, hosted by Keynote SIGOS. GlobalRoamer customers can use this sophisticated testing infrastructure
All that is required is a web browser and access to the internet. Simply log on with your password and set up your test schedules without worrying about a thing. However, Keynote SIGOS can also provide a fully managed roaming test service so that all that you really need to do is look at the results.
through a web based user interface.
Professional Services Solution Consulting, Managed Services and More – Flexible and Customizable
6
We at Keynote SIGOS are always there for our customers: in each phase of your testing requirements we provide you with well
For instance, with different levels of Managed Services, we can help our customers with the management, operation and administration of
experienced and specifically trained personnel, whether it be for project implementation, maintenance, managed services, training or solution consulting. All our Professional Services
tests. Our services are completely customizable and scalable: we are handling complete SITE systems for customers as well as we manage small occasional testing projects. Just as you
can be customized to your specific needs.
please.
Keynote SIGOS > Introduction
The Keynote SIGOS platform for first-class Quality of Service Today, network operators are confronted with an extremely dynamic market and the challenges of keeping up with new technology, permanent surveillance of Service Level Agreements (SLA) and reducing costs whilst maintaining customer satisfaction. To fulfil these challenges preventive and permanent testing is required. These tests can be both labour-intensive and extremely costly and for those reasons are frequently neglected.
The solution is fully automated testing with SITE: Keynote SIGOS has developed the most advanced
automated test system available on the market, providing precise and easy to use automated testing throughout the entire network.
Cost-Saving Automated Testing Avoid imprecise, time consuming and labour intensive manual tests
Surveillance Continuous and precise monitoring of service availability, quality (KQI) and performance (KPI)
Service Quality Management Precise measurement of service availability, performance and quality
Reporting Highly flexible, dynamic and automated reporting and alarming environment
Scalability From small stand-alone to network-wide distributed systems
Central SIM Multiplexing To use infinite numbers of SIM Cards at various locations
Graphical User Interface User-friendly, drag-and-drop graphical interface with rollover help text
Flexible User Access Permission based access via Internet, LAN and XML
Open Interfaces For seamless integration and combination of existing and new tools
Customising Environment Test case editor to create and adapt tests to specific customer needs
7
SITE TEST SYSTEM
SITE Overview
Open System
Central Open Databases
SITE is an open system and can be easily integrated into existing test environments. Existing equipment may be directly linked to SITE and controlled and monitored via the XML system interface. In addition, current software updates, configuration modifications or problem resolution are quickly and reliably performed by Keynote SIGOS.
To ensure maximum performance, the SITE System uses an open SQL-based database. All configuration information, test results, measurements and KPIs are stored logically, to provide a clear measurement and reporting capability. Using powerful filter functionality any database listing can be easily modified and a multi-format export function allows the sharing of data with other network support tools.
SIM Multiplexer
Central Unit
Clients
Local Units ISDN
LAN / WAN
UMTS Uu
Gb GSM
Compact Local Units
GSMA
GSM / GPRS Um
ISUP lu CS
GSM/GPRS Interfaces
UMTS Interface
lu PS supporting thousands of SIM cards serving Um, Uu and SS7-Interfaces (A, …)
SIM Multiplexing SITE can handle thousands of SIM and USIM cards in cascade-style SIM card boards. The subscriber information of a SIM card is read out by the system and transmitted via a LAN/ WAN network to any test location required. The SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central Multiplexer unit.
Test Interfaces SITE supports GSM/GPRS Um , UMTS Uu , HSDPA, HSUPA, EDGE, CDMA2000, PSTN a/b, ISDN S0, S2m, GSM A, GSM Gb, ISUP, GSM-R, WLAN, IuCS , IuPS , Ethernet, DSL, SMPP/UCP/CIMD, MM7.
SITE Test System PBX
GSM/GPRS Um UMTS Uu* CDMA2000 GSM-R EDGE HSPA*
Mobile Network
GSM A ISUP INAP SCCP MAP CAP TCAP Gb GSM IuPS IuCS
Core Network
* with possibility of Layer 3 protocol trace feature/monitoring
8
SMTP/IMAP SMPP UCP WAP via IP Ethernet CIMD WLAN
MM7 DSL MMS via IP BlackBerry
Internet
S0
S 2m
a/b
PSTN
Specific Interfaces
SITE Overview
Graphical User Interface
SITE TEST SYSTEM
The SITE User Interface enables easy system operation and administration via either the intranet or internet. The Web GUI client is used for configuration of tests and reports as well as for administrative system configuration. The system can be accessed simultaneously by various parties, each with configurable user rights. The SITE User Interface provides a user friendly, drag-and-drop environment to arrange, copy and edit test and report elements, within a directory tree and folder system. The Web enabled User Interface enables a flexible access to the system, for example, by technicians from remote locations. The XML interface is used as an integration interface to exchange input and output data with other network test or management infrastructure.
Modularity & Scalability The modularity and scalability of SITE permits optimum system adaptation to customer requirements. Portable and Stand-Alone Systems for implementation in test laboratories are just as possible as the provision of a distributed system to cover the geography of an entire live network. The modules of the SITE system are the Central Unit, SIM Multiplexer and Local Units. Local Units may be connected by permanent IP – but fast,
independent of permanent IP is just as possible. There are Wireless Local Units (WLU) and Mobile Local Units (MLU) to increase deployment flexibility. The IP connection is vital to the system and is therefore constantly monitored by SITE. The test system may be upgraded as required by new applications, functions and test interfaces.
problem oriented, deployment of local units
Dynamic Resource Management SITE can execute tests at any time desired. Via the scheduler window a single or group of tests can be defined once or periodically, based on very flexible selection criteria of date, day, time, frequency and number of repetitions. To avoid any resource conflict, an intelligent resource management system controls access to interfaces and SIM cards, assuring a smooth operation and maximum test parallelism. The selfmanagement checks system components regularly and generates an alarm (SNMP-Trap) in the event of failure. 9
SITE TEST SYSTEM
SITE Overview
Test Case Editor
DATA Safety
SITE provides large libraries of Test Cases for main network services in various formats with detailed parameter options. To create customized own Test Cases with the assembly of various test steps via a user-friendly drag-and-drop mechanism SITE
SITE redundant is a solution for reliable high availability. The main concept is the mirroring of the hard disk partition over TCP, based on the standard Linux High-Availability option. It observes the operating system, databases and processes. If a component crashes a power failure happens or anything is stopped manually, then a switchover to the second system will be initiated.
provides it’s Test Case Editor environment. Complex scenarios can be quickly built to enable the testing of new network services.
SITE Backup Solution is very important in the case of a damaged or corrupt database, SITE installation
Test Case Recorder This SITE tool allows intuitive recording of browsing actions taking handset characteristics into account. Mobile and provider specific web and WAP pages are retrieved from the network via the test probes during recording sessions to get a feel for real download behaviour and latency. Traces are shown live while the developer is browsing. The test case can be evaluated before saving the entire browsing session by replay during creation. Full feature support by the Test Case Editor makes later adaptation of recorded browsing sessions easy. It is like having full and instant remote control access to a specific handset in a remote location – with no need to travel anywhere to use it.
Test Sequences & Control Structures To mimic the typical usage, of say a mobile network customer, a test sequence feature can be used for a series of different service tests after a single Location Update. Control Structures provide logical operators like: List based ‘FOR EACH’, condition based ‘WHILE and REPEAT’, and time based ‘WAIT’ functions. These features save valuable resource time and significantly increase the testing throughput and efficiency of the system.
10
or hard disk. It is based on Arkeia’s “Enterprise Backup Solutions”. Keynote SIGOS provides this backup software with a pre-configured backup strategy for the SITE Central Unit. Special features are scheduled backups, incremental and differentiating backup, as well as tape administration.
UTF-8 Character Support The UTF-8 feature enables the full encoding for e-mail, web pages, & other places where characters are stored or streamed. SITE test cases support full encoding for SMS, WAP and MMS parameters. All parameters in the Test Case Editor can be filled with UTF-8 characters unless no specific presets are given. So an SMS text or html link can be searched and checked with UTF-8. SITE Reporting shows all possible values: conventional as well as UTF-8 entries. Benefit: Wealth of language specific characters can be supported, e.g. Latin, Greek & Coptic, Cyrillic, Armenian, Hebrew, Arabic, Syrian, Bengali, Thai, Myanmar, Georgian …
SITE Overview > Reporting and Alarming
Test Execution on different locations Online Reporting real time reporting
Test Executions
alarming
Post Reporting
Raw-Measurements (Input and Output)
Measurements Strategy / KPI design
KPI Databases
Report Definition
Reporting is fully integrated in SITE
Service Area Monitoring Dashboard Matrix Report
SITE TEST SYSTEM
Reporting and Alarming SITE Reporting enables users to create, view and forward multiple reports. These reports are generated from measurements collected in the report database. These reports can either be based on SIGOS standard Key Performance Indicators (KPIs), on KPIs according to ETSI standards or on individual customized KPIs. This report creation is by means of an easy drag-and-drop configuration functionality. SITE Reporting offers the possibility to visualize test results in various illustration tools, serving even specific presentation and monitoring needs. Flexible standard charts and diagrams as well as enhanced functionalities like “percentile”, “ad hoc reporting” and “derive to” can be immediately generated from recorded KPI data. Real time alarming is also embedded: resulting alarm notifications are automatically distributed e.g. via SMS, e-mail, SNMP, etc. to defined recipients. Users can define flexible threshold-settings, counters, severity triggering points, etc. when alarms should be generated or cleared. Reports can be illustrated in different ways, either charts in various formats; markers, bars, lines etc, or by matrix tables to provide a fast color coded overview of vital services or specific KPIs.
Your benefits Automated testing: avoid expensive and time consuming manual tests Increase reliability of the mobile network, thereby increasing ARPU Increase customer satisfaction Monitoring and measuring of service availability and quality Ensuring SLAs with precise KPIs Scalable architecture: from stand-alone to geographically distributed systems Central SIM Multiplexing No “SIM card traveling” Quick detection of problems by rapid parallel testing of all network services In addition to standard SITE reporting, many powerful reporting features are available 11
SITE Overview > Reporting Additions
SITE TEST SYSTEM
Service Area Monitoring The SITE Service Area Monitoring application is used to visualize mobile network services that target a specific Service Area. Alarms that are generated by the failure or degraded performance of services can now be linked to a specific network element within the operator’s infrastructure. This function is implemented by careful correlation between the specific elements used within a Test Case execution, and the overall network topology which has supported the Test Case scenario that generated the alarm or
Test Definitions Schedules
Test Execution System
measurement. An example could be a WAP test initiated from a wireless interface located at Latitude (x), Longitude (y). The topology for this scenario would use specific BTS/node B, BSC/RNC infrastructure, assigned to an MSC/SGSN reaching finally a specific content portal. Each network information and trace is processed to provide significant data of the actual network performance and functionality, finally combined to a total service area view.
Alarm Correlation Network/Service Topology
Report Definitions Alarm Thresholds
SITE KPI Database
Reporting/Alarming
Service Monitoring Engine Alarms
Test Execution Results (Traces)
Report/Alarm View
Service View
Drill Down #1
Drill Down #2
Service Area Monitoring is divided in two panels: SERVICE View The Service View is the GUI for Service Area Monitoring application. Users are able to see the status of network elements in the Network / Service model graphically.
12
DETAILS View The Details View offers further information for each unit in the Service View, such as: Name, Alarm Aggregation Method, Comments and Assigned Alarms.
SITE Overview > Reporting Additions
Dashboard
SITE TEST SYSTEM
This GUI system tool provides a simplified intelligent interface to SITE reporting. It is interesting especially for the people responsible for the service who want to work intuitively without any training effort. KPIs can easily be filtered and individually stored in a few clicks. Individual configurations allow additional, more customer-oriented, data analysis. Fast and easy drill down to individual traces is possible directly from the Dashboard.
Matrix Report Matrix Report environment allows the user to view Key Performance Indicator (KPI) data as a numerical value, which can be easily color coded to provide a quick, easy to understand overview of network performance. Service KPIs can therefore be displayed in a format which is especially useful for Network Management and Operations personnel.
Matrix_Single mode allows for the tracking of one Key Performance Indicator (KPI) , in relation to two other KPIs in a matrix. Alarm thresholds can easily be set to provide a distinctive color output to ensure that possible error conditions can be quickly seen and understood. In the left example, the Rx (Receive) Value is the single KPI represented, against day of the week and different interface types and their current locations.
Matrix_Multi mode, allows for a table of different KPIs as the “Y-Axis” to be configured, in relation to another KPI as the “X-Axis”. The right example displays the average results of a tested service, where three different measurement KPIs, (Success, Failure and Incomplete) have been tracked against different PLMNs. By placing the cursor above a selected cell within the Matrix, additional information can be gained regarding the displayed statistic. As with all report charts available in SITE, a “drill down” process is also available to gain access to detailed individual test data when required. 13
SITE TEST SYSTEM
SITE TEST SYSTEM
14
Various Technologies – ONE Test System: SI TE
15
SITE TEST SYSTEM
SITE Test Applications > End-to-End testing
SITE TEST SYSTEM
Why End-to-End Service Testing? In a highly competitive market, such as the telecommunications industry, providing and maintaining highest quality to end customers is key to sustainable competitive advantage. With customers having multiple options at hand, poor quality – even the occasional drop of quality – can have immediate consequences. Switching between operators never has been easier and through mobile number portability a classical barrier to switching long has fallen.
are multi-switched calls which need complex interaction with the subscriber profile. Infrastructure growth or changes require that core network configuration data between mobile to mobile and between mobile and fixed line is correctly maintained.
Given all these challenges how can you ensure top quality end user experience avoid revenue leakage
First class service quality has many influencing factors not all being under immediate control of the operator. Identification of weak points can be difficult and remain undiscovered while the effects still are being carried into the market. Often goes along hidden revenue leakage as for example through the fraudulent and undiscovered usage of SIM boxes. Safeguarding compliance of service level agreements is another example that requires active testing. Even the basic call in fact is not exactly basic: prepaid subscribers, which make the majority of most mobile network's customer base, typically involve complex intelligent network support and interaction with a ‘hot billing’ credit database. Also supplementary services like Call Forwarding, Call Waiting, Call Barring, Call Hold, CLIP/CLIR
safeguard SLA compliance The answer is “Active End-to-End Service Quality Testing and Revenue Assurance” with Keynote SIGOS.
Active End-to-End service quality testing and revenue assurance with Keynote SIGOS enables operators to identify weak points and to get in control over aspects normally out of direct reach. From slipping into the role of end customers and experiencing service quality from different angles to preventive testing, as it is required when new services are introduced. With Keynote SIGOS’ SITE Test System and its comprehensive test applications and concepts, operators always have the right tool available.
Advantages of active End-to-End Testing Customers’ View Quality of Service Quality of Service on the move Service reaction time
Defined Conditions Defined time /duration Defined data volume Defined period Exact KPI control
Revenue Assurance CDR Compare Prepaid account check Voucher booking 16
Immediate Reaction Immediate fail detection Clear alarm situation
Preventive Testing New Components Service Introduction Regression tests Roaming Tests IREG tests Outbound roaming
SITE Test Applications > SMS
SMS is the worldwide killer application for network operators. This simple network application results in a large percentage of turnover for each network operator. However, this important revenue stream also requires constant monitoring and possible improvement in quality of service. SMS, as simple as it may look, when monitored continuously, often suffers from long delivery durations, modification of content or missing text with multiple SMS messages.
SITE TEST SYSTEM
What about your Text Message Service?
Regular tests are therefore required to maintain a high standard of quality and to improve customer satisfaction.
Available SMS KPIs: SMS send duration SMS deliver duration SMS end-to-end duration
BSC
BSC
SMSC
IP
SMPP
IP
IP
UCP
CIMD
SITE Test System
Features
Photo © T-Mobile AG
Simulation of real subscriber behaviour Interfaces: GSM/GPRS Um, UMTS Uu, Iu CS, CDMA2000, GSM A, SMPP / UCP / CIMD via LAN (TCP/ IP) Central SIM Multiplexer: infinite number of SIM cards can be managed
Protocol test GSM 03.40, MO / MT Resource allocation for different users or groups Check functionality of SMSC Check SM Service functionality at peak times Transmission time KPI 17
SITE Test Applications > MMS
SITE TEST SYSTEM
Success with MMS! Multimedia Messaging Services are vital to the network operators younger and higher ARPU (Average Revenue Per User) customers. With its complex functional combination of SMS and GPRS it is easy for the service to become unavailable in a complex mobile network that is always being upgraded or optimized. In order to gain acceptance as a useful service and drive frequent use by the subscribers errors should be avoided from the beginning, as once a service does not work subscribers turn away from it. Therefore, to aquire a high reputation for Quality of Services (QoS), regular tests are essential. Test your services proactively via the automatated SITE MMS Test capability, and guarantee your subscribers a high standard of quality!
Features Simulation of real subscriber behaviour
No MM storage limitations
Interfaces: GSM / GPRS Um, GSM A, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu CS, Iu PS CDMA2000, MM7
MM to legacy handset tests User definable test messages
Detailed test reports incl. WAP WTP/WSP decoding Central SIM Multiplexer: infinite number of SIM cards can be managed Resource allocation for different users or groups 18
MO/MT transmission of multipart MMs Segmentation and reassembly supported Expandable library of MMS test messages Logging of all relevant timestamps
> MMS
MMS_MO
MMS_MO_ToEmail_Retrieval Via Mobile
Sending of an MMS message to any external numbers or e-mail address
Sending of an MMS message to an e-mail address and fetching the corresponding e-mail message via POP3/IMAP
MMS_MT Receiving MMS via corresponding WAP Page after SMS notification
MMS_MO_MT Sending and receiving of an MMS (notification and download via WTP or WHTTP protocol stack)
MMS_MO_ToLegacy Sending of an MMS to a subscriber which has no MMS capabilities configured by the network operator
Others on Request
SITE TEST SYSTEM
MMS Test Cases
Example Test Case MMS_MO_MT Orig. MMS Client M-Send
.req
.conf M-Send
Target MMS Client
Target MMS Proxy-Relay
Orig. MMS Proxy-Relay
Interactions occuring beyond MMSM are not in this document’s scope
M-Notifi
cation.i
nd
sp.ind
Re M-Notify
Time passes WSP/HT
.req TP GET
M-Retrie
ve.conf
ery.ind M-Deliv
Interactions occuring beyond MMSM are not in this document’s scope
.ind
e owledg
M-Ackn
Available MMS KPIs: GPRS attach duration PDP context activation duration
Photo © T-Mobile AG
PDP IP UP duration MMS send duration
MMS fetch duration MMS push arrival to receive MMS duration
MMS send to push arrival duration MMS end-to-end duration
MMS connection to send duration
19
SITE Test Applications
SITE TEST SYSTEM
> Mobile Instant Messaging
Can your customers chat via Mobile Instant Messaging? Instant Messaging – the real time text based communication between two or more participants – is well known on the desktop, like Skype, ICQ, MSN etc. This instant messaging (IM) has made the leap from the PC to the mobile phone connecting friends, peers, colleagues while they are on the go. To get connected to either fixed IM users or mobile IM users, Java applets installed on mobiles deliver branded user interfaces that reflect the operator-owned mobile IM community or the most popular Internet IM services. A single client gives access to multiple IM systems and can transmit and receive presence information. The clients are compliant to the Open Mobile Alliance (OMA) Instant Messaging and Presence Service (IMPS). Which also means the needed IM protocol for mobile devices is defined by the OMA.
Keynote SIGOS offers Mobile IM test cases based on OMA, optimized to customer requirements. Operators who test with SITE can get KPIs about: registration at the IM server successful login “get presence”-information of other users and whether two parties can “see” each other text message receipt from IM server successful logout from the IM server
20
SITE Test Applications > Digital Rights Management
SITE TEST SYSTEM
Make Premium Content download a premium customer experience and test your Digital Rights Management Digital Rights Management (DRM) is an important enabler for billing of premium priced content, e.g. ring tones. To cater for fast and flexible service creation the Open Mobile Alliance (OMA) defined application-level protocols and behaviors needed to provide powerful as well as reliable content download functionality. The scheme is implemented on most multi-media phones and is intended to be used by mobile content providers to control access to their products.
Digital Rights Management is a complex process. Users expect seamless procedures when downloading premium content. Ensure your customers will call their download experience a premium one. The purpose of DRM is to enable controlled purchase and usage of digital media objects. The Open Mobile Alliance (OMA) has defined Digital Rights Management specifications for the mobile world: Forward Lock (prevents the user from unlawful forwarding of protected content) Combined Delivery (combined rights object / media object)
The whole Digital Rights Management process is relatively complex and could introduce multiple risks of malfunction. At the same time, the effect of a possible error can be disastrous: unhappy customers if a fault occurs during the download and billing process of the premium priced content. With special SITE Test Cases for the verification of your Digital Rights Management you can avoid undesirable surprises for your customers and test the entire procedure according to OMA specifications. So that your customers will call their download experience a premium one.
Photo © T-Mobile AG
Separate Delivery (separated rights object + encrypted media object)
21
SITE Test Applications
SITE TEST SYSTEM
> IVR
Do your voice response services work correctly? Interactive Voice Response services (IVR) used, for example, during Voicemail access, are a common feature of everyday life. The situations in which people communicate with services such as customer care systems via IVR servers will increase continuously. Testing these systems is essential for network operators to assure the quality of their services and thus keep their customers. IVR systems are sophisticated and extremely difficult to test on a continuous and reliable basis. At present, complicated test runs in which employees must manually test IVR systems are to a large extent standard practice. Keynote SIGOS innovation has created a tool that can wholly automate this task. The IVR tester is designed so that even the most sophisticated speech menus may be recorded and recognized based on a library of voice prompts.
Features
22
Simulation of real subscriber behaviour
Voice mailbox tests
Interfaces: GSM /GPRS Um, UMTS Uu, Iu CS, CDMA2000, PSTN, ISDN So, S2m, GSM A and ISUP
Resource allocation for different users or groups
Scalable architecture: from stand-alone system to widely distributed system Detailed IVR test reports
Announcement comparison based on voice prompts Easy integration of new voice prompts DTMF and voice stimulation
Central SIM Multiplexer: infinite number of SIM cards can be managed Testing IVR trees
Customer specific extension Several languages available Language independent
> IVR
SITE TEST SYSTEM
IVR systems need to be checked in respect to: Availability of voice services Correctness of announcement The structure of the entire IVR system Available IVR KPIs Recognized prompt Recognized prompt parts examples
Keynote SIGOS IVR Test System Procedure
SITE IVR Tester
Announcement comparison with Prompt library
calling service number
recording announcement 1
SITE IVR Tester
sending DTMF/WAV
Announcement comparison with Prompt library
IVR System
SITE IVR Tester
recording announcement 2
sending DTMF/ WAV
...
IVR System
IVR System
recording announcement n
Available IVR KPIs: Call Duration Duration of played audio file Length of recognized reference prompt Duration of recognition process Recognition confidence of best recognized reference prompt Recorded audio file location Real duration of recording
23
SITE Test Applications > Push-to-Talk
SITE TEST SYSTEM
Back to the Future with Push-to-Talk The “push-to-talk” services turn mobile phones into walkie-talkies with unlimited range. Mobile users like businessmen, delivery companies and taxi drivers can connect in a “walkie-talkie-style” at the touch of a button. Push-to-Talk over Cellular (PoC) a realtime, direct, 1-to-1 and 1-to-many voice communication service is mandatory for today’s cellular networks. Companies, especially those needing to be in constant touch with several teams and locations, will soon discover PoC to be the most efficient solution. The benefit of radiostyle communication, especially broadcasting to many users, makes it much more convenient than many phone calls or even call conferencing. Be sure your Push-to-Talk service meets the high quality and reliability required.
Features
Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS, CDMA2000 Central SIM Multiplexer: infinite number of SIM cards can be managed Test 1-to-1 or 1-to-many communication Play and record speech data 24
Emulating mobiles like Nokia 5140 and similar Real End-to-End Testing of real-time-always-on voice service Check SIP (Session Initiated Protocol) Control Plane of the PoC Application Server Check RTP (Real-time Transfer Protocol) User Plane of the PoC Application Server
Photo © T-Mobile AG
Simulation of real subscriber behaviour
> Push-to-Talk
QoS testing solution for PoC: Test PoC availability Check Communication between UE and PoC server
Speech data transmission Send and receive speech data in AMR format to/from other group members
Check control plane Handling SIP sessions which are
Handling of RTCP messages
used to establish and maintain the connection between PoC-enabled handsets (Interface: UE and PoC server via UDP)
SITE TEST SYSTEM
Check user plane
Registration, authentication and authorization at PoC server Group attachment
IP Network
PoC Application Server RTP User Plane
SIP Control Plane
via Um, Uu SIP + RTP messages via
Um, Uu
Central Unit
LAN/WAN SIM Multiplexer
SITE Test System
Available PoC KPIs*: Registration Failure Ratio Registration Time
Floor Request Time [s] Stop-Talking Timer Failure Ratio [%]
Voice Delay (in session) [s] Voice Delay (first) [s]
Session Initialization Failure Ratio [%] Session Initialization Time [s]
Stop-Talking Time [s] Session Cut-off Ratio [%]
Audio Quality
Floor Request Failure Ratio [%]
Session Setup Time [s]
* Reference: ETSI/STQ_Mobile(05)06TD06
25
SITE Test Applications > Voice Quality
SITE TEST SYSTEM
Do you offer excellent Voice Quality? Voice Quality is, and will remain the major key performance indicator for each operator’s network quality. This is recognized by subscribers and operators alike. Bad voice quality generates short holding times and repeated attempts, and immediately sets a poor level of satisfaction with the user. Furthermore, international Voice Quality tests can reveal crucial quality information of different network carriers, the usage of IP routing or SIM boxes. Therefore, verification of voice quality is essential. Subjective tests, where human beings would have to score the quality of sound samples in a listening laboratory environment are expensive. Automated test methods with the intention to mimic subjective tests, allow for a cost effective and consistent alternative to subjective testing, either on a referenced or an unreferenced basis.
Referenced Voice Quality (PESQ) Unreferenced Voice Quality (3SQM)
Features Simulation of real subscriber behaviour Interfaces: GSM /GPRS Um, UMTS Uu, Iu CS, CDMA2000, VoIP, PSTN, ISDN S0, S2m, GSM A, ISUP, LAN/WLAN Central SIM Multiplexer: infinite number of SIM cards can be managed 26
Customer specific audio reference files are easy to ingrate Objective MOS Voice Quality result values from 1 -5 (bad, poor, fair, good, excellent) Many further measurements
> Voice Quality
Referenced SITE Voice Quality testing is based on the ITU-T P.862 standard via the PESQ algorithm (PESQ = Perceptual Evaluation of Speech Quality). PESQ forms the state-of-theart technique and international standard for
automated advanced perceptual voice quality analysis, comparing actual test results with an audio reference. Referenced Voice Quality Testing provides a very high level of accuracy.
A-Side play Reference Audio File
B-Side Audio File
=
SITE TEST SYSTEM
Referenced Voice Quality Testing (PESQ)
record Recorded Audio File Reference Audio File
optionally: A B A B
Call from A-Side to B-Side and perform speech quality check, by playing an audio reference file from A-Side to B-Side and check the received audio signal with its reference using the standardized PESQ algorithm. One crucial result measurement is called ‘mean opinion score’ (MOS) and the result values can be interpreted from ‘bad’ to ‘excellent’.
PESQ Algorithm
Measurements e.g.: MOS value background noise delays attenuation …
Impairment
Excellent Good Fair Poor Bad
Grade
5 4 3 2 1
Unreferenced Voice Quality Testing ( 3 SQM™)
Available Voice Quality KPIs: MOS_Lq MOS_Noise MOS_P8001 MOS_Speech Background Noise Average delay
SITE also supports the Single Sided Speech Quality Measure 3SQM™ (ITU-T P.563) for advanced nonintrusive voice quality testing. The technology behind 3SQM™ is also based on a generic perceptual approach and so is independent from the network technology being assessed. In comparison to intrusive measurement techniques, such as P.862/PESQ, 3SQM™ is based on single ended measurements. In consequence, accuracy may not be as high but measurements can be made at almost any point in the network with any real-world speech signal. 27
SITE Test Applications > VoIP
SITE TEST SYSTEM
Voice over IP With the Voice over IP testing capabilities of the SITE Test System, it is possible to perform real time end-to-end active VoIP-testing to determine the customer’s experience of the service.
Testing Voice Quality Although Voice Quality is vitally important for any type of network that routes voice traffic, the shift from dedicated circuits to the efficiency of IP based traffic, brings its own problems with regard to the end customer’s perception of performance. The possibilities for Delay, Jitter and Packet Loss over an IP based infrastructure, means the network operator must constantly check the Voice Quality metrics to ensure that problems are detected before they cause major disturbances and dissatisfac-tion to the customers. As well as ensuring that end-to-end connections can be established, maintained in a speech state for the required test period and success-fully cleared down, the quality of real sound samples needs to be checked throughout the “speech” phase of the connection.
Available VoIP KPIs: The Mean Opinion Score / Perceptual Evaluation of Speech Quality (MOS / PESQ) Delay RTP Jitter RTP Packet Loss
SITE Central Unit
This is why SITE supports voice quality testing according to the PESQ algorithm recommended in the ITU-T P.862 standard.
LAN Location 1 CLU
Location n CLU
IP
IP
PSTN / ISDN
PSTN / ISDN DSL-Router
DSL-Router
DSL-Modem
Fixed Network ISDN S0, S2m
Ethernet
IP
DSL-Modem
Fixed Network ISDN S0, S2m
IP Operator Network
28
SITE Test Applications > GPRS IP (CS / PS)
SITE TEST SYSTEM
Do you meet your subscribers’ demands with GPRS, EDGE, UMTS and HSPA Data Services? Over the air IP data services offer subscribers a highly flexible way to connect to a rich world of internet based services like Email, Instant Messaging, websites, VoIP and much more. GPRS represents the first step towards a faster access provided via EDGE, UMTS, HSPA (HSDPA / HSUPA). Whilst there are gains in flexibility the technologies need to be supervised and maintained leading to added costs and higher labor content. To increase revenue and service quality SITE offers data tests to access all available technologies via dedicated interfaces to reveal service performance and functionality problems.
Service precedence Availability and reliability Access speed and delay Throughput, RTD and idiosyncrasies And much more ...
Available data KPIs: GPRS attach duration PDP context activation duration PDP setup connect duration PDP IP UP duration CSD dial in duration CSD connect assign IP duration Download: download duration, download rate, throughput, session time
Features Simulation of real subscriber behaviour Interfaces: GPRS Um, GSM Gb, EDGE, UMTS Uu, HSDPA, HSUPA, Iu PS, CDMA2000, Ethernet IP, DSL Central SIM Multiplexer: infinite number of SIM cards can be managed Scalable architecture: from stand-alone system to widely distributed system
Pro-active testing HSDPA throughput: theoretical download maximum 7.2 Mbps; Cat. 6, 8 and 12 HSUPA throughput: theoretical upload maximum 2.0 Mbps; Cat. 3 and 5 HTTP, FTP, SMTP, WAP Measuring transfer rates Roaming aspects covered
Detailed test reports 29
SITE Test Applications > BlackBerry
SITE TEST SYSTEM
BlackBerry, your network’s sweetest fruit? BlackBerry is today’s leading wireless connectivity solution for a large number of mobile professionals like enterprise and governmental organizations worldwide. It allows users to stay connected with secure and wireless access to e-mail, corporate data, calendar and web, to easily manage all their communication and information from a single BlackBerry device whenever and wherever required. BlackBerry eliminates the hassles of dialup by moving mobile data to a “push” architecture. Especially for mobile professionals, it is vital that the network operator provides the highest levels of quality and reliability.
Features
30
Simulation of real subscriber behaviour
Check sending and receiving e-mails
Interfaces: GSM/GPRS Um, UMTS Uu, HSDPA, HSUPA, TCP/ IP Real End-to-End testing of BlackBerry ‘push’ service
Check the BlackBerry device integrated email features Using BlackBerry devices with a java application for reflector code – for sending emails
Testing carried out using a commercial BlackBerry device
Management notification and reporting
> BlackBerry
QoS testing solution for BlackBerry: SITE TEST SYSTEM
Sending a message from SITE test system to a BlackBerry device via mobile operator’s network Important: time synchronisation for time KPIs BlackBerry device receives e-mails from the SITE test system per “push” from the RIM Server and it immediately responds to the sender with a receive timestamp SITE extracts timestamp details from the e-mail and processes them to measurements which can give delivery delay or success rates in both directions
Mobile Operator’s Network
PLMN RIM Mail Server
IP Network with POP3, IMAP or SMTP Servers
BlackBerry device
RIM Server
Push 1. part of e-mail
(optional)
SITE e-mail Test Case e-mail x @ y.com
(more parts of e-mail)
e-mail a @ b.com e-mail with timestamps
SITE Test System BlackBerry device with java application for reflector code
Available BlackBerry KPIs:
Photo © T-Mobile AG
Send time Receive time Round trip time Battery level of the device Battery temperature of the device
31
SITE Test Applications > iPhone
SITE TEST SYSTEM
Up to the hype with iPhone tests For many users the iPhone and the 3G iPhone opened a new era of mobile phone interaction and services. The unique combination of multimedia contents, intuitive multi-touch display controls, accelerometer and much more created also a demand for new operator services dedicated only for a single group of subscribers. Operators around the world specify this group of iPhone users as high-tech – high potential customers with a distinctive technology and quality demand. The unique services offered for this iPhone customer base like the Visual Voice Mail Box create additional quality process demands at each network operator.
Available iPhone Visual Voicemail KPIs: duration Failure Rates
The Keynote SIGOS SITE System offers dedicated iPhone tests to simply fit into all QoS test procedures performed via SITE without any additional effort. At the same time measurements and KPIs provide clear evidence of the service availability and performance focussed on this group of high-tech – high potential customers.
Leav ear efere nce m essa ge o n the Visua l Voi ce M ailbo x Ser ver
Receive an SMS notification for a new message Read the target address from the SMS and open connectivity via APN to the Visual Voice Mailbox Server
executed every e.g. 15 minutes
32
Photo © T-Mobile AG
Download the new message from the Visual Voice Mailbox Server to the device
SITE Test Applications
What about the reliability of your WAP services? Test before your credibility breaks down! Wireless Application Protocol technology, and its correct functionality are vital to today’s mobile networks and the need to increase the amount of data usage by customers. To attract and maintain customers as data users requires that content must be interesting and up to date, which creates risk with the constant change of Portal structure and individual page format.
SITE TEST SYSTEM
> WAP
Keynote SIGOS has designed the WAP 1.x /2.0 Test Cases to prevent the drama of a protracted breakdown in operation becoming reality and to indentify unavailable pages or incorrect links, thereby reinforcing the subscriber’s existing trust and acceptance of WAP services. Available WAP KPIs: GPRS attach duration PDP context activation duration PDP setup connect duration PDP IP UP duration WAP get duration
Features Simulation of real subscriber behaviour
Testing availability of WAP portals
Interfaces: GSM / GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS, CDMA2000 Central SIM Multiplexer: infinite number of SIM cards can be managed
Resource allocation for different users or groups Request pages over WAP 1.x or WAP 2.0 WML/XHTML/CSS decoding
Scalable architecture: from stand-alone system to widely distributed system Detailed test reports
Content check Location based services Throughput measurements WTP/WSP/W-HTTP traces 33
SITE Test Applications > Web Browsing, IP
SITE TEST SYSTEM
What about mobile Internet browsing? The combination of high throughput protocols such as WLAN, EDGE and HSDPA along with the variety of today’s multifunctional, big screen handsets open many new possibilities. The network operators need to ensure that accessing the internet directly via http, https and ftp via a mobile device, provides a similar experience to the customer as their home or office fixed network internet connection. Response, accessibility, Throughput and so on are major performance indicators for monitoring the quality of service. In addition, the SITE Web Browsing test can access websites, fill in forms, receive cookies, initiate secure transactions, download contents etc. Be sure your service is at its peak in coping with today’s demands!
Features Simulation of real subscriber behaviour Interfaces: GSM /GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS, CDMA2000, WLAN, Ethernet Simulation of different browsers, e.g. Netscape, MSIE, Mozilla Firefox Central SIM Multiplexer: infinite number of SIM cards can be managed 34
Chains of user interaction on a web application, e.g. a full e-commerce session HTTP post/get request methods HTTPS (SSL) for secure transactions Cookie handling Follow links both by name or URL
> Web Browsing, IP
Testing Services SITE TEST SYSTEM
such as: Send and Check e-mail Send MMS and SMS over a Web Portal Check Cookies Limited check of HTML page content (keywords, images) HTML parsing
Example: Send MMS to a non MMS compatible mobile 1. 2. 3. 4. 5. 6.
Client (A) sends MMS to Mobile (B). (B) receives an SMS notification with a Web Link possibly with password. (B) starts a Web session by sending this Web Link (URL) to an operator Web Portal. Web Portal responses and asks (B) for his authentication. (B) sends authentication (e.g. mobile no., possibly with password). Web Portal responses with MMS.
Mobile
MMS Client (A) 1. Send MMS
Client (B)
Operators Web Portal
Web Browser
2.
Receive legacy notification per SMS Extract Web Link
Start Browser Session 3.
URL request 4.
URL response ) (with html form UMTS Uu
GSM Um
5.
Authentication 6.
(with URL response
MMS)
SITE Available Web Browsing KPIs: GPRS attach duration PDP context activation duration PDP setup connect duration PDP IP UP duration Web Browsing duration
35
SITE Test Applications
SITE TEST SYSTEM
> WLAN
Wireless LAN for mobile operators – Test the availability and services! Business at every location, direct e-mail and internet is today’s life. Due to this, the number of worldwide Wireless LAN (WLAN) access points and users is continuously growing. Many mobile network operators offer this type of convenient internet access to their customers. The existing customer SIM card is the preferred most secure solution for identification and authentication to this service.
36
Photo © T-Mobile AG
If customers discover that the service is unreliable or inconvenient to use, they will soon retreat. In a competitive market it is essential to maximize quality, reliability and usability along with the fastest possible time to market. With SITE WLAN it’s easy to test the availability, the access and the performance of hot spots in a flexible, continuous and accurate way.
> WLAN
Testing Services Search for available WLAN networks in the hot spot area Entering SSID of WLAN network Entering WEP network key Receiving IP address via DHCP Receiving DNS servers and default IP gateway from the backbone IP network
DHCP: DNS: SSID: WEP:
Payment /Billing procedures
Dynamic host configuration protocol Domain name system Service Set Id (Identifies the WLAN network to attach) Wired Equivalent Privacy (Encryption/ Security mechanism for WLAN)
SITE TEST SYSTEM
such as:
SITE Test System Architecture for WLAN with CU, CLU, GSM-Probe, SIM Multiplexer and the components of public networks like hot-spots with Internet access and public terrestrial mobile network with backbone.
SITE Central Unit
SIM Multiplexer LAN
Um, Uu PLMN Um, Uu Probe
Compact Local Unit
WLAN Probe
HotSpot WLAN
Internet Access Point
Server
Available WLAN KPIs: Number of packets sent Number of packets received round trip delay
Features Simulation of real subscriber behaviour Central SIM Multiplexer: infinite number of SIM cards can be managed Interfaces: WLAN
SSID – Network search WLAN authentication Payment /Billing Detailed test reports
WLAN 802.11 37
SITE Test Applications > Streaming
SITE TEST SYSTEM
What about your streaming applications? Today, almost every major event, e.g. sport, news or society events can be accessed via real-time multimedia streams on a mobile phone. These multimedia applications become more and more important in the wireless and mobile community. To make sure that customers can enjoy these new and exciting premium services, it is most important to guarantee an impeccable streaming service. Using the industry standard protocols RTP and RTSP the SITE system is up-to-date with the latest technology. Scheduled and continuous tests make sure that multimedia streams deliver the desired contents and the required quality even to the largest possible groups.
Features Simulation of real subscriber behaviour Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, WLAN, EDGE, Iu PS, CDMA2000 Simulation of different browsers, e.g. Mozilla Firefox, Netscape, MSIE Central SIM Multiplexer: infinite number of SIM cards can be managed 38
Parallel subsessions per stream, e.g. video and audio Send streamed multimedia over IP TCP or UDP transport protocols Measurement interval in multiple of 100 milliseconds Used industry standard RTP/RTSP
> Streaming
SITE Architecture for Streaming SITE TEST SYSTEM
Because higher bandwidth rates have become available to mobile users the use of real time multimedia applications has grown dramatically. To ensure the mobile customer enjoys a positive experience, the streaming data transfer has to be tested with SITE Streaming. For the solution an RTP/RTSP client is used to download the data (e.g. audio and video).
SIM Multiplexer
SITE Central Unit
Test Case LAN RTSP RTP Socket Interface
Compact Local Unit GSM Probe
UDP
WLAN
IP LAN/DSL/ WLAN
WLAN Probe
GPRS
WLAN Access Point
PLMN Internet
RTSP Server
RTSP / RTP RTSP (Real Time Streaming Protocol) is a client-server multimedia presentation control protocol, designed to address the needs for efficient delivery of streamed multimedia over IP networks. The actual transmission is done by the Realtime Transport Protocol (RTP).
Available Streaming KPIs: GPRS attach duration PDP context activation duration
RTSP packets loss percent video RTSP packets loss percent audio
PDP setup connect duration PDP IP UP duration
RTSP packets received video RTSP packets received audio
39
SITE Test Applications
SITE TEST SYSTEM
> Video Telephony
Do you provide reliable video telephony in 3G UMTS? High quality for Video Telephony using 3G UMTS is an absolute must, without which it is used perhaps once, and then never again by your customers! A high expectation regarding quality of service is set by the mobile UMTS subscriber, as the premium cost invoked
SITE provides the solution to easily ensure the availability of your video telephony service, and to maintain its efficiency and quality.
by use of the service will always increase customer sensitivity. Due to competitive pressure, It is mandatory for wireless service providers to increase their subscriber’s average revenue quickly by successfully launching new services such as video telephony. At the same time, they must also maintain the same stable, consistent quality their customers have come to expect. The implementation of this technology often involves complex interaction between network nodes supplied by different manufacturers, and therefore constant automated testing should be applied to check initial configurations, and then provide long term monitoring of the service.
Features
40
Simulation of real subscriber behaviour Interfaces: UMTS Uu, HSDPA, HSUPA
Usage of SITE’s standard 3G interfaces – no special hardware required
Central SIM Multiplexer: infinite number of SIM cards can be managed Real End-to-End (mobile-to-mobile) Video Telephony
Usage of standardized or customer specific video /audio sequences Usage of a market leading protocol stack
> Video Telephony
Video telephony with SITE SITE TEST SYSTEM
Video Telephony is a key service for 3G. Mobile VT is based on 3G-324M / H.324M protocol stack which is the “mobile” extension of the H.324 stack. Currently the only reliable way for VT calls is to use a 64 kbps circuit-switched connection to avoid delays as much as possible. So VT is a real high performance service for mobile networks and it is currently only possible via 3G networks.
SITE Test System
Video-coding H.263 MPEG-4
Test case
Call Control
H.324M stack
Voice Coding AMR
Test case
Multimedia Multiplexing H.223
H.324M stack
Call Control
Control Protocol H.245
3G UMTS Probe
3G UMTS Probe PLMN
Specific test case results: Detailed Error Codes from the VT stacks VT setup time Measurements for data quality (delays, drops) Trace information for advanced analysis
Available Video telephony KPIs: Video send duration Video call duration Video file size H245 setup duration A H245 setup duration B
Photo © T-Mobile AG
Audio send duration H223 setup duration A H223 setup duration B CS Bearer establish duration
41
SITE Test Applications > Video Quality
SITE TEST SYSTEM
Is your network Video Quality excellent? UMTS opens a new world of possibilities with multimedia applications. Customized infotainment like streaming video, video messaging, mobile TV and video telephony offer a unique opportunity to create a market for highly personalized and truly inimitable mobility services. For mobile customers the quality of services is decisive for acceptance; especially for motion picture based services, quality is the key factor to success. SITE delivers perceptual quality measurements to reproduce the subscriber’s quality impression mapped to the mean opinion score (MOS), similar to other quality tests. Be sure that your network’s new multimedia applications are more then just moving colour pixels.
Features Simulation of real subscriber behaviour Interfaces: UMTS Uu, HSDPA, HSUPA
Objective MOS Video Quality result values from 1 -5 (bad, poor, fair, good, excellent)
Central SIM Multiplexer: infinite number of SIM cards can be managed Customer specific video reference files are easy to integrate
Many further measurements PEVQ analysis is based on human model of visual perception
Real End-to-End Testing of real-time video services (video telephony, video streaming, video messaging) 42
> Video Quality
Send a video file from A-Side to B-Side. Perform Video Quality check by playing a video reference file from A-Side to B-Side and check the received video signals against the reference video signals using the standardized PEVQ algorithm.
One crucial result KPI is the objective ‘mean opinion score’ (MOS). The scale values can be interpreted from bad to excellent.
A-Side
play
Reference Video File
SITE TEST SYSTEM
QoS testing solution for Video Quality:
B-Side
Video File
=
record Recorded Video File Reference Video File
PEVQ Algorithm
Available KPIs e.g.: MOS value delays brightness
Photo © T-Mobile AG
contrast distortion indicators …
Impairment
Excellent Good Fair Poor Bad
Grade
5 4 3 2 1
43
SITE Test Concepts
SITE TEST SYSTEM
> Drive Service Testing
Drive Service Testing What ’s your customers ’ experience on the move? SITE solution is a powerful tool to guarantee Service Assurance and generate leading KPIs for operator networks. Quality of subscriber’s experience is not only driven by static service usage but also by service deployment on the move. Mobility truly represents subscribers’ experience in the network.
Enhanced Service Assurance: Independent view of end-to-end quality for static & moving customers Customer Experience: Reproduce customer’s experience on the move
To cover the mobility aspect SITE offers the capability to calculate KPIs for moving subscribers performing end-to-end services in addition to static subscriber probes. These mobility tests are geared for vehicles like taxis, trucks or trains. Consequently they are called SITE ‘Drive Service Tests’. Equivalent to the static Local Units SITE collects a variety of network measurements from moving subscriber probes, so-called Mobile Local Units (MLU). The information is processed to KPIs and displayed on a brightly coloured geographic map.
Geographic View: of your network quality – KPIs displayed on map
Features Autonomous System No engineer needs to be present in the vehicle
Benchmarking Comparison with quality of competitors’ networks
Easy Installation and Removal Once the MLU has been installed, no further human interaction required
Interfaces All SITE air interface probes supported Investment Protection Compatible extension to existing SITE solution securing current investment into Keynote SIGOS products
Network Optimization Troubleshooting & optimization for new technology networks 44
> Drive Service Testing
Functionality of Drive Service Testing SITE TEST SYSTEM
The Mobile Local Unit (MLU) is connected to the electronic board system of a vehicle. In case of cars the MLU is automatically started once the engine is started. Fully automated test cases, even beyond the automation grade of previous SITE System ensure that absolutely no human interaction is required after first installation in a vehicle and test case set up of an MLU. Geographic View (GIS)
GPS Position
Clients Customer’s Map Server Mobile LU in car
LAN/WAN Central Unit
Mobile LU in train
SIM Multiplexer Static LU
As no permanent IP connection between MLU and Central Unit can be guaranteed all the time, since there will be gaps in coverage, the communication is realized via an e-mail server. The MLU sends its results and receives additional administrative commands via e-mails.
Permanent IP Connection Non-Permanent IP Connection
45
SITE Test Concepts
SITE TEST SYSTEM
> Handset Simulation
Do handsets work perfectly in your mobile network? The opportunity for mobile operators to sell exciting new mobile content and handsets is enormous, but the variety of available services like MMS, Video Streaming and Web Browsing may cause problems when using different handsets. How can these new devices and services be properly tested in a cost-effective way that ultimately leads to increased revenue and customer satisfaction? We can help you with a powerful tool to test all your services, simulating the large variety of handsets in your network. – No labour intensive and high cost manual testing!
Features Simulation of real subscriber behaviour Central SIM Multiplexer: infinite number of SIM cards can be managed Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS Real End-to-End content test of available handsets on the market Validation of received contents with mobile profiles 46
Database with a large collection of mobile devices and their relevant parameters New customer or country specific handsets can easily be integrated Support of many services: e.g. WAP1.x /WML, WAP2.0 /XHTML, MMS, Video Streaming (e.g. Mobile TV)
> Handset Simulation
SITE tests specific handset characteristics against network services and device specific monitoring of pages with fixed content/ URLs. The following important content questions are validated: Color Support Check if device is capable of displaying colored images
Image Size Comparison of all downloaded images with maximum height and width of the device Content Support Check (based on HTTP/WTP accept header) if device can decode downloaded content Data Format Check if the downloaded content is valid
SIM Multiplexer
SITE TEST SYSTEM
Handsets need to be tested
MMSC
Central Unit
LAN/WAN
via UMTS Uu GSM/GPRS Um GSM Gb, HSDPA, HSUPA, EDGE
WAP Proxy/Gateway
Content Server
Local Unit
SITE Test System
SITE Test Case Recorder This recorder is an easy tool for intuitive creation of test cases e.g. WAP, Web Browsing or whatever you need. It is particularly for use in handset simulation tests. Each click on a hyperlink creates a URL download test step and a trace of all browser actions, like HTTP-GET-Requests, which are shown live whilst the developer is browsing. (See also chapter “Overview”) The trace of the recorded session is shown live during development
Your benefits
Photo © T-Mobile AG
Intuitive Recording of browsing actions => No drag ‘n’ drop anymore Support of HTML forms Easy creation & adaptation of browsing sessions SITE integrated Received page content at a glance
KPIs for each browsing action User defined measurements / KPIs can be added with SITE Test Case Editor Whole session can be ‘Replayed’ during development to evaluate the test case
47
SITE Test Concepts > SIM Box Detection
Make sure your roaming revenues are not being detoured SIM boxes have multiple negative effects on operators, roaming hub providers and customers alike, e.g.: revenue loss due to call redirection roaming calls are intercepted, redirected and terminated whilst being re-conducted via the fraudulent SIM box, creating a cost / revenue shifting along the way revenue loss due to service inaccessibility SIM boxes have the negative effect that multiple popular services, e.g. voice mailbox, may not be available. Revenue loss and unhappy customers is the consequence revenue loss through missing callbacks due to the redirection of calls none or wrong CLIs will be displayed at the recipient’s side; immediate impact is the inability to “call back” resulting in a significant loss of roaming revenue
The fraudulent usage of SIM boxes remains a big issue to various network operators around the world. The revenue leakage caused often stays unnoticed, hence no or only little action is taken.
image loss through bad QoS SIM boxes redirect calls over inadequate, highly compressed IP connections, resulting in poor voice quality. Call setup time is extended which also leads to the impression of an overall bad roaming QoS of the home network operator.
Features Reliable detection of SIM boxes Preserve the revenues you are entitled to Cost-effective concept for SIM box detection Ensure first-class end user experience through quick elimination of SIM boxes
Hight test density possible while avoiding network congestions
www.keynote-sigos.com
Photo © T-Mobile AG
SITE TEST SYSTEM
SIM Box Detection –
> SIM Box Detection
SIM Box Detection in two steps probability of SIM boxes being in operation on certain routes by identifying suspicious MSISDNs. Once SIM boxes have been identified, the operator can then block these suspicious SIMs. Trace files and additional tools provide the option to identify the actual SIM box location, allowing operators to fight back on revenue.
SITE TEST SYSTEM
SIM Box Detection is a fully implemented feature. The concept follows a very costeffective strategy: at the first step, SIM Box Detection tests generate results without the necessity to establish a speech channel. This allows a high test density without possible network congestion. These results lay the foundation for step two: narrowing down the
Situation: The A-Party at the visited country (VPMN) calls the B-party at the home country (HPMN)
Normal situation: The call is being forwarded through an international roaming network and terminated at your home network (HPMN).
OK
Visited Country (VPMN)
Network
Home Country (HPMN)
International call transfer
Network
B Subscriber
A Subscriber
Detour situation: The international call is intercepted and terminated by a SIM box located in your home country (HPMN). The call is transferred to the B-party by a SIM box, e.g. transforming the original international call into a domestic call whilst bypassing your network. not OK
Visited Country (VPMN)
Home Country (HPMN) Network
Network A Subscriber
International call transfer
Detour
SIM box
B Subscriber
49
SITE Test Concepts > Revenue Assurance
SITE TEST SYSTEM
Money makes the world go round – what happens if the networks metering, rating and billing is not correct? For all network operators Revenue Assurance is of major importance. The operator must provide fair and accurate billing to the customer and also avoid revenue leakage from services being incorrectly rated and invoiced. In most countries accuracy of metering and billing is mandatory to comply with legal regulations.
How to guarantee correct billing? Call Generation CDR Comparison Billing and Rating Verification
Today manual tests only provide inaccurate, untrustworthy and in most cases very expensive results. To ensure correct billing a precise and reliable Revenue Assurance system is essential. With SITE scheduled, continuous testing of all services provides maximum assurance that all calls are being correctly billed.
Features Simulation of real subscriber behaviour
CDR generation
Interfaces: GMS/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, CDMA2000, ISDN S0, GSM A, ISUP, INAP Scalable architecture: from stand-alone system to widely distributed system
CDR comparison Billing and Rating Invoice comparison Resource allocation for different users or groups
Central SIM Multiplexer: infinite number of SIM cards can be managed 50
Detailed test reports Revenue stream audit Covering billing aspects of outbound roaming
> Revenue Assurance – CDR Comparison
Actual Customer Usage
SITE Live Network
CDRs
Mediation Systems
CDR Postprocessing
Tariff Model
SITE TEST SYSTEM
Test Call Generation
SITE Test System
Billing Filter*
Operator CDRs
SITE CDRs
(rated/unrated) Billing Verification Rating
CDR Import*
(unrated)
CDR Import
Tariff Model* Reference CDRs Live CDRs
CDR Comparison Comparison Results
Unrated CDRs Rated CDRs * Customization required
Reports
CDR Comparison The SITE Call Detail Record (CDR) Comparison provides a mechanism to match MSC call records against SITE generated CDRs. Thus, the correctness can be verified. Discrepancies between the MSC CDR and the corresponding SITE KPIs are calculated. And tolerances of CDRpair differences can be passed or failed. Thus an independent means of minimizing Revenue
Leakage and ensuring the end customer is subject to a fair and legally compliant charging process. Scenarios such as basic call, SMS etc. are used to generate CDRs from the network elements. These standard network CDRs are handled by the operators Mediation, Rating and Billing Systems.
SITE generates and compares output data like: Time based Calls (e.g. speech)
Volume based Calls (e.g. GPRS-data)
Event based Calls (e.g. SMS)
A Number B Number Call Type
A Number B Number Call Type
A Number B Number Call Type
Begin of call for both files Difference of begin of call Call duration for both files Difference of call duration
Begin of call for both files Difference of begin of call Data Volume for both files Difference of data volume
Time stamp from both files
51
SITE Test Concepts > Revenue Assurance – Billing and Rating
SITE TEST SYSTEM
Billing and Rating Verification With the SITE Billing and Rating concept the actual price of a test case scenario dependent upon the defined customer price plan can be generated. This allows a simple comparison to be made with the actual bill generated by the network’s billing system.
the correctness or discrepancies of invoices. SITE CDR Comparison, including the price comparison, can be used to identify the CDRs that cause billing discrepancies.
With this concept there are test cases for the services like basic call, SMS, MMS, WAP and HTTP which write their own independently measured CDRs into a data table. The billing job then takes these CDRs during a specified time period, and rates them according to the pricing plan of the specific subscriber (Tariff Model). The calculated price for each Test Case is then written to the rated reference CDR table. Furthermore, the reference of the invoice total for a given period, is calculated and returned as a result of the billing job. Then the live invoice total is calculated and compared with the reference invoice. Thus SITE Invoice comparison creates measurements indicating
The screenshot shows an example of a trace
The trace of the billing job can be viewed with the SITE User Interface. This trace contains on each line the rating (price) information generated for each of the CDRs within the billing job. Other details include the Service Type and the event related time stamps. The trace also contains the invoice total for the whole billing job.
A central part of SITE Billing and Rating concept is the implementation of the price plans. A table driven Tariff Model is built to replicate the price plans and billing rules of the network operator. The tables can be easily modified later, in the case of changes to the price plan or associated rules. The billing job is defined and scheduled in the same way as normal test cases. For the parameterization of the billing job the user has to provide a subscriber number, a tariff name and a time period for which the bill shall be created.
52
The SITE Billing and Rating concept again enhances the Return on Investment (ROI) for the SITE system. Now another vitally important department, Revenue Assurance (RA), can also become a user of the SITE system to perform essential checks on the billing process.
SITE Test Concepts > Roaming – Inbound Roaming (IREG)
Today, subscribers expect all frequently used mobile services to work reliably everywhere in the world. Thus, the quality and availability of services inside and outside the home network becomes increasingly important in the battle for customers. A large list of international roaming agreements seems to be the key to success.
SITE TEST SYSTEM
What about your inbound roaming services?
However, most operators simply suffer from a lack of manpower to perform all IREG specified test sets like IR 24, 26, 27, 29, 32, 35, 50 and 60 for often well over 200 Roaming partners.
Keynote SIGOS has facilitated IREG testing to run periodically and automatically, using all your roaming partner SIM cards. All sets of IREG tests will generate an ITU-T standardized report for all your roaming partners.
The Keynote SIGOS distributed test system covers the complete network and locations, even abroad with remote test probes and virtual SIM card transfer.
Available Roaming KPIs: Roaming – IREG Barring: barring activation duration barring deactivation duration Forwarding:
forwarding activation duration forwarding deactivation duration SMS MO MT: SMS send duration SMS deliver duration SMS end-to-end duration Basic call:
call setup alert duration call establish duration
For Outbound Roaming see chapter “Global Roamer” Features Simulation of real subscriber behaviour Interfaces: GSM / GPRS Um, GSM Gb, GSM A, UMTS Uu, HSDPA, HSUPA, EDGE, lu CS, lu PS, PSTN, ISDN So Scalable architecture: from stand-alone system to widely distributed system
Detailed IREG reports Resource allocation for different users or groups Tests according: IREG 24, 26, 27, 29, 32, 35, 50, 60 from GSM MoU
Central SIM Multiplexer: infinite number of SIM cards can be managed 53
SITE Test Concepts
SITE TEST SYSTEM
> Global Roaming Quality (GRQ)
Consistency and comparability of QoS tests for Inbound and Outbound Roaming The newly defined GRQ (Global Roaming Quality) / IR.81 standards – developed by the GSMA in co-operation with selected partners like Keynote SIGOS – provides a comprehensive framework for pro-active testing, reactive monitoring and assurance of end-to-end roaming services quality.
Mobile Network Operator A Roaming QoS
Standard monitoring methods e.g. daily, monthly
Parameters
1
2
3
4
KPIa KPIb
Roaming SLA KPIc
A
Reconciliation Compare results Problem Reporting Troubleshooting Escalation
B
Mobile Network Operator B Roaming QoS
Standard monitoring methods e.g. daily, monthly
Parameters
1
2
3
4
KPIa
Both mobile network operators can monitor and test on base of standard parameters that followed a comparison of SLAs and KPIs for QoS.
Key to a global perspective on roaming quality is consistency of measurements and thus comparability between home network and visited networks, regardless of monitoring and testing methods used.
KPIb KPIc
With SITE and GlobalRoamer, Keynote SIGOS covers all specified parameters / KPIs of IREG – IR.81 for active roaming end-to-end testing. What are the GRQ Quality of Service Parameters? About 40 parameters / KPIs have been identified by defining 5 stages of service usage for Voice, Data and SMS:
Network access Service accessibility Connection establishment Connection sustainability Connection quality
As an additional service Keynote SIGOS offers special managed service packages on GlobalRoamer. With these you can introduce the standardized GSMA SLA monitoring approach without administrative or engineering effort on your part. 54
SITE Protocol Test
SITE is a flexible solution, which offers an extensive library of available test cases, that fit with the majority of services defined in the mobile network standards and popular implementations of other additional network features. These tests enable operators to test the End-to-End functionality of their network. However, it may be necessary for a network operator to examine the detailed signalling protocols that support their services, or implement a non-standard interconnection between internal network nodes or external network operators.
Core Network Testing Keynote SIGOS offers core network protocol tests on various core network interfaces in GSM, GPRS, UMTS and IN environments which are available with the SITE test system. Protocol tests are needed to analyse the network’s behaviour in detail and to reach a high degree of interoperability between networks and network components. Keynote SIGOS engineers have developed test applications on SITE and have supported various network operators and vendors with its integration tests.
ISUP INTERCONNECTION, CONFORMANCE ITU-T Q.784 & Q.788 ETSI ETS 300 356-31/32/33 Basic Calls ETSI ETS 300 356-34/35/36 Suppl. Services
GSM – A (BSSAP) for testing of MSCs
SITE TEST SYSTEM
SITE Protocol Test
GSM – Gb for testing core network components of GPRS packet domain (e.g. SGSN)
Iu CS / Iu PS over IP for testing circuit and packet switched core network components (e.g. MSC and SGSN)
Layer 3 Trace Keynote SIGOS offers 3G Layer 3 tracing which is very important for core network testing. The primary goal is to get a deeper insight into the message flow and the protocol data exchanged between mobile station and network. On most Qualcomm-based 3G probes traces of the Layer 3 (NAS) signalling messages exchanged are recorded. Keynote SIGOS supplements the 3G Layer 3 NAS tracing with selectively recorded information from Radio Resource Control (RRC) signalling messages, employing appropriate protocol filtering techniques.
SS7 for SCCP, TCAP and ISUP
IN/CAMEL TESTS for SSP and SCP on CAP or INAP
MAP HLR and VLR Test Suite, specified by Keynote SIGOS
55
SITE Protocol Testing > IN / CAMEL
SITE TEST SYSTEM
Improve your IN / CAMEL test strategy! CAMEL is the keyword for intelligent service roaming within GSM, GPRS and UMTS networks. For the differentiation of mobile market competitors the IN services play a major role. Above all, the customers demand a roaming capability that functions exactly as it would in the home environment. With most networks having a majority of Prepaid customers, and the special billing requirements and checks that must be made by the home network, the testing of CAMEL is an essential requirement for the mobile operator.
Keynote SIGOS offers you a fully automated IN / CAMEL test system for preparing your own network for Camel roaming requirements End-to-End testing with real roaming partners preparing your IN platform (SSP, SCP)
Your benefits Reduction of testing effort for IN/CAMEL tests Preparation of the own network components for inbound and outbound roaming (SCP and SSP with high quality) Simulation of the complete foreign PLMN at CAP, INAP, MAP, ISUP for inbound and outbound roaming 56
Full test system control for simulation of end-user behaviour at Um No real roaming partner’s network required Excluding protocol problems before End-to-End tests Automated re-execution for regression tests Fully automated IR.32 tests
> IN / CAMEL
The introduction of IN or CAMEL based services affects various interfaces of the network. In order to reduce the implementation risks of services, all involved components have to be tested on the related internal interfaces of the network. For this kind of core network protocol tests, the simulation of several components is necessary.
According to the network architecture Keynote SIGOS has developed test scenarios for tests on all relevant interfaces adjacent to the GSM/GPRS/ISDN core networks. These kind of tests allow the vendor or network provider to test either single network components or their own network without any real connection to other networks.
The figure below points out which interfaces and network components should be tested for introducing IN or CAMEL services.
The SITE Test System offers simulation and tests of IN/CAMEL on the interfaces UMTS Uu,
SITE TEST SYSTEM
Testing of IN/CAMEL in the UMTS-GSM-ISDN network environment
GSM/GPRS Um, ISDN S0, ISDN ISUP, GSM MAP (3), GSM A, GSM Gb, CAP and INAP.
CSE / SCP
Core network protocol tests with SITE INAP MAP
Test interfaces
HLR
CAP
CAP Fixed Network
MAP
MSC/SSP
MAP MSC/SSP
SGSN/SSP
SGSN/ SSP A or ISUP
A or ISUP
ISUP Gb
GSM A
ISUP
MAP
CAP
INAP
Gb
GSM Gb
Um
ISDN S0 a/b
Test System SITE IN/CAMEL 57
GlobalRoamer > Outbound Roaming
GlobalRoamer – the easiest way to solve your Roaming Test needs The Challenge
GlobalRoamer
Customers demand and expect a high quality and reliable service from their chosen network operator and a similar seamless experience regardless of where they are currently in the world. By introducing new technologies and services like Streaming, Video Telephony, UMTS and HSDPA, networks become more and more complex, interference-prone and increasingly complicated to administer. Permanent surveillance of roaming networks is indispensable but inevitably extremely complicated due to the lack of operational visibility of the roaming partners networks.
Test the service availability and performance for your customers when they roam to other networks
Features Centralized SIM Multiplexing technology makes your SIMs travel the world! All services can be tested (speech, data, messaging...) Web-based, secure and convenient user interface Daily e-mail reports Flexible scheduling of test campaigns (once only, periodically) 58
Daily /weekly/ monthly reporting – graphical display Automated alarming based on your threshold settings CDRs, KPIs and traces for billing and troubleshooting
> Outbound Roaming
GlobalRoamer allows you to verify that all services are available to your roaming customers worldwide. By means of the Keynote SIGOS SIM Multiplexing technology your SIMs are capable of being virtually transmitted to any of our extensive global network of remote test stations where the actual testing is performed. SIM Multiplexer
Tests can be generated on an individual immediate ad-hoc basis, or as a fully automated group of tests via the flexible test case scheduler. Sophisticated reporting facilities enable the visualization of the results, which can be generated at any required time or sent periodically via email reporting.
GlobalRoamer
The Solution
All you have to do is: Send your test SIM cards to Keynote SIGOS! Access the worldwide test network via the internet! Define and start tests and collect the results!
Benefits Increased roaming revenue due to better service availability and performance Increased Roaming Customer Satisfaction No CAPEX Reduce your mean-time-to-repair in identifying / resolving problems 24 hour testing possible Full worldwide control of Roaming tests so Roaming partners’ support is not needed
Test of new roaming services before commercial launch Complete overview of outbound Roaming performance at any time Reduced costs for manual testing
59
GlobalRoamer > Outbound Roaming
Ad-Hoc testing and pro-active monitoring in one combined solution! GlobalRoamer provides a very powerful test environment for network or service engineers: Secure web-based, ad-hoc and periodic testing environment
GlobalRoamer
Ultimate flexibility in terms of parameter setting and SIM card selection Extensive library of predefined test cases, easily adaptable Targeted troubleshooting and detailed analysis based on call traces and CDRs
SMS, MMS, WAP, GPRS, UMTS, HSPA, Voice & Video Quality, CLI
GlobalRoamer provides automated, pro-active testing of roaming services: Pro-active monitoring assures optimal service for your outbound roamers Continuous network surveillance with graphical reports Predefined management reports based on the most important KPIs Ultimate flexibility in report generation and threshold setting Tailored service view sorted by geography, operator and service Automated e-mail alarms directly to the technical engineer Automated e-mail reports
60
> Outbound Roaming
Over 250 networks can be tested today Who benefits from GlobalRoamer? There are several departments which will benefit from GlobalRoamer. Keynote SIGOS helps to solve questions!
Network operations: How to keep expected roaming services working to expectation whilst CAPEX budget is being squeezed? Core network and service engineering: How to ensure new roaming services work at launch?
Service quality: How to measure the actual experience of highest value roaming customers? Customer Care: How to troubleshoot roaming problems in real-time?
GlobalRoamer
Management: How to increase and protect highly profitable roaming revenue whilst improving quality for premium customers?
Revenue assurance: How to verify that the TAP files from roaming partners are correct?
delivery, CF to mailbox, Prepaid CAMEL, USSD call back, PLMN selection Worldwide testing Today you can already test over 250 mobile networks worldwide in more than 90 countries. Currently covered are the following countries: Afghanistan Algeria Angola Argentina Australia Austria Bahamas Bahrain Bangladesh Barbados Belarus Belgium Bermuda Bosnia and Herzegovina Brazil Brunei Bulgaria Cambodia Canada
Cape Verde Chile China Colombia Cook Islands Costa Rica Croatia Cyprus Czech Republic Denmark Dom. Republic Egypt Estonia Fiji Islands Finland France Germany Greece Hong Kong Hungary
Iceland India Indonesia Ireland Israel Italy Jamaica Japan Jordan Korea La Reunion Lebanon Lichtenstein Lithuania Luxembourg Macedonia Madagascar Malaysia Mauritania Mexico
Morocco Netherlands New Zealand Nigeria Norway Pakistan Panama Peru Philippines Poland Portugal Romania Russia Saudi Arabia Serbia Singapore Slovakia Slovenia South Africa Spain
Sri Lanka Sweden Switzerland Taiwan Tajikistan Thailand Tunisia Turkey Turkmenistan Turks and Caicos Islands UK Ukraine United Arab Emirates USA Uzbekistan Venezuela Vietnam
The GlobalRoamer deployment is ongoing with new locations added continuously. Please contact us for the current installation base! 61
GlobalRoamer > Outbound Roaming
What our customers say
GlobalRoamer
Ilse De Kee (Base Belgium) “Using GlobalRoamer, we realized that the success rate of our CAMEL calls was only around 50%! Additional to that, we then realized that another 50% of the successful tests weren’t billed! Thanks to GlobalRoamer, we could detect this and immediately take the respective actions.”
Kjartan Briem (OG Vodafone Iceland) “The chart demonstrates how we could decrease the amount of Roaming errors. This improvement was a combination of three actions: the automatic roaming testing with the GlobalRoamer service, a new international carrier connection and the ASR measurements on international links.”
62
Oct
Nov
Sep
Jul
Aug
Jun
Apr
May
Mar
Jan
Feb
Dec
Oct
Nov
Sep
Aug
Jul
Number of problems
Registered roaming problems
Gerrit Raymakers (Vodafone NL) “…The biggest profit we yield by using GlobalRoamer is the improvement of our GPRS roaming service. By testing this service on a daily basis we were able to notice disturbances prior to customer complaints being reported. Before we had GlobalRoamer, these tests had to be done manually; in other words we had to contact other operators and ask them to perform these tests. This proved to be very time-consuming and the frequency of these tests were at a much lower rate than with GlobalRoamer. […] Our experience has taught us that network changes can lead to serious roaming problems and, of course, you want to detect these as soon as possible in order that the customers are less inconvenienced. To summarize, we can say that we are enthusiastic about GlobalRoamer. It has helped us in several cases to detect network errors and because we were able to identify those errors at an early stage we were able to decrease the resolve time.”
Professional Services > Your Needs – Our Services
In the liberalized and highly innovative and fast paced telecommunications market, new products and services are introduced at very short notice. This means that complex processes have to be constantly adjusted, thus generating a need for testing and quality measurement with independent, reliable and trustworthy solutions.
Professional Services – for an error-free network!
Professional Services
Professional Services
The introduction of new services, especially in respect of being on time and budget, depends on the efficiency of testing and the availability of appropriate service quality management tools.
We at Keynote SIGOS are striving to support our customers in each and every phase of their testing requirements. Under the umbrella of “Keynote SIGOS Professional Services” we provide a focussed collection of support and consulting services. project implementation training maintenance system hosting managed services solution consulting
63
Professional Services > Your Needs – Our Services
Professional Services
During Project Implementation we assist you in determining the best possible solution for your requirements. With our expertise gained over two decades in the implementation of large-scale as well as niche projects we will help you find the optimal solution for efficient and successful project realization.
Maintenance contracts offer support through multiple channels: hotline support, on-site or remote support. Of course, maintenance of hard- and software components is included as well.
System Hosting refers to our world-wide roaming test infrastructure GlobalRoamer. Customers gain access to this extensive and comprehensive network for roaming testing and do not need to worry about a thing.
Project Implementation (SITE)
Maintenance Contract (SITE)
Hosted System (GlobalRoamer)
Training on our solutions can be provided either on site or at our headquarters in Germany, and can be supplemented by web-aided meetings. We offer training tailored to users or administrators or we develop specific training schedules according to your requirements.
With different levels of Managed Services packages we take further load off our customers’ shoulders: let Keynote SIGOS manage the operation and / or administration of your tests. This can be either on a project basis on special occasions, e. g. Olympic Games, or as part of your supply chain on a long-term basis.
Our experts are available for Solution Consulting at any stage of your project. From systems integration to project management to development of test concepts and coaching during and after project implementation. You can always rely on our expertise.
Training
Professional Services 64
Managed Services
Solution Consulting
> Your Needs – Our Services
Test Specification and Development Network Component Tests (Protocol Tests)
Engineering Services SW Development Service Development (specifications and reviews) System and Network Integration • UMTS – Network Integration and Interoperability GSM-UMTS • Interconnection (fixed, wireless)
Outsourced Test Services for: • Acceptance Tests for Networks • Type Approval Tests for Mobiles (GSM, GPRS, UMTS) • Network Launch Tests • Service Tests (GSM, GPRS, UMTS, IN, IP) • International Roaming Tests • Billing Tests (fixed, wireless network)
Professional Services
SIM Tests and Tests for SIM Toolkit Applications Service Tests (End-to-End Service) Mobile Phone Type Approval Tests (2G, 3G) TTCN Specification & Validation
Senior Consulting Services Standardisation (ETSI, ITU-T) Test Strategies Process Optimisation Network Management & Network Optimising Project Management
65
Customers
Albania
Finland
Austria
France Operator
Belgium
Europe
Operator
Operator
Germany
Bosnia Bulgaria Croatia
Operator
Hungary
Czech Rep.
Iceland
Denmark Estonia
Operator
Greece
Operator
Africa / Middle East Azerbaijan Angola
Operator
Bahrain Burkina Faso Congo Brazzaville Democratic Rep. of Congo Egypt Gabon Ghana Kenya Kuwait
North and South America Argentina
Operator
Operator
Malawi Mauritania Morocco
Canada Chile
Niger
Operator
Nigeria
Paraguay
Palestine Operator
Uruguay USA
Saudi Arabia Sierra Leone South Africa Tanzania
Customer Country
66
Tchad Tunisia
Ireland Italy Kazakhstan
Operator
Operator
Operator
Luxemburg Macedonia
Portugal
Switzerland
Romania
Turkey
Russia
UK
Serbia
Ukraine
Operator
Slovakia
Malta
Slovenia
Netherlands
Spain
Operator
Operator
Asia Pacific Afghanistan Bangladesh Cambodia China Hongkong India Indonesia Malaysia Pakistan Singapore Madagascar
Sri Lanka Taiwan
UAE Uganda
Thailand Vietnam
Operator
New Zealand Australia Operator
Zambia
67
Fon +49 (o)911 9 51 68-0 Fax +49 (0)911 9 51 68-355
[email protected] www.keynote-sigos.com
anoris. 01.2009
Keynote SIGOS GmbH Klingenhofstrasse 50d 90411 Nuremberg Germany
