Troubleshooting LTE RAN NOKIA
Short Description
Troubleshooting LTE RAN NOKIA...
Description
Nokia Networks
LTE Radio Access, Rel. RL70, Operating Documentation, Issue 02, Documentation Change Delivery 4 Troubleshooting LTE RAN DN09185928 Issue 02 Approval Date 2015-09-15
Troubleshooting LTE RAN
The information in this document applies solely to the hardware/software product (“Product”) specified herein, and only as specified herein. This document is intended for use by Nokia Solutions and Networks' customers (“You”) only, and it may not be used except for the purposes defined in the agreement between You and Nokia Solutions and Networks (“Agreement”) under which this document is distributed. No part of this document may be used, copied, reproduced, modified or transmitted in any form or means without the prior written permission of Nokia Solutions and Networks. If you have not entered into an Agreement applicable to the Product, or if that Agreement has expired or has been terminated, You may not use this document in any manner and You are obliged to return it to Nokia Solutions and Networks and destroy or delete any copies thereof. The document has been prepared to be used by professional and properly trained personnel, and You assume full responsibility when using it. Nokia Solutions and Networks welcome Your comments as part of the process of continuous development and improvement of the documentation. This document and its contents are provided as a convenience to You. Any information or statements concerning the suitability, capacity, fitness for purpose or performance of the Product are given solely on an “as is” and “as available” basis in this document, and Nokia Solutions and Networks reserves the right to change any such information and statements without notice. Nokia Solutions and Networks has made all reasonable efforts to ensure that the content of this document is adequate and free of material errors and omissions, and Nokia Solutions and Networks will correct errors that You identify in this document. But, Nokia Solutions and Networks' total liability for any errors in the document is strictly limited to the correction of such error(s). Nokia Solutions and Networks does not warrant that the use of the software in the Product will be uninterrupted or error-free. NO WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY OF AVAILABILITY, ACCURACY, RELIABILITY, TITLE, NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, IS MADE IN RELATION TO THE CONTENT OF THIS DOCUMENT. IN NO EVENT WILL NOKIA SOLUTIONS AND NETWORKS BE LIABLE FOR ANY DAMAGES, INCLUDING BUT NOT LIMITED TO SPECIAL, DIRECT, INDIRECT, INCIDENTAL OR CONSEQUENTIAL OR ANY LOSSES, SUCH AS BUT NOT LIMITED TO LOSS OF PROFIT, REVENUE, BUSINESS INTERRUPTION, BUSINESS OPPORTUNITY OR DATA THAT MAY ARISE FROM THE USE OF THIS DOCUMENT OR THE INFORMATION IN IT, EVEN IN THE CASE OF ERRORS IN OR OMISSIONS FROM THIS DOCUMENT OR ITS CONTENT. This document is Nokia Solutions and Networks’ proprietary and confidential information, which may not be distributed or disclosed to any third parties without the prior written consent of Nokia Solutions and Networks. Nokia is a registered trademark of Nokia Corporation. Other product names mentioned in this document may be trademarks of their respective owners, and they are mentioned for identification purposes only. Copyright © 2015 Nokia Solutions and Networks. All rights reserved.
f
Important Notice on Product Safety This product may present safety risks due to laser, electricity, heat, and other sources of danger. Only trained and qualified personnel may install, operate, maintain or otherwise handle this product and only after having carefully read the safety information applicable to this product. The safety information is provided in the Safety Information section in the “Legal, Safety and Environmental Information” part of this document or documentation set.
Nokia Solutions and Networks is continually striving to reduce the adverse environmental effects of its products and services. We would like to encourage you as our customers and users to join us in working towards a cleaner, safer environment. Please recycle product packaging and follow the recommendations for power use and proper disposal of our products and their components. If you should have questions regarding our Environmental Policy or any of the environmental services we offer, please contact us at Nokia Solutions and Networks for any additional information.
2
DN09185928
Issue: 02
Troubleshooting LTE RAN
Table of Contents This document has 94 pages
Summary of changes..................................................................... 9
1
LTE troubleshooting methodology................................................10
2 2.1 2.1.1 2.1.2 2.1.3 2.1.4 2.1.5 2.1.5.1 2.1.5.2 2.1.5.2.1 2.1.5.2.2 2.1.5.2.3 2.1.5.2.4 2.1.5.2.5 2.1.5.3 2.1.5.4 2.1.5.5 2.2 2.2.1 2.2.2 2.2.3 2.2.3.1
Monitoring LTE RAN.....................................................................11 Hardware and software monitoring...............................................11 Handling faults and alarms .......................................................... 11 Troubleshooting faults and alarms............................................... 12 Viewing alarms in BTS Site Manager...........................................12 Alarm monitoring in NetAct.......................................................... 13 LED indications............................................................................ 14 LEDs of the Flexi Multiradio System Module (FSME).................. 14 LEDs of the Flexi Multiradio 10 BTS............................................ 15 LEDs of the Flexi Multiradio 10 System Module (FSMF)............. 15 LEDs of the Flexi Multiradio 10 System Module (FSIH)...............17 LEDs of the capacity extension sub-module (FBBA)................... 18 LEDs of the capacity extension sub-module (FBBC)................... 20 LEDs of the capacity extension sub-module (FBIH).................... 21 LEDs of the transmission sub-module......................................... 21 LEDs of the Flexi Zone Micro/Pico BTS.......................................22 LEDs of the Flexi Zone Controller................................................ 26 Performance monitoring...............................................................27 Viewing counters in BTS Site Manager........................................28 Performance monitoring in NetAct............................................... 29 Network monitoring using Traffica................................................30 Traffica general use case for LTE troubleshooting....................... 30
3 3.1 3.1.1 3.1.2
Collecting and analyzing troubleshooting data.............................32 eNB snapshot...............................................................................32 eNB snapshot content..................................................................32 Saving a Flexi Multiradio BTS LTE snapshot file for troubleshooting purposes.............................................................33 LTE1099: Event-triggered symptom data collection and provisioning ................................................................................. 34 Collecting eNB logs using the LTE1099: Event-triggered symptom data collection and provisioning feature.......................................34 LTE1909: BTS Diagnostics Toolkit............................................... 35 Triggering snapshot collection using LTE1909: BTS Diagnosis Toolkit........................................................................................... 36 Cell trace...................................................................................... 36 Trace features.............................................................................. 37 LTE163: Subscriber and Equipment Trace.................................. 37 LTE433: Cell Trace.......................................................................38
3.1.3 3.1.3.1 3.1.4 3.1.4.1 3.2 3.2.1 3.2.1.1 3.2.1.2
Issue: 02
DN09185928
3
Troubleshooting LTE RAN
3.2.1.3 3.2.1.4 3.2.1.5 3.2.1.6 3.2.1.7 3.2.1.8
3.3.2 3.4 3.5
LTE459: LTE Timing Advance Evaluation.................................... 38 LTE644: Configurable cell trace content...................................... 38 LTE162: Cell Trace with IMSI.......................................................38 LTE953: MDT (Minimization of Drive Test)...................................38 LTE1340: Trace-based Real Time Monitoring..............................39 LTE1457: Cell trace Configuration via Configuration Management. 39 LTE1687: Basic Layer3 Data Analyzer (L3DA) for LTE................39 Cell trace content......................................................................... 39 Activating cell trace in BTS Site Manager.................................... 40 Viewing and analyzing cell trace data using L3DA...................... 41 Tracing with NetAct...................................................................... 43 IP traffic capturing........................................................................ 43 Monitoring IP traffic using the LTE1460: Local and Remote IP Traffic Capturing feature...............................................................44 Analyzing IP capture files with Wireshark.................................... 45 Sending troubleshooting data to technical support...................... 47 Problems and use cases..............................................................48
4 4.1 4.1.1 4.1.1.1 4.1.1.2 4.1.1.2.1 4.1.1.2.2
LTE troubleshooting use cases.................................................... 51 BTS Site Manager connection problems......................................51 Accessing eNB using BTS Site Manager.....................................51 Problems with BTS Site Manager connectivity to the eNB.......... 51 Checking the PC firewall settings in Windows............................. 52 Checking PC firewall settings in Windows XP Professional.........53 Checking the PC firewall settings in Windows Vista/Windows 7...... 54 Remote connectivity via transport backhaul (m-plane)................ 55 Remote connectivity over Bluetooth (FZM only).......................... 56 Local connection problems.......................................................... 60 Local connectivity via local maintenance port.............................. 61 Cannot ping modules through LMP port...................................... 61 Changing BTS Site Manager local account................................. 62 Configuring Exceed for BTS Site Manager launching..................62 Access to the Linux shell..............................................................63 GPS maintenance access not possible through remote connection ..................................................................................................... 64 Software download/activation problems.......................................65 Incompatible BTS software version .............................................65 Software update to BTS site fails................................................. 66 Software version mismatch.......................................................... 67 Problems with local software download from BTS Site Manager..... 67 (Re)commissioning problems.......................................................70 Checking the BTS commissioning file..........................................70 Cannot save commissioning file or send parameters.................. 70 Verification of normal eNB site operation..................................... 71
3.2.1.9 3.2.2 3.2.3 3.2.4 3.2.5 3.3 3.3.1
4.1.1.3 4.1.1.4 4.1.1.5 4.1.1.5.1 4.1.1.5.2 4.1.2 4.1.3 4.1.4 4.1.5 4.2 4.2.1 4.2.2 4.2.3 4.2.4 4.3 4.3.1 4.3.2 4.3.3
4
DN09185928
Issue: 02
Troubleshooting LTE RAN
4.4 4.4.1 4.4.2 4.4.3 4.5 4.6 4.7 4.8 4.8.1 4.8.2 4.9 4.9.1 4.10 4.10.1 4.10.2 4.10.2.1 4.10.2.2 4.10.2.3 4.10.3 4.10.4 4.10.5 4.10.6
Issue: 02
Synchronization problems............................................................73 GPS Synchronization................................................................... 73 Timing Over Packet (IEEE.1588) Synchronization.......................73 Fallback solution for phase synchronization................................ 74 Cell does not come on air............................................................ 75 Sleeping cell.................................................................................76 eNB in a reset loop.......................................................................77 Troubleshooting call processing problems .................................. 77 High RRC Setup failure rate/RACH problems..............................78 RAB setup problems.................................................................... 79 Antenna line device problems...................................................... 80 Checking antenna line and MHA .................................................80 Troubleshooting hardware problems............................................81 Performing routine maintenance tasks.........................................81 Troubleshooting Flexi transmission module................................. 85 BTS reset required....................................................................... 85 Dead Peer detected..................................................................... 85 Ethernet interface is not working..................................................86 Identification of faulty units...........................................................87 Identification of faulty FZM unit.................................................... 91 Problems in connectivity between BTS modules......................... 91 FZM Recovery..............................................................................92
DN09185928
5
Troubleshooting LTE RAN
List of Figures
6
Figure 1
LTE troubleshooting methodology...................................................... 10
Figure 2
Faults view in BTS Site Manager....................................................... 13
Figure 3
System Module LED positions............................................................14
Figure 4
LEDs of the Flexi Multiradio 10 System Module (FSMF)....................17
Figure 5
LEDs of the Flexi Multiradio 10 System Module (FSIH)..................... 18
Figure 6
LEDs of the capacity extension sub-module (FBBA)..........................19
Figure 7
LEDs of the capacity extension sub-module (FBBC)......................... 20
Figure 8
LEDs of the capacity extension sub-module (FBIH)...........................21
Figure 9
LEDs of pico eNB............................................................................... 23
Figure 10
Front panel of the Flexi Zone Controller module ............................... 26
Figure 11
Performance monitoring data useful for troubleshooting....................27
Figure 12
Measurement configuration in BTS Site Manager..............................28
Figure 13
Viewing counters in BTS Site Manager.............................................. 29
Figure 14
Defining symptom data trigger list...................................................... 34
Figure 15
Selecting triggers for eNB snapshot collection................................... 36
Figure 16
Local and Remote IP Traffic Capturing Service window.....................44
Figure 17
IP capture file in Wireshark.................................................................46
Figure 18
Expert Info view in Wireshark............................................................. 46
Figure 19
Disabling Windows Firewall in Windows XP Professional..................54
Figure 20
BTS Site Manager log-in screen.........................................................56
Figure 21
Legacy pairing settings.......................................................................57
Figure 22
Select manual pairing option.............................................................. 58
Figure 23
Enter the legacy pairing code............................................................. 59
Figure 24
Successful pairing ............................................................................. 59
Figure 25
Establishing PAN connection..............................................................60
Figure 26
Local connectivity log-in screen..........................................................61
Figure 27
Enabling the SSH service for Linux shell access............................... 64
Figure 28
Software update failed........................................................................68
Figure 29
Software update report....................................................................... 69
Figure 30
BTS statuses in BTS Site Manager.................................................... 72
Figure 31
IP Connectivity Test in BTS SM..........................................................72
Figure 32
IP Connectivity test result................................................................... 72
Figure 33
Example ToP configuration.................................................................74
Figure 34
LMP IP plug installed..........................................................................82
Figure 35
LMP port IP cap not reinstalled after maintenance.............................82
Figure 36
Connector IP boot correctly installed firmly in place...........................83
Figure 37
Connector IP boot incorrectly installed (IP seals not firmly in place on any edge)............................................................................................83
Figure 38
Connector IP boot incorrectly installed (not pushed all the way in).... 84
DN09185928
Issue: 02
Troubleshooting LTE RAN
Issue: 02
Figure 39
Cable installed without IP boot........................................................... 84
Figure 40
Flexi Multiradio BTS LTE construction, stacked installation............... 90
Figure 41
Fan mapping in Flexi Multiradio BTS LTE.......................................... 90
Figure 42
Reset button in the BTS Hardware tab ..............................................93
DN09185928
7
Troubleshooting LTE RAN
List of Tables
8
Table 1
System Module LEDs (from left to right).............................................14
Table 2
LEDs of the Flexi Multiradio 10 System Module (FSMF)....................15
Table 3
LEDs of the Flexi Multiradio 10 System Module (FSIH)..................... 17
Table 4
LEDs of the capacity extension sub-module (FBBA) .........................18
Table 5
LEDs of the capacity extension sub-module (FBBC)......................... 20
Table 6
LEDs of the capacity extension sub-module (FBIH)...........................21
Table 7
Transmission sub-module LED indications.........................................22
Table 8
FZM and FZP LED indications........................................................... 23
Table 9
Flexi Zone Pico Wi-Fi LED states.......................................................25
Table 10
Description of front panel indicator LEDs in a BCN module............... 26
Table 11
Features related to eNB snapshot......................................................32
Table 12
Trace features.....................................................................................37
Table 13
Nokia Case Types.............................................................................. 47
Table 14
Nokia Problem Priorities..................................................................... 48
Table 15
LTE use cases.................................................................................... 48
Table 16
Explanation of NetAct Diagnostic Info values.....................................87
Table 17
Explanation of NetAct Diagnostic Info values.....................................89
Table 18
Explanation of NetAct Diagnostic Info values.....................................89
DN09185928
Issue: 02
Troubleshooting LTE RAN
Summary of changes
Summary of changes Changes between issues 01 (2014-11-21, RL70) and 02 (2015-09-15, RL70) The Fallback solution for phase synchronizationsection was added. Issue 01 (2014-11-21, RL70) This is the first issue of the document.
Issue: 02
DN09185928
9
LTE troubleshooting methodology
Troubleshooting LTE RAN
1 LTE troubleshooting methodology Figure 1: LTE troubleshooting methodology presents a general example of the procedures performed and tools used by the troubleshooting personnel. Figure 1
LTE troubleshooting methodology
TROUBLESHOOTING!PROCEDURES MONITORING
• ALARMS • KPIs/!COUNTERS • NETACT • TRAFFICA
COLLECTING DATA • eNB!SNAPSHOT • CELL!TRACE • IP!TRAFFIC CAPTURE
ANALYZING DATA • NETACT • TRAFFICA • PROTOCOL ANALYZER
FINDING ROOT!CAUSE • DATA!CORRELATION • USE!CASES • RECOVERY PROCEDURES
TROUBLESHOOTING!TOOLS The LTE troubleshooting methodology consists of the following procedures: • • •
Monitoring Collecting and analyzing data Finding root cause (with the help of use cases)
The order of actions and the selection of tools might vary depending on the use case and operator preferences. It depends on the nature of a problem if the root cause analysis is performed by the operator (for example, site configuration-related problems) or by Nokia Services (for example, defects inside a product). If it is not possible to find the root cause of the problems, Nokia Services should be contacted.
10
DN09185928
Issue: 02
Troubleshooting LTE RAN
Monitoring LTE RAN
2 Monitoring LTE RAN Monitoring of LTE RAN network allows the operator to notice potential problems and unwanted behaviors. Network monitoring consists of: • •
hardware and software monitoring (using faults and alarms) performance monitoring (using key performance indicators and counters)
Particular eNB sites can be monitored using the BTS Site Manager. NetAct and Traffica applications allows the operator to monitor the whole LTE RAN network.
2.1 Hardware and software monitoring This section explains how to monitor hardware and software using faults, alarms, and LED indications.
2.1.1 Handling faults and alarms Issues with software or hardware are signalled via fault messages, which in turn raise alarms. Fault messages come either from hardware devices or software components. The faults are system-specific or hardware-specific. The Fault Diagnosis System creates upper network alarms, which are based on an analysis of the faults, and sends them to the BTS Site Manager and iOMS/NetAct. The eNB alarm handling is based on the information of a unit or module state. It prevents sending unnecessary alarms by checking and updating the unit states. The eNB is able to maintain alarm handling after it has been commissioned and is in a configured state. During the start-up, the eNB waits for the real-time clock from the Network Time Protocol (NTP) server, and the fault diagnosis starts after the time has been set, or a time-out has been detected. If the eNB is unable to set the time using the NTP server, the default time (1.1.2004) is used. eNB transmission alarms The eNB transmission alarms (alarm ID 7665) are reported towards iOMS or NetAct. The transmission equipment uses the base station interface. Therefore, the retrieval of alarm information is mapped (using the fault ID) either in the iOMS or in the NetAct to distinguish between the alarms. Troubleshooting faults and alarms Faults and alarms are signaled in several ways: • •
Issue: 02
in BTS Site Manager in iOMS/NetAct
DN09185928
11
Monitoring LTE RAN
Troubleshooting LTE RAN
•
using LEDs
When starting to solve a problem, first refer to the instructions given in individual alarm descriptions. See the fields 'Fault source' and 'Instructions' in the alarm description. Many problems can be caused by commissioning mistakes, incorrect cabling, or wrong module installation.
2.1.2 Troubleshooting faults and alarms The following procedure is an overview of faults and alarms troubleshooting methodology. Symptoms Fault or alarms is detected. Recovery procedure Follow these instructions to check the BTS faults and LED states.
Procedure 1
Check the faults with OMS Fault Management. a) Start the Fault Management application. b) Check the active faults from the Active Alarms tab. c) Additionally fault history can be checked from the Alarm History tab.
2
Establish a connection to the BTS using BTS Site Manager and read alarm information. For more information see Viewing alarms in BTS Site Manager.
3
Check the unit states signalized by LEDs. Ensure that BTS Site Manager HW view corresponds with the actual BTS HW configuration. If there is a mismatch or grey units, check the SW level and unit states. For instructions, see Checking BTS SW versions and SW download. For descriptions on module LED states see LED indications.
2.1.3 Viewing alarms in BTS Site Manager BTS Site Manager displays the current alarm information, and the following procedure explains how to access this information. Alarm history is also included in the eNB snapshot.
12
DN09185928
Issue: 02
Troubleshooting LTE RAN
Monitoring LTE RAN
Procedure 1
Check the Faults view in BTS Site Manager (in the BTS Hardware tab). Figure 2
Faults view in BTS Site Manager
B 2
A
Click Show Source to find out which component is responsible for the alarm. Show Source is marked as element A in Figure 2: Faults view in BTS Site Manager. Clicking this button will highlight the faulty unit or open a configuration window where the error occurs.
3
To display the alarm description, click the question mark icon. The question mark icon is marked as element B in Figure 2: Faults view in BTS Site Manager. Clicking this button will open an online help window with detailed information about the fault.
2.1.4 Alarm monitoring in NetAct The NetAct Monitor application allows the user to view and process alarm information. For information on available tools and functions, refer to NetAct operating documentation: • •
Issue: 02
Fault Management Overview and Operations Fault Management Helps
DN09185928
13
Monitoring LTE RAN
Troubleshooting LTE RAN
2.1.5 LED indications Most hardware components have tricolor LEDs on the front panel to indicate the operational status and fault conditions. It is recommended that you read the information on the LED indications carefully. A blinking red LED does not always require removing of the module.
2.1.5.1
LEDs of the Flexi Multiradio System Module (FSME) See figure below for the FSME System Module LEDs location. Figure 3
System Module LED positions
The LED indications are listed and explained in table below. Table 1
System Module LEDs (from left to right)
LED
Color
FPFB status (one LED for internal and each external power output)
•
Yellow: Stand-by, output disabled
•
Green: Normal operation, output enabled
•
Red: Fault, output disabled
•
Yellow, blinking: Remote controlled, output disabled
•
Red: Fan fault
•
Green: Fan OK
• •
Red: Module self-test or reset (LED red for
View more...
Comments
