Network Troubleshooting and Optimization With Nemo Tools

Mobile Network Driving Test TrainingWith ANITE NEMO tools Bui Nguyen Dat, TSE Ha Noi, Oct 2013 Table of content  Part 1: Overview  1. Overview of driving test tools  2. Driving test solution Part 2: Testing with Nemo Outdoor  1. Overview  2. Software and tools  3. Testing with Nemo Outdoor Part 3: Handy solution  1. Overview  2. Software and tools  3. Testing with Nemo Handy Part 4: Analyzing and reporting with Nemo Analyze Software  1. Overview  2. Software and tools  3. Using Nemo Analyze Summary 2 Telecom Test & Optimization Expert     Part 1: Overview 3 Telecom Test & Optimization Expert maintaining. analyze QoS and QoE parameters. troubleshooting. turn up.1. optimizing. Overview of driving test tools  Part of all phases of Mobile Network life circle: planning.  QoS parameters:  Configuration  Services 4 Telecom Test & Optimization Expert .  Traditional purpose: verify the quality of Mobile Network. 1.86x 5 Telecom Test & Optimization Expert . Overview Driving Test Standards  Testing standards:  3GPP  ETSI (102 250)  ITU-T P. 1. Overview Traditional testing devices  Outdoor test tools: Nemo Outdoor  KPIs test  Services test  Handy & Indoor test tools: Nemo Handy  Indoor  Walking test 6 Telecom Test & Optimization Expert . KPIs  QoE test: Nemo CEM 7 Telecom Test & Optimization Expert . Overview New testing devices  Benchmarking test: Nemo Invex  Benchmarking services & KPI for many operator Require high performance hardwares  Auto-test: Nemo Autonomous  Automatically route test  Daily test QoS.1. 2. Cable. Driving test solution Hardware  Hardware – 2xTest phone Nokia C5 – 01xUSB modem Sierra wireless Aircard 312U (to test data up to HSPA+) – 01xLaptop X230 – Accessories: GPS USB. USB hub 8 Telecom Test & Optimization Expert . 2. Driving test solution Software  Nemo Outdoor – Instalation software – Nemo Outdoor license (dongle) – Drivers for terminal  Nemo Handy – Software setup in test phone – License in test phone  Nemo Analyze – Instalation software – Nemo Analyze license (dongle) 9 Telecom Test & Optimization Expert . 2. Driving test solution Working flow 10 Telecom Test & Optimization Expert . and USSD testing 11 Telecom Test & Optimization Expert . POP3/S.76 Mbps UL with 312U) – WCDMA/HSDPA/HSUPA 2100 (312U/Nokia C5) – GSM/GPRS/EDGE 850/900/1800/1900 (312U/Nokia C5)  Supported applications: – – – – – – – – – – Voice call/Video call FTP/HTTP (DL/UL) SFTP WAP/HTTP browsing HTTP streaming (YouTube) RTSP streaming/streaming quality with PVI algorithm Iperf service testing (for TCP and UDP) Ping trace route testing SMTP/S.2. Driving test solution Testing capability  Supported Technologies: – HSPA+ Dual Cell /HSPA+ 2100 (upto 42. and IMAP/S protocols (for e‐mail testing) SMS.2 Mbps DL/5. MMS. 2. CSV. TXT. WORD. POWER POINT…)  Troubleshooting with Proffesional version  Create report template with Proffesional version 12 Telecom Test & Optimization Expert . Driving test solution Reporting capability  Importing & storing logfile for analyzing  Analyzing & exporting result  Creating report (various format: PDF. HTML. indoor test. ETSI 102 250 (services).86x (VQ)  Currently solution for driving test: – Nemo Outdoor + terminals: controlling and data collecting (driving & outdoor) – Nemo Handy with Nokia C5: data collecting (indoor & walking test) – Nemo Analyze: post-processing & reporting 13 Telecom Test & Optimization Expert . auto-test.Summary  Driving test overview: – Outdoor test. benchmarking test. ITU-T P. QoE test – Testing standard: 3GPP. Discussion 14 Telecom Test & Optimization Expert . Part 2: Testing with Nemo Outdoor 15 Telecom Test & Optimization Expert . Nemo Handy Nemo Analyze Nemo Outdoor Nemo Invex Complete toolset from data collection to post-analysis with open file format Nemo FSR1 Nemo Autonomo us 16 Telecom Test & Optimization Expert .1. Overview NEMO TOOLS FOR NETWORK TESTING Nemo tools will help our customers to optimize the quality of wireless voice and data networks and to maximize their revenue stream. 17 Telecom Test & Optimization Expert . iDEN. and TETRA networks. Overview NEMO OUTDOOR Nemo Outdoor ™ is a pioneering network measurement and optimization solution for perfecting the air interface of wireless networks. 1xEV-DO. HSPA+ DC. WiMAX. • Nemo Outdoor supports more than 270 test terminals and scanners. TD-SCDMA.1. CDMA. GSM. • Comprehensive and cost-efficient – Drive testing. Nemo Outdoor is always among the first-to-market with support for the very latest technologies. • Patented Multi-Data functionality in Nemo Outdoor empowers the user to connect up to 6 terminals to one laptop. WCDMA. QoS and benchmarking measurements can all be carried out on a single platform. currently supporting measurements on LTE. Overview NEMO OUTDOOR PRODUCT PLATFORM 18 Modem 3 Modem 2 Modem 1 Scanner 3 Scanner 2 Scanner 1 18 Telecom Test & Optimization Expert .1. Pantech. DRT. Nvidia-.    19 Telecom Test & Optimization Expert . Novatel. Currently supported UE devices from Nokia. Qualcomm®TM. Overview SUPPORTED CHIPSETS AND TERMINAL VENDORS  Base software works for all technologies Look and feel always the same. ZTE.1. Bandrich. Anritsu. Motorola. LG. Qualcomm chipset –based vendors Wide selection of supported Scanning receivers from Nemo. Beceem-. Samsung. PCTEL. Handlers are all optional and can be selected depending on technology and terminals required. Huawei. and other RunCom-. and Rohde & Schwarz. Sierra Wireless. 1. including Nokia. Overview • NEMO OUTDOOR HARDWARE – NEMO MULTI LITE The 4th generation Nemo Multi Lite is a compact and cost-effective benchmarking solution for use with Nemo Outdoor Simultaneous multi-data testing with a single laptop (Patented) Possibility to measure up to six networks Supports more than 270 test devices. CDMA 2000. and TD-SCDMA to EVDO and LTE System Highlights – High quality rugged case .Maximum protection for Nemo drive testing tools – Compact size .In case of power failures measurements can be continued.Can be taken inside most of the aircrafts as carry-on luggage – Built-in 2500 mAh battery pack . 20 • • • • • 20 Telecom Test & Optimization Expert . mix & match. Can also be used for indoor testing. Motorola and Qualcomm-based terminals and USB modems Supports any combination of technologies ranging from GSM to HSPA+. buses. and boats • Wire-free mobility – Three hot-swappable Li-ion batteries – Up to 36 hrs of usage without an external power supply • In-vehicle use with standard +12V input Telecom Test & Optimization Expert 21 .1. Overview NEMO OUTDOOR HARDWARE – NEMO WALKER • Compact and convenient backpackbased carrying solution for network measurement equipment • Holds all necessary test devices – – – – – – Up to six test mobiles or USB modems Scanner Voice Quality accessories GPS receiver USB hub Tablet PC Use case examples • • • Voice quality benchmarking in parks and pedestrian zones Roll-out LTE service KPI verification at shopping malls Multi-technology and multi-operator benchmarking on trains. 2 (wide band) producing a PESQ score that is mapped on an EMOS (Estimated Mean Opinion Score) scale.862.862.3 support with Android phone 22 Telecom Test & Optimization Expert . POLQA P.1.862. Overview 22 NEMO OUTDOOR VOICE QUALITY TESTING – MOBILE TO MOBILE    With Nemo Outdoor it is possible to perform mobile-to-mobile and mobile-to-fixed-to-mobile voice quality measurements The measurement is based on the ITU-T recommendations P.1 (narrow band) and P. 1. Overview NEMO OUTDOOR VOICE QUALITY TESTING – MOBILE TO FIX 23 23 Telecom Test & Optimization Expert . The information provided by Nemo Outdoor assists in the verification and troubleshooting of new services reducing the time-to-market.1. therefore. Overview NEMO OUTDOOR APPLICATION TESTING Nemo Outdoor enables network operators to test their network using the same application protocols as their customers and. 24 Telecom Test & Optimization Expert . provides results that correspond with the end-user experience. 1. Overview NEMO OUTDOOR VIDEO STREAMING QUALITY • • • Nemo video quality uses Psytechnics PVI algorithm A non-intrusive method for measuring the video quality of IP networks Based on IP parametric analysis of live traffic • Available parameters: • Video codec • Video frame rate • Video protocol • Video quality degradation due to compression • Video quality MOS • Video quality MOS degradatation • Video quality jitter • Video quality packet error rate • Video quality degradation due to packet errors • Video quality type • Video preview can be seen during the measurement 25 Telecom Test & Optimization Expert . 1. Overview NEMO OUTDOOR TROUBLE SHOOTING  Pilot and frequency scanning can be performed on Nokia terminals. Hence, there is no need to use a separate fast frequency scanner to perform scanning and missing neighbor detection on both GSM and WCDMA bands simultaneously, which adds to costeffectiveness and increases user convenience. Missing neighbor detection using a Nokia terminal – no need for a separate scanner to be used simultaneously Missing Neighbor Detection requires that terminal & scanner be used simultaneously. Both GSM/WCDMA missing neighbors can be detected simultaneously. 26 Telecom Test & Optimization Expert 1. Overview NEMO OUTDOOR – NEMO SERVER With Nemo Outdoor it is possible to conduct data testing against • Commercial/private servers and • Nemo test server 27 April 21, 2014 Telecom Test & Optimization Expert 1. Overview NEMO OUTDOOR – ADVANTAGE FEATURES     Channel lock/scr. code lock Cell barring Timeslot testing Cell testing – Also called ”sleeping cell detection”. UE is automatically locked to neighbor cells and test call is made. Surrounding cells can be tested from a single location.      Forced handovers – Supported in Nokia terminals Measurement report message modification with Nokia UEs (3G) Neighbor list – Decoded from signaling messages Measurement lists User parameters – User can select parameters to be decoded from signaling messages and show them in the UI during measurements and playback 28 April 21, 2014 Telecom Test & Optimization Expert No conversion or parsing of the files A detailed description of the file format is included in the product user documentation. The file format description contains all recorded events and their parameters.1. • • 29 Telecom Test & Optimization Expert . Overview NEMO OUTDOOR – LOGFILE FORMAT • Produces measurement files in an open ASCII file format • Files can be directly imported to Nemo analysis tool Nemo Analyze as well as to various third-party post-processing/analysis tools. 2. Software & Tool  Nemo outdoor installation packet  Drivers: – Phone Nokia C5 – USB modem sierra wireless – GPS driver 30 Telecom Test & Optimization Expert . 2. Software & Tool Setup Software Start program 31 Telecom Test & Optimization Expert . 3. Testing with Nemo Outdoor NEMO OUTDOOR – USER INTERFACES  Tool bar + function   Workspaces Parameter tree + Drag & drop functionality Device manager Export/import user interface settings    Instant playback 32 Telecom Test & Optimization Expert . 3. Testing with Nemo Outdoor NEMO OUTDOOR – CONNECT DEVICE 33 Telecom Test & Optimization Expert . The Loop script command enables scripts where a portion of the script is repeated a number of times before proceeding with the rest of the script. data transfers. SMS/MMS messages. and ping. automatically Can be created and edited with Nemo Outdoor’s built-in script editor • 34 Telecom Test & Optimization Expert . Testing with Nemo Outdoor NEMO OUTDOOR – CREATE SCRIPT • Can be used for voice and video calls. etc. HTTP/FTP packet data uploads/downloads. Can be used to create Conditional scripts where the type of the detected packet technology determines how the script proceeds. With the Wait script command. the user can create scripts that are not activated before a certain system or bandwidth is active. HTML/WAP browsing. • • • • • Use script files to run measurements Makes voice/video calls. emails.3. Testing with Nemo Outdoor NEMO OUTDOOR – GRAPH • Multi-layer capability for displaying multiple results in single graph • Parameters displayed in graphical and numerical format • Event notifications displayed on graphs and maps 35 Telecom Test & Optimization Expert .3. and later used in the various data views 36 Telecom Test & Optimization Expert . TABLE • • Messages from events. etc.3. Testing with Nemo Outdoor NEMO OUTDOOR – GRID. decoded User parameters can be defined by the user. L3. possibility to search cells on the map Possibility to plot the same measurement several times on a map to easily correlate different parameters  Interfering cell presentation on the map 37 Telecom Test & Optimization Expert . site names. and cell information displayed on map Color set to color BTS icons based on different parameters Find cell .3.measurement route can be planned beforehand Parameter-based route coloring Active cell information can be plotted along the routes Base station icons. Testing with Nemo Outdoor NEMO OUTDOOR – MAP        Route planning . 3. Testing with Nemo Outdoor NEMO OUTDOOR – MAP  Export to Google Earth 38 Telecom Test & Optimization Expert . Standard Graphics formats (.3.) and MapInfo maps supported Import a floor plan and use that as a map Nemo Outdoor supports markers.bmp.jpeg. correlate events to positioning coordinates Colored based on parameter values Event notification icons can be displayed on the map • • • • • 39 Telecom Test & Optimization Expert . No bulky hardware needed: just a phone connected straight to a Tablet PC or Graphics Tablet. . Testing with Nemo Outdoor NEMO OUTDOOR – INDOOR OPTION & MAP • Nemo Outdoor with Indoor option is suited for indoor measurements. etc. PLAYBACK 40 Telecom Test & Optimization Expert . Testing with Nemo Outdoor NEMO OUTDOOR – RUNNING TEST AND SAVING LOGFILE.3. Centralized solution – All of the test devices among the extensive selection can be connected to a single laptop. HSDPA/HSUPA. HSPA+. Extremely easy to set up.Summary  Powerful platform-based tool – All the latest customer needs can be met through additions of options to the flexible and expandable Nemo Outdoor platform. CDMA/EVDO and WIMAX. Comprehensive and cost-efficient : one platform with support for different terminal vendors and more than 270 different test devices. Fully customizable user interface. TETRA. supported online map Open Street Map Telecom Test & Optimization Expert      41 . DVB-H. TD-SCDMA. Capable of benchmarking for 3 Network operator simultaneously Latest technologies : Support for LTE. WCDMA. GSM/GPRS/EDGE. automated test with advantage script function. configure and use with Autodetect devices. Discussion & Practice 42 Telecom Test & Optimization Expert . Part 3: Testing with Nemo Handy 43 Telecom Test & Optimization Expert . or inside building. walking test in small road.1. Overview NEMO HANDY Nemo Handy belong to Anite Nemo Tool that help customer to quick troubleshooting inside field without laptop or driving test. Nemo Handy Nemo Analyze Nemo Outdoor Nemo Invex Complete toolset from data collection to post-analysis with open File Format Nemo FSR1 Nemo Autonomo us 44 Telecom Test & Optimization Expert . Overview NEMO HANDY PRODUCT FAMILY  Consists of smart phone and tablet based tools supporting Symbian (Handy-S).9 LTE Nemo Handy-W with HTC Touch Pro 2 Nemo Multi Handy is the most portable and cost-effective benchmarking solution in the market  Multiple Handy terminals collecting syncronized measurement data that enable benchmarking with up to seven terminals 45 Telecom Test & Optimization Expert .S with Nokia C7-00 Nemo Handy-A with HTC Desire HD Nemo Handy-A with Samsung Galaxy Tab 8. Android (Handy-A) and Windows Mobile (Handy-W) operating systems Nemo Handy.1. Overview NEMO HANDY-S .e. and cell barring Cell and timeslot testing. distance to serving cell. fully customizable and user-friendly user interface Voice quality measurements based on Mean Opinion Score (MOS) Enables collecting geographical coordinates with an internal or Bluetooth GPS receiver Supports EGSM/GPRS/EDGE/WCDMA/HSPA/ measurements Indoor map with markers and geodetic coordinates Automated service testing with scripts Real-time statistics BTS information. serving cell name. scrambling code lock. can be displayed based on BTS file Forcing commands for channel lock.Key Features              Collecting all KPIs that capable with Nemo Outdoor & Terminal Graphical. and cell ID.1. site name. i. handover assist and handover suppression GSM frequency scanning and UMTS pilot scanning Playback for viewing measurement files after measurements 46 Telecom Test & Optimization Expert . system lock. HTC Desire HD. S4. user-friendly user interface  Enables collecting geographical coordinates with an internal GPS receiver  Indoor map with markers and geodetic coordinates  Live outdoor map  Notifications on the map and graphs  HTML testing with real web browser 47 Telecom Test & Optimization Expert .Key Features  Support up-to-date terminals: Galaxy TAB.1. S3. Galaxy S2. Raider …  Supports GSM/WCDMA/HSPA/LTE measurements  Automated service testing with scripts: voice call. Incredible-S. Thunderbolt. FTP data transfers and HTTP data transfers  Supports the following view types: line graphs. Overview NEMO HANDY-A . bar graphs and text views  Real-time statistics  Graphical. Vivid. Sensation. 1. Overview NEMO HANDY-W .Key Features        Supports GSM/WCDMA/HSPA measurements Manual Data Transfer (FTP) Logging Internal GPS Support Voice Call All Qualcomm –chipset based parameters logged Based on HTC Touch Pro 2 48 Telecom Test & Optimization Expert . 1. line graphs. Overview NEMO HANDY INTERFACES  User interface – Multiple pages – Bar graphs. numerical views  Indoor map  Outdoor map  Real-time statistics 49 Telecom Test & Optimization Expert . 2. Software & Tools  Installation Handy-S file  License file (generated matching with IMEI)  Nemo File Manager (auto convert Handy Logfile when importing to Nemo Analyze)  Installation step: – Copy installation file and license file to memory or SD card of phone – Open Application  Office  File Manager  Run installation file & license file 50 Telecom Test & Optimization Expert . 3. Testing with Nemo Handy-S General information  Open Nemo Handy software in phone  Press Option to view all Control Comands  Press about to view all license 51 Telecom Test & Optimization Expert . 3. Testing with Nemo Handy-S Manually testing  Press Option  Tool  choose test case  run/call  automatically recording  end call/stop  stop logging  save logfile 52 Telecom Test & Optimization Expert . 3. Testing with Nemo Handy-S Script testing  Press Option  Scipts Open  Open a predefined logfile or create New  Run  Start Logging  Stop  Stop recording & save 53 Telecom Test & Optimization Expert . Handy-Android.Summary  Handy Solution: Handy-Symbian. Handy-Window Phone  Ease of use – Intuitive user interface makes all operations from timeslot testing to creating complex measurement scripts time-effective and easy  Multi Handy functionality – A centralized solution for conducting large-scale measurements. One Nemo Handy works as a Master unit. sending script commands to as many as 6 Slave units  Immediate file sharing – Share display configuration files and scripts with other Handy users 54 Telecom Test & Optimization Expert . Discussion & Practice 55 Telecom Test & Optimization Expert . Part 4: Analyzing and reporting with Nemo Analyze Software 56 Telecom Test & Optimization Expert . benchmarking. statistics and map plots over nationwide data sets Enterprise level client-server based post-processing solution Centralized data storage.1. analysis and reporting tool In-dept analysis and troubleshooting Corporate wide access to network KPIs via web interface Instant data reporting. Overview Nemo Analyze Nemo Analyze Standalone   PC based postprocessing. management and advanced search functionality In-dept analysis and troubleshooting Nemo Analyze Snapshot   Nemo Analyze Enterprise    57 Telecom Test & Optimization Expert . 58 Telecom Test & Optimization Expert . Overview Nemo Analyze – Centralize solution Analysis and Optimization Visualization of all NW and application level diagnostics on map and various graphs Fully customizable. multi-page. and areas. CSV format ASCII data Ascom TEMS products Rohde&Schwarz ROMES product Reporting Statistical reporting on NW and application level KPIs. technologies.1. synchronised UI Nemo Analyze Enterprise Nemo product portfolio Troubleshooting Server Clients Quickly found NW and application level problems from large data sets Drill-down to full details Root-cause analysis Nemo Analyze Standalone Benchmarking Automatic benchmarking of QoS and NW KPIs between operators. terminals. iDEN. Overview Nemo Analyze – Technologies supported  Supported technologies: GSM. WCDMA. EVDO.  EDGE.1. HSPA+ Upgradable technologies: CDMA. TDSCDMA. DVB-H. TDMA. GPRS. TETRA. WiMAX Benchmarking and analysis:  – Different technologies – Different test terminals and scanners 59 Telecom Test & Optimization Expert . Wimax mobile. LTE. iDEN. with dropped calls” Coverage comparison over 1125 hours (140 man-days) of data 60 Telecom Test & Optimization Expert . or any combination of these attributes – E.g. ”Find files from London downtown. serving system. Overview Nemo Analyze – Storing Capacity • • • • Thousands of log files can be loaded into Nemo Analyze running on a standard laptop Hundreds of hours of measurement data can be analyzed simultaneously as one dataset Every sample is stored into the database instead of just aggregates Files can be instantly filtered and merged based on geographical area. time.1. problem event. operator. measurement name. from last month. and Google Maps. including – Route colorcoding – Base station overlay – Line drawing to serving and neighbour cells – Delta plotting – Use in saved workbooks   61 Telecom Test & Optimization Expert .1. the map tiles are retrieved as needed when map is opened. zoomed. OpenStreetMap. Live maps can be used the same way as regular MapInfo maps. or panned. Internet connection is required. Overview Nemo Analyze – Live Map  Nemo Analyze supports KML-based live maps. 2. Software & Tool Nemo Analyze  Installation file  License inside copy protection dongle  Nemo File Manager (import handy logfile)  Run Installation file  run Nemo File Manager 62 Telecom Test & Optimization Expert . Queries. report template control menu Database loader 63 Telecom Test & Optimization Expert . Software & Tool Nemo Analyze – User Interfaces   Work book Tool & Menu Logfile group by folder Parameter. Map. Troubleshooting tool   Logfile. BTS file.2. Using Nemo Analyze Exporting Process  Importing logfile  Choose logfile/multi logfile  choose parameter  Statistic or Open  Select Data view  Drag-drop inside map/grid  Exporting workbook 64 Telecom Test & Optimization Expert .3. 3. Using Nemo Analyze Reporting Process  Importing logfile  Choose logfile/multi logfile  right click  select Report  save or print report 65 Telecom Test & Optimization Expert . 3. Using Nemo Analyze Services performance report • KPI reporting on following services: – – – – – – – – – – – Voice call (ETSI-compliant) Video call (ETSI-compliant) SMS MMS Generic packet data (Attach + PDP Context Activation) WAP HTTP FTP E-mail Ping Streaming 66 Telecom Test & Optimization Expert . Using Nemo Analyze Advanced functions – Event Scheduler  Typical steps of the post-processing chain can be automated : – Loading measurement data into the tool – Running report for the new data – Checking critical KPIs from the new data – Distributing reports and problem alarms in the organisation 67 Telecom Test & Optimization Expert .3. 3. Using Nemo Analyze Advanced functions (2)  Spreadsheets report design: Drag and drop parameter aggregates and statistics on a single spreadsheet based on multiple measurement files and KPIs  save report template  MS Excel Report templates: Export query result data sets from Nemo Analyze to a selected location within an existing MS Excel document. 68 Telecom Test & Optimization Expert . in tracking certain signaling message sequences AVG. CASE. etc 69 Telecom Test & Optimization Expert . COUNT. useful e. MIN. Using Nemo Analyze Advanced functions – KPI workbench • • User-friendly way of creating custom parameters and KPIs No need for SQL or programming knowledge • Provides tools for complex KPIs: State machine.g. MAX.3. level: summary  Predefined troubleshooting and optimization tasks: – Call failure and dropped call root – – – – – – cause analysis Missing neighbor analysis Neighborlist optimizer Cell overspilling analysis and crossfeeder detection Cell footprint survey BCCH clash analysis (overlapping BCCH) Scrambling code clash analysis(overlapping scr) HSUPA low throughput root cause analysis Telecom Test & Optimization Expert 2. Using Nemo Analyze Advanced functions – Automatic troubleshooting  Drill-down: – Get list of failures (e. level: full details – 70 . level: individual failures 3.g.3. dropped calls) – – in the dataset Drill-down with double-click to see full details per failure Full details analysed only around the problem events  efficient troubleshooting of vast datasets 1. Summary  Complete analyzing and reporting software that support: – – – – – Importing and storing logfile in database Exporting and reporting Automatically analyzing and reporting with event schedule Creating Report templates with Microsoft excel KPIs workbench 71 Telecom Test & Optimization Expert . Discussion & Practice 72 Telecom Test & Optimization Expert . Telecom Test & Optimization Expert .