WHEN QUALITY MATTERSQualiPoc 10.6 Speech and Video Test Description April 2011 SwissQual® License AG Allmendweg 8 CH-4528 Zuchwil Switzerland t +41 32 686 65 65 f +41 32 686 65 66 e
[email protected] www.swissqual.com Part Number: 16-100-200549-1 Rev 10.6 SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and free of errors and omissions. SwissQual will, if necessary, explain issues which may not be covered by the documents. SwissQual’s liability for any errors in the documents is limited to the correction of errors and the aforementioned advisory services. Copyright 2000 - 2011 SwissQual AG. All rights reserved. No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated into any human or computer language without the prior written permission of SwissQual AG. Confidential materials. All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and is provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material. When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademark somewhere in your text. SwissQual®, Seven.Five®, SQuad®, QualiPoc®, NetQual®, VQuad®, Diversity® as well as the following logos are registered trademarks of SwissQual AG. Diversity Explorer™, Diversity Ranger™, Diversity Unattended™, NiNA+™, NiNA™, NQAgent™, NQComm™, NQDI™, NQTM™, NQView™, NQWeb™, QPControl™, QPView™, QualiPoc Freerider™, QualiPoc iQ™, QualiPoc Mobile™, QualiPoc Static™, QualiWatch-M™, QualiWatch-S™, SystemInspector™, TestManager™, VMon™, VQuad-HD™ are trademarks of SwissQual AG. SwissQual acknowledges the following trademarks for company names and products: Adobe®, Adobe Acrobat®, and Adobe Postscript® are trademarks of Adobe Systems Incorporated. Apple is a trademark of Apple Computer, Inc. DIMENSION®, LATITUDE®, and OPTIPLEX® are registered trademarks of Dell Inc. ELEKTROBIT® is a registered trademark of Elektrobit Group Plc. Google® is a registered trademark of Google Inc. Intel®, Intel Itanium®, Intel Pentium®, and Intel Xeon™ are trademarks or registered trademarks of Intel Corporation. INTERNET EXPLORER®, SMARTPHONE®, TABLET® are registered trademarks of Microsoft Corporation. Java™ is a U.S. trademark of Sun Microsystems, Inc. Linux® is a registered trademark of Linus Torvalds. Microsoft®, Microsoft Windows®, Microsoft Windows NT®, and Windows Vista® are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries U.S. NOKIA® is a registered trademark of Nokia Corporation. Oracle® is a registered US trademark of Oracle Corporation, Redwood City, California. SAMSUNG® is a registered trademark of Samsung Corporation. SIERRA WIRELESS® is a registered trademark of Sierra Wireless, Inc. TRIMBLE® is a registered trademark of Trimble Navigation Limited. U-BLOX® is a registered trademark of u-blox Holding AG. UNIX® is a registered trademark of The Open Group. .......................................................................................................................................................... 7 Configuring a Diversity Voice Server as a B-Side Device ..................................................................................................... 7 Figure 2-2 Main Job edit view for an A-Side or B-Side test...................... 4 Figure 1-3 Sample direction during a measurement ....................... 4 Figure 1-4 Sequence of tones and samples ............. 16 Monitoring a Call to Any Number Test....................................................................................................................................................................................................................................................... 12 Monitoring a Speech or Video Call Test ............................................ 17 A Abbreviations ..................................................................................................................... 12 Log View ............................................................................................................................................................................... 5 Figure 2-1 Creating a new A-Side or B-Side test .................................................................... 13 Figure 3-1 Creating a new Call to any number test .....................................................6 Speech and Video Test Description © 2000 .................................................................................................................................................................................................. 3 Figure 1-2 Call direction for a 2:1 MOC/MTC ratio ................................................................................. 10 Figure 2-6 Timing options for an A-Side or B-Side test ...............................................................QualiPoc 10............................................................................................................................................................................................................................................................................... 11 Starting a Double-Ended Speech or Video Call Test . 7 Figure 2-3 General settings for an A-Side or B-Side test ............................................................................................................................................................. 8 Figure 2-4 Total test duration for A-Side or B-Side test .... 16 Tables Contents | CONFIDENTIAL MATERIALS ii ................................................................................................................................................... 3 Sample Direction During a Test .......................................................................................................................... 9 Figure 2-5 Reference sample settings ...................................................................................................... 4 Call to Any Number Test ............................................. 2 Call Direction ......................................................................... 2 Video Call Tests ........... 13 3 Configuring a Speech or Video Call to Any Number Test ............. 5 Call to Diversity Voice Server Test ...................................................................................................................................................... 15 Figure 3-2 Main settings for a Call to any number test ...................................... 10 Figure 2-7 Log view for a Speech or Video Call test .......................................................................................................... 15 Starting a Call to Any Number Test ............. 16 Figure 3-4 Main settings for Call to any number test ........................................................................... 4 Sequence of Call Setup and Playing Samples.................................................................................................................................................2011 SwissQual AG Contents 1 Introduction ..................................................................................................... 18 Figures Figure 1-1 Overview of a speech call test .................... 15 Figure 3-3 General settings for a Call to any number test.................. 1 A-Side and B-Side Tests ........................................................................................................................... 1 Overview of Speech and Video Call Tests ................................................................................... 5 2 Configuring an A-Side or B-Side Speech or Video Call Test ....... ............................................................................. 13 Table 3-1 Description of the settings in the main Job Edit view for a Call to any number job .... 16 Table A-1 Description of abbreviations ........................ 18 Contents | CONFIDENTIAL MATERIALS iii .................................................................................................................... 8 Table 2-3 Description of the reference sample settings ................................................................. 7 Table 2-2 Description of general settings for an A-Side and B-Side test ..................................................................6 Speech and Video Test Description © 2000 ...... 15 Table 3-2 Description of the General settings for a Call to any number test .......................... 10 Table 2-5 Description of events in the Log view for a Speech or Video Call test................................. 10 Table 2-4 Description of the timing options for an A-Side or B-Side test ....................2011 SwissQual AG Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test .QualiPoc 10.............. for either side of the test. QualiPoc sends a predefined reference audio sample over the network. the A-Side device sets up a full configuration call to select the test on the BSide and to synchronize the measurement windows of both sides. that is. which can be a mobile phone or a Diversity voice server. single-ended tests do not require a dedicated channel in the test system. These tests assess an unknown sample and do not occupy network resources to the same extent that intrusive tests do. • Note: Before the test starts. Call to Diversity Voice Server: Standard speech test where the Voice Call Server is controlled with DTMF tones that are sent to an ISDN or PSTN device that is connected to the server. see the "Abbreviations" section on page 18. IVR. that is. Note: To calculate the MOS speech quality. Non-intrusive tests. • Speech Call Test: Assesses the functionality and quality of voice calls on a network. The test assesses the quality of the calls by comparing the originating call signal (A-Side) to the received call signal (B-Side). The test transmits a predefined reference signal through this channel. Chapter 1 | Introduction CONFIDENTIAL MATERIALS 1 .QualiPoc 10. • • • Call to Any Number Test: Simple variant of the standard speech test that sets up a call for a specified amount of time. You can start the call on an A-Side or a B-Side device. Video Call Test: Same as the standard speech test except that the call is a video call instead of a voice call. double-ended tests. Intrusive. This test cannot record the call. This test does not assess the speech quality of the call. that is. You can also use a dedicated service number.6 Speech and Video Test Description provides an overview of the following types of QualiPoc Speech and Video Call/Streaming tests: • • • • Speech: A-Side and B-Side LQ assessment tests Call to any number (access test) Video call test (access test) Video call to any number (access test) Note: For a description of the abbreviations in this document.2011 SwissQual AG 1 Introduction The QualiPoc 10.6 Speech and Video Test Description © 2000 . require a dedicated channel in the test system. You need to use this test if your Voice Call Server does not have access to an IP enabled network. Video Call to Any Number: Same as the Call to any number test except that the call is a video call instead of a voice call. Overview of Speech and Video Call Tests You can perform the following QualiPoc Speech Call tests to assess the functionality and quality of speech calls on a network. The main difference is that the call is a video call instead of a speech call. These two parameters are the same on both sides of the test. The behaviour of the test inside the call windows is determined by the job settings that you specify and the st network conditions. if this attempt exceeds the guard time. 1st call setup delay and the call windows. the call disconnects. see the "Configuring an A-Side or B-Side Speech or Video Call Test" chapter on page 7. To establish a Video Call there must be a 3G Network available. The general flow of a speech call is similar on the A-Side and B-Side devices except for the call and the sample directions. A Video Call Test establishes a Video Call and calculates the video quality of the presented video display. However. that is. the following sequence of events occurs: • • • • • One device initiates a configuration call to the other device Other device sends a synchronization tone to the calling device Calling device synchronizes to the tone and the sample sequence starts on both devices One device starts to play a speech or video sample Other device records the sample Note: Video call tests cannot record the sample. If the first call setup fails and the call terminates when the timeout is reached. The guard time ensures that the call successfully terminates at the end of the test cycle.QualiPoc 10. that is. This test can only be done on trace-capable phones. • • Recorded sample is compared to a local reference and MOS quality value is calculated. the call starts with trace capability setup which is followed by the actual test phase. Note: On a trace capable phone. cycles. In combination with NQTM such a test can be easily configured and run automatically. Chapter 1 | Introduction CONFIDENTIAL MATERIALS 2 . the call connects before the 1 call setup delay expires and terminates before the guard time ends. the test attempts to reconnect after the amount of time that you specify. Each test starts with the 1 call setup delay which is followed by a consecutive series of call windows. st Video Call Tests The test flow for Video call is exactly the same as for the speech call test. Configuration calls are required for Mobile to Mobile and Mobile to Diversity Voice Server B-Side devices while the following tests do not require a configuration call: • • Call to any number Call to Answering Station or Service Number (IVR) Figure 1-1 on page 3 provides an overview of a speech call test. For more information on test settings. For a successful test. window duration that you specify for the test.2011 SwissQual AG A-Side and B-Side Tests During a double-ended speech or video call test. A Video Call Test with video quality evaluation (MOS-Value) must establish the call to a Video Call Server which transmits a predefined video sample to the A-Side. that is.6 Speech and Video Test Description © 2000 . Calling device terminates the call This sequence repeats for the amount of cycles. Parameter “MOC-only” “MOC/MTC” “MTC-only” Ratio MOC/MTC = X:0 MOC/MTC = 1:X MOC/MTC = 0:X X Value (X>0) (X>0) (X>0) For example.QualiPoc 10. if the MOC/MTC ratio is 2:1.2011 SwissQual AG Trace setup (10sec) . only on TRACE mobiles 1st Call Setup Delay Window duration Window duration Call Window Window duration Call Window Call Window Overall Job duration Call duration Call Setup Call Window Call Guard Time Start dial Connect Max.6 Speech and Video Test Description © 2000 . the A-Side device initiates the call in the first two call windows while the B-Side device initiates the call in the third call window. Similarly. The test Chapter 1 | Introduction CONFIDENTIAL MATERIALS 3 . the B-Side device terminates the call in the first two call windows while the A-Side device terminates the call in the third call window. Call Setup Time Call duration Call Window Call Setup Call Setup Pause Call Guard Time Start dial Disconnect because failed Start dial #2 Connect Disconnect because Guard Time Figure 1-1 Overview of a speech call test Call Direction The call direction of A-Side and B-Side tests is specified by Mobile Originated Call (MOC) and Mobile Terminated Call (MTC) values respectively. A- Sample Interval Call Sample Interval Sample Interval B- Sample Interval Call Sample Interval Sample Interval Figure 1-3 Sample direction during a measurement Sequence of Call Setup and Playing Samples After a successful call setup. The test repeats this sample direction for the duration of the measurement. The A-Side searches for this BD-DTMF sequence.2011 SwissQual AG repeats this call direction sequence for the duration of the measurement. that is. The sample direction can either be from A to B. the test plays a defined sequence of sounds on the called side.6 Speech and Video Test Description © 2000 . only on TRACE mobiles 1st Call Setup Delay A- Call Window Call Window Call Window B- Call Window Call Window Call Window Figure 1-2 Call direction for a 2:1 MOC/MTC ratio Sample Direction During a Test During a double-ended test one side plays a sample and the other side listens for and measures the quality of the sample. where B plays the sample and A listens for the sample. synchronization tone and then starts to record and evaluate the speech samples. where the A-Side device plays the sample and B-Side device listens for the sample or from B to A. Chapter 1 | Introduction CONFIDENTIAL MATERIALS 4 .QualiPoc 10. Note: Each test is equal to one speech sample. Trace setup (10sec) . Call to Any Number Test The Call to Any Number test procedure is the same as the speech tests that are described in the "A-Side and B-Side Tests" section on page 2 except for the following differences: • • Call duration is limited to 60 seconds if you use Test Manager to configure the test Test has only one pause value. Chapter 1 | Introduction CONFIDENTIAL MATERIALS 5 . The length of the interval in which the speech sample repeated plays depends on the length of the sample.6 Speech and Video Test Description © 2000 .2011 SwissQual AG Connect Start dial Synch Twitcher & Cocodjojo Speech sample Speech sample Call Setup Sample Call Window Call Sample Sample Interval Connect to Synch Sample Interval Synch to Sample delay Figure 1-4 Sequence of tones and samples The called side plays the following sequence of tones and samples: • • Twitcher and Cocodjojo sample: Serves as line opener for QualiPoc Synchronization sample: Combination of four multi-frequency tones. so the actual delay is 2. • WAV reference speech sample: Plays 2. This reference sample is played after the “Connect to synch delay” that you specify. for example. to synchronize the call windows for the measurement. which is also used as the value for the guard time Note: For the Video Call to Any Number Test. Note: For standard answering machines. Call to Diversity Voice Server Test The Call to Diversity voice server test procedure is similar to the speech tests that are described in the "ASide and B-Side Tests" section on page 2. a 5 second sample corresponds to a 20 second interval and a 6 second sample corresponds to a 25 second interval.6 seconds after the synchronization sample start. QualiPoc attempts to establish a video call with the receiving end. The only difference is that the configuration call uses in-band DTMF tones to select the corresponding test and in a second sequence. this delay is 7 seconds. namely a regular DTMF BTone and D-Tone as well as two higher frequency tones that are outside of the DTMF-frequency range which trigger the recording start on QualiPoc phones. The voice starts on the reference sample after two seconds of silence. The delay must provide the phone enough time to play the sample and to switch between the phone application and the QPAEngine after the connection is established.QualiPoc 10.8 seconds for the standard sample. 6 Speech and Video Test Description © 2000 .2011 SwissQual AG Chapter 1 | Introduction CONFIDENTIAL MATERIALS 6 .QualiPoc 10. select Options > Job handling > Video Call/Streaming. Figure 2-1 Creating a new A-Side or B-Side test 2.2011 SwissQual AG 2 Configuring an A-Side or B-Side Speech or Video Call Test This chapter describes how to manually configure an A-Side or B-Side speech or video call in the QPAEngine software on your phone. Note: For a video call. and then select Call MOS (A-Side) or Call MOS (B-Side). and general timings for the test. select Options > Duplicate. that is. Figure 2-2 Main Job edit view for an A-Side or B-Side test Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test Setting Job Name General settings Tests Timings Description Name of the test Specifies the duration. The B-Side device can be a mobile phone. answering station. cycle. To manually create an A-Side or B-Side call test 1.QualiPoc 10. Select an existing test or create a new test Specifies the detailed timings of the tests such as the MOC:MTC ratio or Window duration. or s a specially configured service number. The configuration of the A-Side and B-Side devices is identical. a Select Options > Create New. Start QPAEngine on the phone and select Options > Job handling > Speech Call. The only difference is the Job ID that QualiPoc automatically assigns the B-Side test. and then select Options > Edit. a Diversity Voice Server. Tip: If the view contains an existing job. you can select the job. Specify the basic job settings. 7 Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS .6 Speech and Video Test Description © 2000 . Figure 2-3 General settings for an A-Side or B-Side test Table 2-2 Description of general settings for an A-Side and B-Side test Setting Duration Description Enter the maximum measurement time for the test after which the test automatically stops. enter 0. Cycles Note: If you specify a maximum number of cycles and a maximum duration. 3. • To determine the IMEI of a Nokia phone. repetition A-Sides IMEI (last 8 digits) (B-Side test only) Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 8 . and then select OK. enter 0. To disable this feature. Enter the number of times to repeat the test sequence. type *#06# A number B number Test seq. the test stops when one of the maximum values is reached. and then select Back. Enter the phone number for the B-Side device. enter a name for the job. Enter the phone number for the A-Side device.2011 SwissQual AG b Select Job Name. Select Options > General settings. specify the general options for the test. Enter the maximum number of call windows for the test. Enter the last 8 digits of the International Mobile Equipment Identity of the A-Side mobile phone.QualiPoc 10.6 Speech and Video Test Description © 2000 . To disable this feature. and then select Back. For the Qp_Default reference sample. select Back. and then select Options > Add > New Test. This value is automatically calculated based on the Test seq. Average call setup [s] 4. You can use this value to help you to determine the call window for the test. Enter the amount of time in seconds for the call setup procedure. QualiPoc uses this value to calculate the remaining time for the tests within a call. 6.6 Speech and Video Test Description © 2000 . Select Options > Change. Figure 2-4 Total test duration for A-Side or B-Side test 5. Select Tests. Test 1:Speech.QualiPoc 10. see the "Configuring an A-Side or B-Side Speech or Video Call Test" on page 7. You need to type this identifier on the A-Side phone when the test starts. Note: You cannot specify the Total test duration value. this value must be 14500 ms. Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 9 .2011 SwissQual AG Setting Description Select one of the following B side device types: • • Answering Station: Select this type if you do not want the B-Side device to generate measurement files QualiPoc Unit: Mobile phone with QPAEngine software When the B-Side test starts. Record hang over. Select the test. This ID is validated when you save the job. this value must be 18500 ms. repetition. QualiPoc generates a unique job identifier so that NQDI can synchronize the measurement results from both sides. Voice Server Job-ID (For Diversity Voice Server B-side type) Record hang over [ms] Enter a unique number to identify the test. For other reference samples. Diversity Voice Server: B-Side device is a voice server B side type (A-Side test only) • Note: For information on how to configure the Diversity Voice Server as a B-Side device. This value has a direct impact on the Total Duration of the test. and Average call setup values as well as the reference sample that you choose. for example. specify the reference sample settings. specify the timing options for the test. For a detailed description of this ratio. Select the types of WAV files that you want to save on the phone. that is. Select the direction that you want the sample to travel during the call. is A-Side to B-Side while a 1:1 ratio causes the call direction to reverse in each call window. 7. a 1:0 ratio. Select Timings. Figure 2-6 Timing options for an A-Side or B-Side test Table 2-4 Description of the timing options for an A-Side or B-Side test Setting Description Enter the call direction during the test in the form of a ratio.2011 SwissQual AG Figure 2-5 Reference sample settings Table 2-3 Description of the reference sample settings Setting Reference sample Sample Direction Save WAV files LQ <= (LQ Dependent WAV files only) Description Select the reference sample in the list that you want to use for the test. MOC only.6 Speech and Video Test Description © 2000 . Enter the cutoff Listening Quality value for the LQ dependent WAV files that you want to save.Ratio Note: If you specify a MOC only call direction. MOC:MTC . see the "Call Direction" section on page 3. and then select Back.QualiPoc 10. the call direction for a 1:0 ratio. For example. Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 10 . This list only shows the samples that are installed on the phone. The receiving side compares the sample with a corresponding copy to assess the speech quality. that is. the test starts with a configuration call to synchronize the measurement windows on both devices. Enter the amount of time in seconds during which the test does not reattempt a call. the guard time. Enable Bluetooth connectivity on your phone and on your computer. Enter the maximum amount of time in seconds for the test to try to establish a call. the call duration. QualiPoc automatically terminates a call that exceed the window duration. Note: This setting does not apply to dropped calls. Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 11 .QualiPoc 10. Configuring a Diversity Voice Server as a B-Side Device After you create and save a Call-MOS (A-Side) test that uses a Diversity Voice Server as a B-Side device. Enter the amount of time in seconds to wait between the last call termination and the next Dial command. The call window must be long enough to accommodate the 1st call setup delay. you need to copy the configuration file from the phone to the server. the test attempts the setup repeatedly until the window duration expires. No call setup time [s] Pause after failed calls [s] Max failed calls Pause after max. Note: SwissQual ships most mobile phones with Bluetooth enabled. the test ends. Enter the amount of time in seconds between the Dial and Disconnect commands. Select Back. Enter the amount of time in seconds for the buffer time at the end of the call window during which QualiPoc disconnects the call. If a call setup fails. Max. This set point in time occurs at the end of each call window.6 Speech and Video Test Description © 2000 . Enter the amount of time in seconds for the test to wait between a failed test and a call reattempt. If the time expires before the call connects. Connect your phone to your PC. Enter the amount of time in seconds for the test to wait before the first call setup. If the test does not establish a call within this time. and an additional three seconds. To copy the configuration file to the Diversity Voice Server without a connection 1. and in the save dialog box. call setup time [s] No connection timeout [s] 8. This amount cannot exceed the Window duration minus the Guard time. • • Connect the data cable to the PC and then connect the other end of the cable to the phone. Window duration [s] Use call duration Call duration [s] (Only if Use call duration is set to On) Pause duration [s] 1st call setup delay [s] Guard time [s] Select On to automatically disconnect the call after the call duration that you specify.2011 SwissQual AG Setting Description Enter the amount of time in seconds for the call window during which one more call setups can occur. Enter the amount of time in seconds to wait for a call to occur before the test stops. failed Enter the amount of time in seconds to wait after the test reaches the Max failed calls limit. select Yes. the call fails and the test proceeds to the next call. Specifies the number of consecutive failed calls after which a call reattempt is made. If you need to enable Bluetooth. The amount of time between two speech samples is 20 to 30 seconds is determined by the length of the reference sample. Copy the following B-Side device configuration file from your phone to your computer: C:\data\QualiPoc\DataTest\Jobs\VoiceServer\Job_123. see Manual QualiPoc SW . To manually start a double-ended Speech or Video Call test in QPAEngine 1.2011 SwissQual AG consult the manufacturer manuals for your phone and your computer. Copy the Job_123. This number is transmitted during the configuration call as in-band DTMF tones to identify the job that the Diversity Voice Server has to start.QualiPoc 10. B-Side. enter the Job ID from the Status view of the B-Side test. Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 12 . Monitoring a Speech or Video Call Test This section describes the events that you can monitor during a Speech or Video Call test. On the B-Side device. Starting a Double-Ended Speech or Video Call Test At the start of a Data Call test. In the Start Job view.ini file to the following location on the Diversity Voice Server: C:\Documents and settings\All users\Application data\SwissQual\Diversity\Tasks\ PreDefinedJobs Important: The three digit number in the filename must be unique on the server. The events in Table 2-5 are for A-Side. In the TID from BSide Job box.pdf. 2. and Call to any number speech and video call tests as well as Diversity Voice Server tests. select Options > Start a job > Choose from List > Speech Call. QualiPoc uses an adapted version of the Squad LQ algorithm to calculate the MOS of the speech samples that are received. Note: For a video call. QualiPoc opens a GPRS session through the access point that you configured for QPAEngine on the phone. the algorithm takes 5 to 15 seconds to calculate the MOS. select Options > Start a job > Choose from List > Speech Call. Depending on the processing power of the phone. a b c d In QPAEngine. start the A-Side test. 2. b c Select Call-MOS (B-Side) and select Start.Active Engine. and then select OK. Take note of the Job ID for the B-Side test in the Status view.6 Speech and Video Test Description © 2000 . select Yes. Select Call-MOS (A-Side) and select Start. On the A-Side device. a In QPAEngine.ini 3. select Video Call/Streaming. For information on how to configure an access point. start the B-Side test. Note: NQDI uses this ID to match the measurement files from both sides of the test when you import the files into the NQDI database. Transmitting a DTMF tone sequence to the Diversity Voice Server to select the BSide test. Indicates. The value displayed is the MOS value. Indicates a starting config call. SQuad failed: -20 (A-Side and B-Side speech tests only) SQuad failed: -30 (A-Side and B-Side speech tests only) SQUAD LQ: x. This tone is required if the voice server did not receive to the DTMF tones as some network operators filter out the DTMF tones in a call.QualiPoc 10. Recording of a sample starts. Indicates the beginning of the xx-th call window.6 Speech and Video Test Description © 2000 . as side x The phone was not able to establish a call to the B-Side within the specified time frame.2011 SwissQual AG Log View Figure 2-7 Log view for a Speech or Video Call test Table 2-5 Description of events in the Log view for a Speech or Video Call test Event ACK! B Side Connected Call terminated Cell_Id: 0x3933 Config Call (x) Connect Failed CONNECT! Create XXMF Tones > Dropped hh:mm:ss Cycle #xx MOC (outgoing) MTC (incoming) Playing DTMF Tones Rec.xx (A-Side and B-Side speech tests only) Signal recording is incomplete so the MOS analysis failed due to lost synchronization. Complete Rec. Creating a DTMF or SQMF sequence. Call lost due to some local or remote fault. Indicates correct connect information in a config call. Transmitting a SQMF tone sequence to the Diversity Voice Server to select the BSide test. A signal was not found during the recording and MOS analysis failed. Playing SQMF Tones Description Indicates correct acknowledge in a config call. Indicates a change of the serving cell with the new Cell Id in hex format.. Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 13 . Analysis of the speech sample was successful. that the phone was able to establish a call to the B-Side. Denote the direction of the calls inside this call window. A call has been locally terminated due to the job parameters.. A complete speech sampled has been recorded and is now ready to be analyzed. Signal recording is incomplete so the MOS analysis failed due to lost synchronization. Such a scenario can occur if the samples finish playing and recording before the call duration expires. Xx indicates the type and digits that were found.6 Speech and Video Test Description © 2000 . QPControl forces a stop. Analysis of the speech sample was successful. QPAEngine plays a "stop" reference sample instead of a speech sample. Upon receipt of the "stop" sample. Stopping a Call to a Diversity Voice Server without a Connection If you stop a test on the phone that involves the Diversity Voice Server. the voice server component of the test automatically stops. A signal was not found during the recording and MOS analysis failed. A multi-frequency code that is used for recording synchronization has been detected. The voice server restarts the task after the test duration expires or when you start a new configuration call. and then exits the test.2011 SwissQual AG Event SQUAD… (A-Side and B-Side speech tests only) Synch: xxMF-xx. (A-Side and B-Side speech tests only) VMON failed: -20 (Video Call on Nokia N80 only) VMON failed: -30 (Video Call on Nokia N80 only) VMON LQ: x. Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 14 . The value displayed is the MOS value.QualiPoc 10. Analysis of the speech sample has started. Important: If QPControl in advanced mode cannot end the current cycle and play the "stop" sample within 50 seconds.xx (Video Call on Nokia N80 only) VMON… (Video Call on Nokia N80 only) Description Analysis of the speech sample has started. Chapter 3 | Configuring a Speech or Video Call to Any Number Test CONFIDENTIAL MATERIALS 15 .6 Speech and Video Test Description © 2000 . you can select the job. You only need to configure the test on the A-Side device. Although you do not need a dedicated B-Side device. and then select OK. enter a name for the job. Figure 3-2 Main settings for a Call to any number test Table 3-1 Description of the settings in the main Job Edit view for a Call to any number job Setting Job Name General settings Tests b Description Name of the test Specifies the duration. cycle. To manually create a Call to Any Number test 1. and then select Options > Edit. Figure 3-1 Creating a new Call to any number test 2. Tip: If the view contains an existing job. Specify the basic job settings. Start QPAEngine on the phone and select Options > Job handling > Speech Call > Call to any number. Select an existing test or create a new test Select Job Name.QualiPoc 10. select Options > Job handling > Video Call/Streaming.2011 SwissQual AG 3 Configuring a Speech or Video Call to Any Number Test This section describes how to manually configure a Speech or video Call to Any Number test in the QPAEngine software on your phone. the device that receives the call must be able to answer the call and hold the connection until the ASide phone terminates the call. a Select Options > Create new. The Call to Any Number test does not perform a speech quality assessment. and timings for the test. select Options > Duplicate. Note: For a video call. Select General settings. Select Tests. 7. Chapter 3 | Configuring a Speech or Video Call to Any Number Test CONFIDENTIAL MATERIALS 16 . and then select Back. specify the timing options for the test. call windows. Enter the maximum number of cycles.QualiPoc 10. and then select OK. Enter the amount of time in seconds 4. that is. connect timeout Enter the amount of time in seconds to wait between test cycles. Figure 3-3 General settings for a Call to any number test Table 3-2 Description of the General settings for a Call to any number test Setting Duration Cycles Description Enter the maximum measurement time for the test after which the test automatically stops. and in the save dialog box. 8. Starting a Call to Any Number Test At the start of a Data Call test. select Yes. For information on how to configure an access point. 5.6 Speech and Video Test Description © 2000 . Select Number. see Manual QualiPoc SW . Note: If you specify a maximum number of cycles and a maximum duration. the test stops when one of the maximum values is reached. QualiPoc opens a GPRS session through the access point that you configured for QPAEngine on the phone. and then select Options > Add > New Test. Pause between cycles Max. To disable this feature. Select Duration. for the test.pdf. Figure 3-4 Main settings for Call to any number test 6. and then select OK. enter 0. enter 0.Active Engine. Select Options > Change. Select Back. enter the amount of time for the call in seconds. enter the phone number to call. To disable this feature.2011 SwissQual AG 3. see the "Monitoring a Speech or Video Call Test" section on page 12. Chapter 3 | Configuring a Speech or Video Call to Any Number Test CONFIDENTIAL MATERIALS 17 .2011 SwissQual AG To manually start a Call to any number test in QPAEngine 1. Monitoring a Call to Any Number Test For a description of the events that you can monitor during a Call to any number test. 3. Call to any number. Note: For a video call.QualiPoc 10.6 Speech and Video Test Description © 2000 . for example. select Video Call/Streaming. Select Options > Start a job > Choose from List > Speech Call. Select a test category in the list. Select a test in the list and then select Start. 2. objective measures for LQ are limited at 4. which indicate that the signal to be measured is identical to the used reference signal. Listening Quality on a five-point MOS (Mean Opinion Score) scale. used for the MOC:MTC Ratio in the Intrusive Job timings TestManager Public Switched Telephone Network QualiPoc Active Engine Universal Mobile Telephone System Waveform audio format Table A-1 Description of abbreviations Abbreviation DTMF GSM IP ISDN IVR LQ MOC MOC-only MOS MTC NQTM PSTN QPA UMTS WAV Appendix A | Abbreviations CONFIDENTIAL MATERIALS 18 .6 Speech and Video Test Description © 2000 .QualiPoc 10. Mobile-Originated Call (synonym for the calling side). By practical reasons.2011 SwissQual AG A Abbreviations Description Dual-tone multi-frequency Global System for Mobile Communications Internet Protocol Integrated Services Digital Network Interactive Voice Response is an interactive technology that allows a computer to detect voice and keypad inputs.5. the value ‘5’ means ‘excellent’. used for the MOC:MTC Ratio in the Intrusive Job timings This is indicated if the MOC:MTC Ratio in the Intrusive Job timings is set to 1:0 Mean Opinion Score. The value ‘1’ refers to bad quality. Value of the listening quality Mobile-Terminated Call (synonym for the call terminating side ).