Beruflich Dokumente
Kultur Dokumente
QualiPoc
Fig. 4-1: Answering station single CALL job Table 4-1: Description of the settings for an Answering station single CALL job Setting "Algorithm" "Reference File" Description Evaluates speech quality on the calling side. Reference file for speech quality evaluation
25
SwissQual...QualiPoc
Fig. 4-2: Call to Any Number single CALL job Table 4-2: Description of the settings for a Call to Any Number single CALL job Setting "Phone number" "Call duration" "Number of cycles" Description Number that you want to call Duration of the call in seconds Number of times to repeat a single test before the job ends
26
SwissQual...QualiPoc
Fig. 4-3: Speech MOC DL single CALL job Table 4-3: Description of the settings for Speech MOC single CALL job Setting "Phone number" "Call duration" "Max call setup time" "Algorithm" "Reference File" "Wave file options" Description Number that you want to call Duration of the call in seconds Maximum waiting time for the call to be set up Algorithm to evaluate speech quality Reference file to play for speech quality evaluation Options for recording wave files during the test
For speech quality tests, you can use the SQUAD08 or POLQA (P.863) algorithm.
You need a valid QualiPoc Android license for the algorithm that you want to use.
27
SwissQual...QualiPoc
Fig. 4-4: Speech Double Ended job settings Table 4-4: Description of the settings for a Speech Double Ended Job Setting "Side" "Call direction" Description Side of the call, that is, A or B-side "A-side to B-side", "B-side to A-side", or "Alternating Call Sequence" In Diversity, the call direction is in MOC:MTC format, that is, 1:0 for A to B, 0:1 for B to A, and 1:1 for the "Alternating Call Sequence". "Phone Number" "Advanced settings" "Number of cycles" "Job Name" Number that you want to call Specify call timings, algorithm, and sample Number of times to repeat a single test before the job ends Name of the job Diversity ignores this name. "Timing and Scheduling" "Speech Double Ended" Settings to configure the duration of the job. The window timings are compatible with Diversity. Specify the settings for the Speech Double Ended job
28
SwissQual...QualiPoc
Description From A to B, B to A, or Half-Duplex Select the algorithm to calculate quality scores, namely POLQA or SQuad08. Speech sample to use for the call. You need to re-select the reference file when you change the algorithm. QualiPoc reference files do not have the same names as Diversity reference files.
QualiPoc to QualiPoc or with the stop call option where the phone operates as an autonomous B-side answering station. Do not enable this option if the job involves a call to a Diversity unit.
Unlike the job name, the value that you enter is transferred to a Diversity unit during the call. Plays a sample each time that the interval that you specify elapses
For more information, see chapter 4.4.2, "Creating and Running the Job on a QualiPoc Phone", on page 30. QualiPoc Android to Diversity Call Server (PSTN/ISDN): Add and configure the Diversity voice call server in NQView. For more information, see chapter 4.4.3.1, "Creating a Voice Call Server in NQView ", on page 38. Export the configuration of the voice call server from NQView and import the configuration on the voice call server. Manually configure the job on the QualiPoc phone. For more information, seechapter 4.4.2, "Creating and Running the Job on a QualiPoc Phone", on page 30. Add the QualiPoc phone as a mock voice call server in NQView. For more information, see chapter 4.4.3.1, "Creating a Voice Call Server in NQView ", on page 38. Manually create the task in NQView, export the B-side task configuration file, and import the file on the voice call server. For more information, see chapter 4.4.3.2, "Creating the Speech Double Ended Measurement Task in NQView", on page 41. Manually start the job on the QualiPoc phone. For more information, see chapter 4.4.2.1, "Starting the Job on the QualiPoc Phone", on page 37. The QualiPoc phone must be the A-side device.
Diversity Android Smartphone without an MCM/PSM to QualiPoc Android: Add and configure the Diversity smartphone . For more information, see the Manual NetQual NQView.pdf document.
29
SwissQual...QualiPoc
Manually configure the job on the QualiPoc phone. For more information, see chapter 4.4.2, "Creating and Running the Job on a QualiPoc Phone", on page 30. Some Diversity settings are slightly different than the QualiPoc counterparts. In such cases, consult the setting information in the paragraph below the relevant step.
Diversity Android Smartphone without an MCM/PSM to QualiPoc Android: Add the QualiPoc phone as a mock DTMF voice call server in NQView. For more information, see chapter 4.4.3.1, "Creating a Voice Call Server in NQView ", on page 38. Create the measurement task in NQView with the Diversity smartphone as the A-side device and the QualiPoc phone, that is, the mock DTMF voice call server, as the B-side device. For more information, see chapter 4.4.3.2, "Creating the Speech Double Ended Measurement Task in NQView", on page 41. Manually start the job on the QualiPoc phone. For more information, see chapter 4.4.2.1, "Starting the Job on the QualiPoc Phone", on page 37. Start the measurement task in NQView. For more information, see chapter 4.4.3.3, "Starting the Measurement Task in NQView", on page 43. A Diversity smartphone only supports the DTMF job transfer method. The Diversity smartphone must be the A-side device and the QualiPoc Android phone must be the B-side device.
Diversity Smartphone in an MCM/PSM to QualiPoc Android: Same as the Diversity Android Smartphone without an MCM/PSM to QualiPoc Android scenario except that you need to include an MCM in the NQView hardware configuration
30
SwissQual...QualiPoc
b) Touch "Selected phone number > Add new", enter the number for the A-side phone, and then touch "OK".
3. Touch "Advanced settings > Job name", enter a name for the job, and then touch "OK".
4. Specify the timing settings for the job. a) Touch "Timings and Scheduling".
31
SwissQual...QualiPoc
b) Touch "Duration", enter a value, and then touch "OK". For a test that involves a Diversity unit, enter the same duration as you did in figure 4-16 for the measurement task in NQView. c) Touch "# of Cycles", enter a value, and then touch "OK". For a test that involves a Diversity unit, enter the same duration as you did in figure 4-16 for the measurement task in NQView.
d) Touch "Pause time", enter a value and then click "OK". This setting is only available in QualiPoc and must be 0 if the test involves a Diversity unit.
32
SwissQual...QualiPoc
e) Touch "Window Timings" and use the timings picker at the top left to select the setting that you want to change, and then use the value picker at the top right to select the new value. For a test that involves a Diversity unit, specify the same Window timings as you did in figure 4-17 for the intrusive job in NQView.
f)
Press Back
5. Specify the test settings. a) On the "Job settings" screen, touch "Speech Double Ended" in the "Test" area.
33
SwissQual...QualiPoc
b) Touch "Selected call direction" and touch the call direction. For a test that involves a Diversity unit, the call direction is the "MOC:MTC" ratio in figure 4-17 that you specified for the intrusive job in NQView. For a "MOC:MTC" ratio of 1:0, touch "Call A to B", for a "MOC:MTC" ratio of 0:1, touch "Call B to A", and for "MOC:MTC" ratio of 1:1, touch "Alternating Call Sequence".
34
SwissQual...QualiPoc
c) Touch "Selected sample direction", and then touch an option in the list. Unlike in Diversity, the half-duplex option in QualiPoc always starts with a B to A sample direction and then alternates the sample direction. Furthermore, unlike in Diversity, you cannot specify the number of samples that a QualiPoc job uses. However, QualiPoc always evaluates the reference samples that the phone receives. For a test that involves a Diversity unit, ensure that the sample direction that you selected in figure 4-18 for the test in NQView reflects these limitations.
35
SwissQual...QualiPoc
d) Touch "Selected algorithm" and touch one of the following options. "SQuad08": for a "Speech" test "SQuad08 (WB)": For a "Speech-Wideband" test "POLQA": For a "Speech POLQA" test "POLQA (WB)": For a "Speech-Wideband POLQA" test
For a test that involves a Diversity unit, touch the algorithm that you selected in figure 4-18 for the test in NQView.
e) Touch "Selected reference file" and touch a sample file for the test. For a test that involves a Diversity unit, use same reference sample that you selected in figure 4-18 for the test in NQView, for example, "English (U.S.) IRS" for the AM_fm_IRS.wav reference sample.
36
SwissQual...QualiPoc
f)
Touch "Sample frequency", enter one of the following sample frequencies, and then touch "OK": 12.5: For tests that use the "SQuad08" and POLQA algorithms. The sample frequency is the time difference between the start times of the two subsequent samples. A sample frequency of 12.5 seconds in QualiPoc corresponds to the combined 6 second "Record hang-over" that you specified in figure 4-18 in NQView and the 6.5 second duration of the SwissQual reference samples. 20: For tests that use the "SQuad08 (WB)" and "POLQA (WB)" algorithms. QualiPoc on slower phones requires the longer time to calculate the MOS results in a wideband Speech Double Ended measurement job.
g) Touch "Selected wave file option" and touch an option. 4.4.2.1 Starting the Job on the QualiPoc Phone
To start the job, press Menu , touch "Jobs", ensure that the Speech Double Ended job is loaded, and touch "Start job". To load the job, press Menu , touch "Load job", touch "Speech Double Ended", and touch the job that you created.
37
SwissQual...QualiPoc
4.4.2.2
Stopping the Job on the QualiPoc Phone The B-side QualiPoc device handles a stop command from the Diversity A-side device in the following ways: Stop command arrives during a configuration call: QualiPoc restarts the measurement job into waiting for configuration mode and does not save a measurement file Stop command arrives during a normal call: QualiPoc stops the measurement job and saves a measurement file. Stop command arrives during a pause in a normal call: Job continues to run until the timeout is reached Stop command does not arrive: If the call has already been configured and the test is running, the call runs indefinitely; however, if you restart the measurement task in NQView and QualiPoc is configured to receive the call, then QualiPoc restarts the job on the phone after the configuration call.
4.4.3.1
Creating a Voice Call Server in NQView This section describes how to configure a physical Diversity voice call server with PSTN or ISDN cards in NQView as well as a mock Diversity voice call server. The mock call server represents the QualiPoc unit when you configure a mixed environment Diversity and QualiPoc speech double ended task in NQView. For the Diversity smartphone to QualiPoc phone scenario, the following sections assume that have already configured the Diversity smartphone for the test. For the QualiPoc to Voice Call Server scenario, the following procedure assumes that you have already installed the ISDN or PSTN devices and the respective Windows drivers on the PC that hosts the voice call server. To create a mock voice call server in NQView 1. On the Navigation panel of the "Control" console, click "System configuration". 2. Add a PC unit.
38
SwissQual...QualiPoc
b) Type a "Name" and "Computer name" for the unit, for example, QPAndroid.
c) In the "Time synchronization" list, click "Internal sync". d) In the following lists, click "No connection/DTMF": "NQComm control" "Unit control" "Job transfer send" "Job transfer listen" e) Click "Apply" and click "OK".
39
SwissQual...QualiPoc
3. Create a subscriber profile for the phone device or PSTN or ISDN card. a) Click "System configuration" on the Navigation panel and click the plus sign (+) beside "Subscriber and access points". b) Click the plus sign (+) beside an operator in the tree, right-click a provider, and then click "Add subscriber". c) Add the subscriber information, click "Apply", and then click "OK". 4. Add the QualiPoc phone or the PSTN or ISDN card as device to the DTMF voice call server. a) Right-click the unit in the tree, point to "Add device", and then click the type of device, for example "Mobile" for a QualiPoc phone or "ISDN" for a Diversity device. b) Type a name for the phone. c) In the "Model" list, click the type of phone or ISDN or PSTN model. d) In the "Subscriber" list, click the profile that you created in the previous step. If you are creating a mock call server for a QualiPoc phone, the subscriber number is the only value that needs to be identical to the QualiPoc setting. e) Click "Apply" and click "OK".
5. Transfer the configuration to the voice call server PC. You do not need to perform this action for the QualiPoc mock voice call server. For a description on how to transfer the configuration to the voice call server, see chapter B, "Configuring Voice and Video Call Servers", on page 108.
40
SwissQual...QualiPoc
4.4.3.2
Creating the Speech Double Ended Measurement Task in NQView The following procedure assumes that you have already configured the Diversity device involved in the test, for example, the Diversity smartphone. To define the Speech Double Ended measurement task in NQView 1. On the Navigation panel of the "Control" console, click "Tasks and Jobs", right-click "Measurement task" in the tree, and then click "Add task". 2. Type a name for the task.
3. In the "Device A/B side" area, select the A-side and B-side devices.
Scenario A-Side Device B-Side Device Diversity call server (PC) QualiPoc phone (mock call server) QualiPoc phone (mock call server)
QualiPoc to Diversity Call Server QualiPoc phone (mock call (PSTN/ISDN) scenario server) Diversity Android Smartphone without an MCM/PSM to QualiPoc Android Diversity Smartphone in an MCM/PSM to QualiPoc Android scenarios Diversity Android Smartphone
4. Add a measurement job to the task Important: You need to use the same job settings that you manually specified on the QualiPoc phone in chapter 4.4.2, "Creating and Running the Job on a QualiPoc Phone", on page 30. a) In the "Job sequence" area, click the green plus sign .
41
SwissQual...QualiPoc
c) In the "Name" box, type a name for the job in the following DTMF job transfer format: job_xyz d) In the "Record hang-over [ms]" box, type 6000. QualiPoc does not have a hang-over recording setting. Instead, you need to specify a "Record Hang-Over" value of 6000ms and a "Test Repetition Sequence" of 11 in NQView. e) In the "MOC:MTC ratio" box, specify the call direction, for example, 1:1. QualiPoc does not use the MOC:MTC ratio to define the call direction, but rather uses A-side and B-side. As a result, a MOC:MTC ratio of 1:0 corresponds to the A to B call direction setting in QualiPoc and a 0:1 ratio corresponds to B to A. However, the MOC:MTC ratio of 1:1 corresponds to the"Alternating Call Sequence" call direction in QualiPoc. f) In the "Timings" area, select "Use call duration to abort call". If you do not enable this option, the measurement task will not run correctly g) Specify the remaining timings, click "Apply", and then click "OK". 5. In the "Intrusive test" window, specify the settings for the speech test. a) Type a name for the test.
42
SwissQual...QualiPoc
b) In the "Test type" list, click one of the following types: "Speech" "Speech POLQA" "Speech-Wideband" "Speech-Wideband POLQA" c) In the "Direction" area, click a direction for the reference sample. You need to select the same direction for all of the reference samples that you use. Samples with alternating directions must start with a B to A direction; otherwise NQView does not accept the configuration on the task level. d) In the "Reference sample" list, click the speech sample that you want to use. e) In the "Save WAV files" area, click an option. f) Click "Apply" and then click "OK"
6. In the "Job details in task" window, click "Save". 7. In the "Measurement task" window, specify the "Duration" and the number of "Cycles" for the task. 8. Click "Apply", and then click "OK". Note: For a description on how to transfer the task configuration to a Diversity voice call server, see chapter B, "Configuring Voice and Video Call Servers", on page 108. 4.4.3.3 Starting the Measurement Task in NQView This section describes how to start the Speech Double Ended Measurement in NQView and on the QualiPoc phone. To start the measurement task on NQView 1. On the "Control" console in NQView, click "Tasks and Jobs". 2. Click the "Tasks" tab in the workspace. 3. Click the green arrow in the "Start" column in front of the task that you created.
43
SwissQual...QualiPoc
Fig. 4-19: Capacity DL single DATA job Table 4-5: Description of the settings for a Capacity DL single DATA job Setting "URLs" "Advanced Settings" "Number of cycles" Description HTTP address of the site that you want to download Specify advanced timeouts and test options Number of times to repeat a single test before the job ends
Ensure that the total download size of the reference files is large enough to last for the duration of the test.
44
SwissQual...QualiPoc
Fig. 4-20: Email Send single DATA job Table 4-6: Description of the settings for a Email Send and Receive single DATA job Setting "Outgoing and Incoming mail server" "Advanced Settings" "Number of cycles" Description Address of the email serve Specify advanced timeouts and test options Number of times to repeat a single test before the job ends
45
SwissQual...QualiPoc
To add the port number, type a colon (:) at the end of the address, and then type the port number. Only QualiPoc Handheld uses this number.
Table 4-7: Description of the settings for FTP DL and UL single DATA jobs Setting "File" "Credentials" "Advanced Settings" "Number of cycles" Description Name of the remote file that you want to download Login credentials for the FTP server Specify advanced timeouts and test options Specify the number of times to repeat a single test before the job stops
46
SwissQual...QualiPoc
Fig. 4-22: HTTP Browser single DATA job Table 4-8: Description of the settings for an HTTP Browser single DATA job Setting "URL" "Advanced Settings" "Number of cycles" Description HTTP address of the site that you want to browse Specify advanced timeouts and test options Number of times to repeat a single test before the job ends
47
SwissQual...QualiPoc
Fig. 4-23: HTTP Transfer DL and UL single DATA jobs Table 4-9: Description of the settings for HTTP Browser Transfer DL and UL single DATA jobs Setting "Host address" "File" "Credentials" "Advanced Settings" "Number of cycles" Description IP address of the host Name of the remote file that you want to download Login credentials for the HTTP server Specify advanced timeouts and test options Number of times to repeat a single test before the job ends
48
SwissQual...QualiPoc
2. Touch "Selected server address", touch "Add new", enter the name of the server, and then touch "OK". 3. Specify the test settings. a) Touch "Iperf" in the "Test" area. b) To add a command-line setting, touch "Selected additional parameters", enter the setting, and then touch "OK".
49
SwissQual...QualiPoc
Note: To view the list of available parameters, touch "Full arguments list".
For the l and w, K or M parameters, suffixes are required, for example, l 8K, or w 512K. QualiPoc supports the UDP protocol and automatically adds the u parameter.
50
SwissQual...QualiPoc
Fig. 4-26: Iperf log with the client report outlined in red
The client report in the Iperf log has the following fields: 20130104135043 date/time 10.105.30.236 sender IP address 34548 sender port (UDP) 82.220.1.20 receiver IP address 5001 receiver port 4 ID 1.0-2.0 Interval in seconds 132300 data transferred in Bytes 1058400 bandwidth in bits/s
The final report datagram from the client and server has a total of 14 fields, 9 from the client report, and the following 5 fields: 6.429 Delay jitter 10 quantity of lost packets 893 quantity of received packets 1.120 lost packets in % 0 quantity of packets out of order
51
SwissQual...QualiPoc
Fig. 4-27: Ping single DATA job Table 4-10: Description of the settings for a Ping job Setting "Host" "Number of pings and interva" "Packet size and timeout" "Advanced Settings" "Number of cycles" Description IP address of the host Number of pings and interval between pings in milliseconds Enter the packet size in bytes and the timeout for the ping in seconds Specify advanced timeouts and test options Number of times to repeat a single test before the job ends
52
SwissQual...QualiPoc
To create an Upload measurement job 1. Press Menu Upload". and touch "Jobs > Selected job type > Single DATA tests >
b) In the "Result files upload connection profile" area, touch "Select connection type". c) Touch a connection type in the list, for example, "FTP" or "HTTP". d) Touch "Select host", enter the URL for the server, and then touch "OK". e) Select active or passive mode. 3. Specify the login information for the server. a) Touch "Select user name", enter an account name, and touch "OK". b) Touch "Password", enter the password for the account, and touch "OK". 4. Specify the remaining settings, for example, enable the "Auto upload" and "Auto compression" options.
53
SwissQual...QualiPoc
Measurement Job Types Single MESSAGE Job MMS Send and Receive
54
SwissQual...QualiPoc
Measurement Job Types Single MESSAGE Job SMS Send and Receive
Fig. 4-30: MMS Send MESSAGE job Table 4-11: Description of the settings for MMS Send and Receive single MESSAGE jobs Setting "Receiver number" "Advanced Settings" "Number of cycles" Description Number of the receiver Specify advanced timeouts and test options Number of times to repeat a single test before the job ends
55
SwissQual...QualiPoc
Fig. 4-31: SMS Send MESSAGE job Table 4-12: Description of the settings for SMS Send and Receive single MESSAGE jobs Setting "Receiver number" "Advanced Settings" "Number of cycles" Description Number of the receiver Specify advanced timeouts and test options Number of times to repeat a single test before the job ends
56
SwissQual...QualiPoc
You cannot use copyrighted videos or videos that have had embedding disabled.
The YouTube No Reference job supports the following link types: Full address http://www.youtube.com/watch?v=-UaMoP-D1VY ID only -UaMoP-D1VY Mobile site m.youtube.com/watch?v=-UaMoP-D1VY Short address youtu.be/watch?v=-UaMoP-D1VY
You can also share a link from the Android YouTube application with QualiPoc.
57
SwissQual...QualiPoc
58
SwissQual...QualiPoc
59
SwissQual...QualiPoc
4. Add a job to the sequence. a) In the "Job Quick Start Settings" area, touch "Job Sequence contains". b) In the "Select Job Group" list, touch a group that contains a job that you want to include, for example, "Single DATA job".
60
SwissQual...QualiPoc
c) In the "Select Job Type" list, touch the type of job that you want to include, for example, "FTP DL". The Answering Station single CALL Job is not available. d) In the "Select a job file" list, touch a job, for example, "LastJobFTPDL.xml".
Note: If you touch "Add new", see chapter 5.3, "Creating and Running Basic Jobs", on page 65 or chapter 5.4, "Creating and Running Advanced Jobs", on page 66. You can only specify the number of cycles and test duration "Timings and Scheduling" options for the individuals. 5. Press Back and on the "Job Sequence" screen, press Menu job" to add an additional job. Note: Repeat this step for each additional job. 6. To start the "Job Sequence", press Back , and touch "Start Job". and touch "Add
61
SwissQual...QualiPoc
Fig. 4-39: Advanced settings Setting "Timings and scheduling" Description Time and date on which to start the job, the number of repetitions for the job, and the related timings, for example, duration of the job, pause between the tests, and so on Settings that are related to the job Network access point for the job Include the PCAP information to the measurement file
62