Sie sind auf Seite 1von 23

Landslide® 16.

8 Release Notes

This document contains the latest technical information that is not included in the product’s user
documentation. Please read this document carefully.

WARNING – As of the 16.6 release, Landslide no longer supports TAS and Test Servers running the
Ubuntu 9.10 operating system. Contact Spirent support for further information and assistance.

WARNING – Before downgrading a TAS to any release prior to 16.0, you must first downgrade the TAS
to 15.7.1.4. Failure to do so will result in rendering your TAS inoperable. Contact Spirent support for
access to the 15.7.1.4 software as needed.

WARNING - For users of C100 hardware running the 14.04 Ubuntu OS with L-NIC-27s:
Once you have upgraded to the 14.0.0.26 TS or beyond, extra steps are required to downgrade to
14.0.0.25 or prior (including 13.5 or 13.3). To downgrade to any TS software version below 14.0.0.26
(13.3, 13.5 or 14.0 engineering) without harming the L-NIC-27, you must first downgrade to 13.5.1.28+
or 13.3.1.25+ as an intermediate step. Failure to do so may result in rendering one or more L-NIC-27
cards inoperable.

WARNING - For users with L-NIC-27s:


Do not reboot or power cycle a test server that is being upgraded from 14.0.0.25 or prior (including 13.5
or 13.3). The time required to upgrade the system may be increased by 5 to 10 minutes per L-NIC-27 in
cases where the firmware is being updated. If this firmware update process is interrupted in any
fashion, the L-NIC-27 being updated may be rendered inoperable.

Notes:
• Landslide users should always back up their TAS database during the upgrade procedure. It is strongly
recommended that this backup be saved to a local drive (not the TAS hard drive) where it can be used to
restore a system to a previous state if needed.
• See the Behavior Differences section for important information regarding systems that are licensed for
the Performance and Data Accelerator features.
• As of Landslide 14.0 GA, the Landslide Manager’s (TAS) required Java version is 1.8. The Java upgrade is
provided in a file named JRE1.8.0_40_Upgrade.upg and is upgraded with the TAS manager in the same
manner as a normal upgrade file. The Client machine must also be upgraded to Java version 1.8 or later
after the TAS upgrade. If the Landslide Client memory is configured to use > 1G (default is 512M), then
it is recommended to download JRE1.8.0_111 or later from www.java.com.
• As of Landslide 15.2 GA, all communication and file transfers between the TAS client, TAS and Test
Servers has been made secure using SSH and SCP. This will require that Port 22 be open for all
communications between the TAS Client, TAS and Test Servers.

P/N 77-005666 Rev. A, 5/18 Page 1 of 23


Landslide 16.8 Release Notes

This document contains the following sections:

Section Description

Contents of Release Lists the hardware, software, and documentation


included in this Landslide shipment

Supported Hardware and Software Lists the hardware, software, platforms, and protocols
supported by Landslide

New Features Lists the new features in Landslide 16.8

Bug Fixes Lists all bugs fixes between Landslide 16.8 and the
previous version

Behavior Differences Lists any behavior differences between Landslide 16.8


and the previous version

API Compatibility Changes Lists any changes to Tcl API commands between
Landslide 16.8 and the previous version

Limitations Lists the limitations of Landslide 16.8

Known Problems Lists any known problems in Landslide 16.8

Additional Information Indicates other important information that you need to


know to operate Landslide

Contacting Spirent Communications Information on how to contact Spirent Communications


for technical support

P/N 77-005666 Rev. A, 5/18 Page 2 of 23


Landslide 16.8 Release Notes

Contents of Release
This release of Landslide includes the following software and documentation. For information on the
hardware and software that Landslide supports, see “Supported Hardware and Software.”

Software Version
Ubuntu Linux 14.04 / 14.04A / 14.04B
Landslide 16.8
Landslide Manager 16.8.0.11
Landslide Test Server 16.8.0.14
Test Suites 16.8.0.14

Documentation Revision
Spirent Landslide Test System Installation Guide 71-008465 Rev A
Landslide Test Server NIC Configurations 71-008430 Rev A
Landslide Tcl API Object and Perform Function Reference 71-008467 Rev A
Landslide RESTful Programmer’s Reference 71-008468 Rev A
Landslide Virtual Machine Installation Instructions 71-008470 Rev A

P/N 77-005666 Rev. A, 5/18 Page 3 of 23


Landslide 16.8 Release Notes

Supported Hardware and Software


Landslide 16.8 supports the following hardware, software, platforms, and protocols:

The following Landslide platforms are supported:


• Landslide C100-M4
• Landslide C100-S4
• Landslide C100-M2
• Landslide C100-S2
• Landslide C100 (TAS Only)
• Landslide C50-S4
• Landslide C50
• Landslide E10
• Landslide Virtual
The following are hardware requirements for the Landslide Client:
• Minimum 1.5 GHz processor; 3.0+ GHz single-core or 2.0+ multi-core processor recommended
• Minimum 512 MB RAM; Recommended 2 GB RAM
• Minimum 50 MB available disk space; 200 MB recommended (excluding saved reports)
• 10/100Base-T Ethernet connection
• Video adapter with at least 16 MB RAM, supporting a screen resolution of at least 1024 x 768 or
higher
• 100MB/1G Ethernet connection to the LAN
The following are software requirements for the Landslide Client:
• Test system web pages are best viewed with the latest version of Internet Explorer, Firefox or
Chrome

• TEX (Test Execution) Web Client is best viewed with the latest version of Chrome
• JavaScript and Java Web Start must be enabled in the browser

• Popup blockers should be disabled before starting


• Cookies should be allowed, if you want your memory settings to be saved
• Java 8 (1.8.0) or later is required for the Landslide client

• Java™ Runtime Environment 1.8.0 (Windows and Linux versions are supplied with the system;
other versions can be downloaded from http://java.sun.com/j2se/downloads.html)

P/N 77-005666 Rev. A, 5/18 Page 4 of 23


Landslide 16.8 Release Notes

New Features
Landslide 16.8 includes the following new features:

• Data - Added an option to Use DNS Address in PCO in the DNS Query pane of the DMF Editor.
• Data - Added DMF support for DNS Testing. (New DNS Protocol / New underlying protocol and
new DNS Pane)
• Data - Added Fireball support for the local network host on IP Application Node.
• Data - Added support for a new Separate Transaction Rate for Target Network configuration for
Basic, Advanced and Lite DMFs.
• Data - Added support for additional data message flow fields in the test data file. (Search for
data_message_flow_tdf_modifications.pdf in the online help for additional information.)
• Data - Added support for HTTP packet retransmission when using Fireball HTTP.
• Data - Added support for the External Applications (HTTP Client, SpeedTest and Traceroute) to
be run on the C100-M4 and C50-S4 platforms.
• Data - Added the ability for Fireball HTTP to work with other Fireball DMF types (UDP / TCP).
• Data - Added the ability to override the SpeedTest and DNS servers in all supported test cases.
• Data - Added VLAN support for Fireball data.
• Data - Increased the maximum configurable transaction rate for Fireball DMFs to 1 Million to
enable the ability to run 25G with a single subscriber on the NIC-73 / 74.
• Data - Increased the maximum URL length on the HTTP Client from 256 to 512 characters.
• HSS Node - Added support for 5G NSA settings.
• HSS Node - Increased the UE-Usage-Type range. Previously the range was from 128 - 255. The
updated range is now 0 - 255.
• HSS Node / PCRF Node - Added TDF support for IMSIs when running with real handsets.
• IMS - Added initial support for Mission Critical Push to Talk. Available in IMS Node, MME Nodal,
PGW Nodal and SGW Nodal.
• IMS - Added support for E911 Call Preemption on the SGW Nodal test case.
• IMS - Added support for R14 AVPs on the Rx Interface.
• IMS - Added support for the Late SDP Offer feature when running IMS Proxy mode.
• IMS - Added support for WebRTC load testing in the IP Application Node, MME Nodal and
Network Host test cases. (16.8 only supports up to a maximum of 50,000 sessions)
• IMS Nodal - Added support for TAS and SCC-AS Application Server Testing and Emulation.
• IMS Node - Added support for Back-to-Back User Agent (B2BUA) mode when ISC Interface is
enabled.
• IPSec - Added support for a maximum of 2 L-ACC-007 IPSec Accelerator cards for the C100-M4
platform.
• IPSec - Added the ability to include IKE keys in the InfoReport when IPSec is enabled.
• Measurements - Added SpeedTest and HTTP Client measurements to the MME Nodal, SGW
Nodal, PGW Nodal, Wifi Offload Gateway Nodal and IP Application Node test cases.
• Measurements - Added Trace Route Latency measurements to the MME Nodal, SGW Nodal,
PGW Nodal, Wifi Offload Gateway Nodal and IP Application Node test cases. Also added PROC
support for the same measurements for the MME Nodal and PGW Nodal test cases.
• MME Nodal - Added support for a configurable option to create multiple default bearers in the
Attach procedure.
• MME Nodal - Added support for multi-link SCTP with MME Pooling.

P/N 77-005666 Rev. A, 5/18 Page 5 of 23


Landslide 16.8 Release Notes

• MME Nodal - Increased the SIP Register maximum Number of Retries from 5 to 1000.
• MME Nodal - Modified labeling for 5G Dual Connectivity feature for clarity. (See Behavior
Differences section for details)
• MSC Node - Added support for SGsAP Option 2 as defined in TS29.118.
• PGW Nodal / SGW Nodal - Added support for per-bearer subtotal measurements for S11 and S5
GTPv2.
• PGW Nodal / SGW Nodal - Added the ability to include IP address allocation via NAS Signaling in
the Protocol Configuration Options pane of the GTPv2 tab.
• PGW Node / SGW Node - Added additional mobility support as well as the ability to select PFCP
version (14.1.0 or 14.2.0).
• PGW Node / SGW Node (CUPS) - Added support for precedence in TFT settings for CUPS
configuration.
• PGW Node / SGW Node (CUPS) - Added the ability to add the SDF (Service Data Flow) to the PDR
(Packet Delivery Ratio) in the Sx Session Establishment Request.
• PGW Node / SGW Node (CUPS) - Added the ability to configure separate QoS for each SDF
(Service Data Flow) within the same bearer.
• PGW Node / SGW Node (CUPS) Added the ability to configure QoS Gating Status in the QER (QoS
Enforcement Rule) IE.
• Real Handset - Added RTP throughput calculation for VoLTE on real handsets. Also added PROC
file support for this data.
• Real Handset - Added support for SMS, MMS, and Email on LTE.
• RESTful API - Added support for overriding test session level parameters from the RESTful API.
(Refer to the Landslide RESTful Programmer’s Reference for additional details.)
• SGW Nodal - Added several new parameters to the SGW Nodal Info-Tab.
• SGW Nodal - Added support for SGW Anchoring when using APN DNS Lookup.
• SGW Nodal - Added the ability to send ULI IE in the Modify Bearer Request during handovers.
• TAS / TS - Added the ability to enable and configure a VPN for TAS - TS communication.
• TS - Added the option to disable IPv6 Router Advertisement messages per IPv6 interface in the
TS Configuration window.
• Virtual - Added the ability to disable promiscuous mode on a virtual test server. (This is only
supported for user mode test servers.)
• Virtual - Reduced the memory requirements for a large VM from 16GB to 8GB. (This only
applies to the 2 core Large VM. The High Performance Large VM with 6 or 8 cores still requires
16GB).
• VisionWorks - Added HTTP Client support in the PROC output file.
• VisionWorks - Added support for PACKETS_LOST in the PROC output file when running Basic
UDP and Basic TCP DMFs.
• VisionWorks - Added support for SMS use cases.
• Wifi RF Emulation - Added support for 5GHz channels 169 and 173 (U-NII-4) India.
• Wifi RF Emulation - Modified the default MAC address to 80:B0:3D:CF:A5:B0 for better
interoperability with real-world access points.

P/N 77-005666 Rev. A, 5/18 Page 6 of 23


Landslide 16.8 Release Notes

Bug Fixes

Landslide 16.8 contains the following bug fixes:

SR # Description
01300658 CDMA Voice Nodal - Landslide failed to handle "location update accept" message from
DUT.
01291387 DRA Nodal - Diameter Cx interface - UAR does not include the User-Name AVP.
01306932 DRA Nodal - S6a interface - RSR is not working, MME did not respond to the RSR message
from the HSS.
01291540 DRA Nodal - Session Termination Request is using the wrong Destination Realm AVP.
01306278 E10 - Database Corruption might be caused by kernel crash. (Note from engineering - Do
NOT purposefully remove power from a Landslide server without first shutting the
system down gracefully as hard drive and database corruption cannot be prevented in
this case.)
01287153 E10 SAS - System licensing does not allow AP emulation.
01306920 HNB Gateway Nodal - "Source RNC To Target RNC IE in Release 7 Format” configuration
is removed when a test case is opened on version 16.6.1.12.
01306922 HNB Gateway Nodal - mobility test - VLAN ID is incorrect in ARP for Iu-CS user plane.
01295830 HNB Gateway Nodal - Wireshark and customer HNB Gateway are unable to decode
Relocation Command message when UMTS version R4 is configured.
01294255 HNB GW Nodal - “SourceRNC-ToTargetRNC-TransparentContainer” should not have
Target Cell ID with ReloType "UE not Involved".
01294260 HNB GW Nodal - Relocation Type "Unknown" in SourceRnc-toTargetRNC-
TransparentContainer of Relocationrequired message.
01300394 HSGW Nodal - The Generate TAC option does not automatically generate a TAC report
after test sessions complete.
01286026 HSS - SCTP - Verification tag in INIT_ACK is different from the Initiate tag in INIT.
01301572 HSS Node - The Cx interface is unable to handle MAR when SIP-Authentication-Scheme =
Unknown.
01291893 HSS Node - Cx interface - Hex value configured for secret key in HSS Node is not working.
01292614 HSS Node - Cx Simulation Issue - LIR message with tel URI as public identity was rejected
by Landslide with error code "user unknown" even though tel URI was enabled in HSS
Node.
01290863 HSS Node - Cx-interface - Result code in second UAA message should be 2002 instead of
2001.
01304466 IMS - Algorithm value is removed in the SIP Register Authorization message when the SIP
header is modified or if PANI is added.
01305867 IMS Nodal - Landslide recycles during the cleanup phase when the user clicks Stop.
01306057 IP Application Node - VoIP SIP - Landslide did not include SDP in the 200 OK message
when the INVITE message sent by the DUT had no SDP.
01301848 IP Application Node / HSS Node - IK and CK values do not match.
01305789 IP Application Node with SIP Supplementary - The direction of notify action shown in GUI
was incorrect.
01294631 LNS Nodal - L2TP over IPSec issue.

P/N 77-005666 Rev. A, 5/18 Page 7 of 23


Landslide 16.8 Release Notes

SR # Description
01290056 Measurements - SCTP related counters for Socket Retransmission Rx are missing.
01306713 MME Nodal - Dual Connectivity, X2 handover with SGW relocation is not working.
01292020 MME Nodal - E10 SIM card reader could not retrieve the SIM card information.
01282740 MME Nodal - Expect call flow defined by TS23.401 section 5.3.4.1 instead of current
implementation based on section 5.3.4B.4 when UE triggers service request in Idle mode.
01299625 MME Nodal - Incorrect SCTP retransmission behavior.
01295395 MME Nodal - Invalid IPSec tunnel instance error occurred in 16.4 maintenance load.
01300522 MME Nodal - Landslide sometimes aborts the SCTP link to the MME after retransmission.
01284673 MME Nodal - NB-IoT - Default Paging DRX is missing in the eNBConfigurationUpdate
message.
01300342 MME Nodal - No eRABModifyIndication message is generated during dual connectivity
test.
01293348 MME Nodal - No Initial Context Setup Response is received if GUTI Reallocation
Command is included in the Initial Context Setup Request.
01306237 MME Nodal - SCTP Multi-homed issue when configured with both IPv4 and IPv6
addresses.
01295488 MME Nodal - Test server recycled with NB-IoT test.
01295093 MME Nodal - VoLTE - SIP messages were sent to the wrong destination IP when "USE
IPV6 CSCF addr from PCO" was enabled.
01304498 MME Nodal - VoLTE IPSec tunnel failed with L-ACC-007.
01307398 MME Nodal - VoLTE POLQA issue - RTP jitter buffer frame index out of rage [0-2346]
caused the test server to recycle.
01212749 MME Nodal / MME Node - The rate for Paging and S1-Release messages is getting
reduced.
01298197 MME Node - 3 Different Default Bearer use one QCI
01306329 MME Node - CSR does not include correct TAI and eCGI.
01293259 MME Node - MME did not send any more authentication requests after it received an
authentication failure.
01306861 MME Node - Security mode command was rejected by the eNodeB due to a UE security
capabilities mismatch.
01300488 MSC Node / SGSN Node - Relocation type is incorrect in relocRequest message from CN.
01307734 Network Host - Test provisioned with Basic Ping DMF replies with ICMPv6 ping replies
with mismatched sequence numbers, when testing with IPv6 client addresses.
01295391 PGW Nodal - Do not add UliTimestamp IE in DSReq if GtpV2 Version is less than 11.4
01296265 PGW Nodal - Test with IPv6 client address does not work when using IPv6 for DNS
Override.
01295352 PGW Nodal - The modify bearer request message for the second default bearer was not
triggered after S1 handover.
01290818 PGW Node - Default Application ID for Ro is incorrect. It is set to 16777238 when it
should be 4.
01298496 PGW Node - SIGSEGV(11) occurred on PGW Node when running in Fireball mode.
01300464 SGSN Node - Landslide is sending an unknown message type with protocol value = 0 and
message type = 0 in NAS PDU after receiving an "Activate PDP Context Accept" message.
01302192 SGW Nodal - Incorrect TEID format is sent in CUPS test scenario.

P/N 77-005666 Rev. A, 5/18 Page 8 of 23


Landslide 16.8 Release Notes

SR # Description
01307890 SGW Nodal - Landslide is not using the QCI and ARP values defined in the TDF with
grouped UE.
01294376 SGW Node - Sx Interface CUPS test - Landslide was sending the wrong type value for
"update forwarding parameters" IE in session modification request message.
01299619 SUT Query - The behavior of traceroute is incorrect when using an IPV6 address.
01297940 TS - Getting ‘ERROR: Cannot Init Interface’ when starting test case.
01301377 TS - Landslide sends out incorrect Router Advertisement message when no IPv6 address
is configured.
01296026 UMTS - Landslide responds to an incorrect IP / Port during the Dynamic SNS procedure.
01305347 Virtual - DPDK issues with Xen hypervisor using Intel X550T interface cards.
01287946 Virtual - Virtual test server drops VLAN tagged traffic when SR-IOV is used.
01302095 VisionWorks - DNS measurements are not being populated in the test PROC file.
01297529 VisionWorks - Failed to send required file to TS. No space left on device.
01298309 VisionWorks - Landslide on an E10 failed to renew the DHCP address
01306478 VisionWorks - Landslide test server recycles when attempting to write info_report.csv
file.
01299125 VisionWorks - Memory leak in info report notify timer.
01293897 VisionWorks - Modem logs do not include complete results.
01305023 VisionWorks - No CA modem level logs are being generated.
01304585 VisionWorks - Processes are not being properly cleaned up after tests which results in the
test server being unable to run new tests.
01305365 VisionWorks - Real handset settings for screen rotation revert to default after reboot.
01298803 VisionWorks - Test session does not stop after TAS initiates an Abort.
01301362 VisionWorks - Test session with U1 Modem does not allow its next port resource to run.
01301360 VisionWorks - Test session with U1 modem does not stop when abort is initiated from
the TAS.
01298336 VisionWorks MSA - Results displayed on dashboard can lag reports by up to 20 minutes.
01297924 Wifi Offload Gateway Nodal - Simulated WTP is not sending a "WTP Event Request"
message with statistics as expected.
01289092 Wifi Offload Gateway Nodal - CAPWAP DTLS issue is seen in 16.4 GA.
01295765 Wifi Offload Gateway Nodal - Configuration missing for session loading test.
01291446 Wifi Offload Gateway Nodal - Hybrid Access - DHCPv6 release is not sent for Dual-Stack
HAG subscribers.
01302372 Wifi Offload Gateway Nodal - Hybrid Access - Test server recycled with only 1 UE right
after test case reached the RUNNING state.
01291027 Wifi Offload Gateway Nodal - Landslide discarded DHCP over GRE message from DUT
resulting in session failure.
01290956 Wifi Offload Gateway Nodal - VoWiFi calls stability investigation.
01295013 Wifi RF Emulation - E10 TS recycles when executing an on-demand ScanGroup.
01286279 Wifi RF Emulation - UE used different MAC addresses for the association request and
DHCP request, which caused DHCP to fail when "UE random mac" was enabled.

P/N 77-005666 Rev. A, 5/18 Page 9 of 23


Landslide 16.8 Release Notes

Behavior Differences

16.8 GA
• PGW Node – The Sxb Interface to UP configuration option is no longer selectable when Mobility
= Inter-Technology. Any saved test cases will be marked red with the following error message
“PGW Node – Sxb Interface with Inter-Technology not supported”.
• IMS Nodal – The Enable 3rd Party Registration checkbox now requires the L-APP-047 P-CSCF and
Mw Interface Testing license. The same applies to the ATGW Node on the Network Devices tab
and the P-CSCF Built-In and ATCF Built-In panels of the SIP VoIP tab for ISC. If the new license
key is not present, test cases with these options provisioned will not be allowed to run.
• MME Nodal 5G Dual Connectivity – The DC Option in the Dual Connectivity pane on the S1-MME
| NAS tab was updated as option 3a functionality has not yet implemented. Previously
configured tests with 3a selected will be upgraded to have 3x selected instead. Previously
configured tests with 3x selected will continue to have 3x selected. The 3a option will be greyed
out until 3a has been implemented.

16.6 GA
• As of 16.6 GA, the Session Pending Time and Session Hold Time minimum limit of 15 seconds is
being enforced. If a saved test has one of these parameters configured to < 15s, the parameter
will be defaulted to 1,000 seconds.
• In 15.5GA, several L3 Client and L3 Server measurements (Total Bytes Sent, Total Bytes
Received, Total Bytes, Total Bits Sent/Sec, Total Bits Received/Sec, and Total Bits/Sec) were
modified to include 18 additional bytes per packet to account for the Ethernet header and
Frame Check Sequence to properly reflect data running at “line rate”. In 16.6, this change has
been reverted so that the L3 counts listed above are once again exclusively L3 only and will
match L3 counts on network equipment and devices under test. New measurements have been
added to account for the additional Ethernet header and Frame Check Sequence bytes and to
properly reflect “line rate”. Since Landslide does not currently have an L2 measurement tab,
these measurements are being added to the L3 Client and L3 Server tabs. In cases where client
data is wrapped into a tunnel (i.e. MME Nodal / GTP tunnel), there will be no ethernet counts on
the L3 Client tab.

New L2 measurements
▪ Total Ethernet Bytes Sent
▪ Total Ethernet Bits Sent/Sec
▪ Total Ethernet Bytes Received
▪ Total Ethernet Bits Received/Sec

• On SGW Nodal, we added the ability to provision a Target ePDG DNS Query Node when running
a Command Mode or Sequencer test case with both ePDG Node Emulation and APN DNS Lookup

P/N 77-005666 Rev. A, 5/18 Page 10 of 23


Landslide 16.8 Release Notes

enabled. Any saved tests in this configuration will be marked red by the TAS and require manual
intervention to configure the Target ePDG DNS Query Node.
• The "Add Prefix to Status Counter" feature in OCS Node is being upgraded. The single text field
for the prefix value is being replaced by a column in the table, so that each row can be
configured as a different value. When the prefix option is active, the Initial Status column will
accept -1 to indicate “no value” for Initial Status. (The status message is then based on the
prefix alone.)
Changes to GUI/Tcl validation
▪ The validation of the Initial Status column has been changed to allow -1 when Add Prefix to
Status Counter is checked. If -1 is entered, the row must have a non-blank Status Counter
Prefix value.
▪ The validation of the single Status Counter Prefix value prior to upgrade did not allow
the field to be blank and was accepting all ASCII values. For the new individual row
values, blank prefixes will be allowed but whitespace characters will be rejected.
• The new Separate Transaction Rate for Target Network checkbox in the DMF Editor is enabled
whenever the regular Transaction Rate field is enabled, but the target transaction rate is only
applied in test cases that support this new feature. Initially, this is only for the test cases
supporting 4G/5G Dual Connectivity. A tooltip has been added on the checkbox: "Only
Applicable for Dual Connectivity, 4G+5G".
• As of release 16.6 (and if the Test Server is not in Kernel mode) we no longer limit the number of
IP addresses defined per interface in TS Configuration to < 2000 per port or <~ 24000 total.

16.4 GA
• The L4 Client and L4 Server Socket Retransmission Rx Count and Server Socket Retransmission
Rx Byte measurements have been removed as Landslide has no way to accurately track the
number of retransmissions on the receive side. If any Pass / Fail criteria were configured using
these measurements, they will need to be removed and the test session saved.
• HTTPS - Pseudo Encryption has been renamed to Performance Two-Armed Encryption.
Functionality and Tcl Parameters for this feature have not changed. Enabling this option results
in improved performance and requires Landslide to be used as both the client and server.
• The Test Session Scheduler has been modified to utilize multiple threads to launch multiple tests
at the same time rather than serially. Tests that share the same test server(s) will still be
serialized.
• An option has been added to allow the Test Session Scheduler to use Aborts instead of Stops.
This is done by adding the TAS setting test_scheduler_abort=ON via the TAS Manager Console
or CLI. This is a global setting for all users and all scheduled test sessions.
• SNMP – The spirLsTasStopping trap is now sent with a value of 0 (for Start) when the TAS is
started and a value of 1 (for Stop) when the TAS is stopped. Previously the trap was not sent
when the TAS was started.
• In previous releases, the Dual Stack Support option (available on select Test Nodes) enabled an
Alternate Node parameter where an IP address could be entered. In 16.4 the Alternate Node

P/N 77-005666 Rev. A, 5/18 Page 11 of 23


Landslide 16.8 Release Notes

parameter is being upgraded to a Dual Stack Test Node with the options to select a Physical
Interface and IP Address as well as configure Advanced Test Node Settings.
▪ If the upgraded Alternate Node IP address is not found in the TS pool, the test case will
fail validation after upgrade and will require manual intervention to run.
▪ Impacted test sessions exported from releases prior to 16.4 and imported to 16.4+ will
need to be manually modified as the upgrade will not happen automatically.
▪ Tcl API users who use this option should reference the API Compatibility Changes
section for details.

This upgrade affects the following nodes:

Test Case Node name


HSGW Node HSGW Node
MME Nodal SGW GTP User Node
MME Nodal Target SGW GTP User Node
MME Node SGW GTP User Node
MME Node Target SGW GTP User Node
PGW Node PGW Control Node
PGW Node LMA Node
SGW Nodal PDN GW Node (GTPv2)
SGW Nodal PDN GW Node (PMIPv6)
SGW Node SGW User Node
UMTS PGW Control Node

16.2 GA
• LTE OTA functionality has been moved from the MME Nodal test case to the new UE Node test
case.
• The MME Node T3412 Extended Value(s) checkbox has been moved from the general section to
the High Latency Communication panel to coordinate with similar placement in the MME Nodal
test case. Only the location has changed. Functionality and the Tcl variable remain the same.
• The “S3 Interface to MME”, “Sv Interface” and “SRVCC” checkboxes are now disabled when the
Handoff Protocol is UMTS (IuCS over IP) as this is not a supported option.
• The System Status has been updated to include a new System tab which is displayed upon
opening. The new System tab includes both the TAS Memory In-Use (just the TAS process), TAS
Hard Drive Space (just the main partition), Running Tests #, Active Test Server #, Active SUTs #,
Remaining ECs (POLQA, PEVQ and DSP).
• The following measurements were added to the L5-7 Advanced HTTP tab. Due to performance
considerations, these measurements will only be available when a test case is using an HTTP or
HTTPS DMF and HTTP Stats is selected on the L3-7 configuration tab or when an HTTP Redirect
DMF is used.
o GET Attempts
o GET Successes
o GET Failures

P/N 77-005666 Rev. A, 5/18 Page 12 of 23


Landslide 16.8 Release Notes

o POST Attempts
o POST Successes
o POST Failures

• The following measurements were added to the L4 Client and L4 Server tabs.
o Socket FIN Messages Sent
o Socket FIN Messages Received
o Socket FIN ACK Messages Sent
o Socket FIN ACK Messages Received

• New SSL Client and SSL Server measurement tabs were added when the data protocol is HTTPS.
Please refer to the online help Home > Measurement Reference > L5-7 Protocol
Measurements. Then click on the L5-7 Client|SSL and L5-7 Server|SSL links for more details.

16.0 GA
Fireball data can now be enabled per process rather than per test server. To Enable Fireball Per
Process,
o Select Admin > Test Servers
o Select the test server to be modified
o Click Configure and enter the cfguser password if prompted
o Select Date Gen Performance = Fireball
o Click Processes
o Select the processes to enable Fireball and click OK
o Click Apply

Non-Release Specific
• If Ethernet or Wi-Fi NIC cards are removed, replaced, or swapped, the ipcfg utility must be
immediately invoked by the user followed by a reboot of the entire system. Refer to the
Landslide Installation Guide for ipcfg operation.
• The Max Data Gen Performance mode greatly increases the data throughput capabilities of
Landslide. There are, however, certain considerations that must be made in test configuration.
Tunneled and un-tunneled (standard IP) interfaces should be on different physical interfaces to
maximize performance. In other words, the interface for a local network host should be
separate from the interface(s) used for tunneled traffic.
• The maximum activation and deactivation rates are based on the maximum achievable rates
while running tests with the capacity test activity. These rates may not be sustainable when
running tests with any other test activity.
• Due to product enhancements, data performance may exhibit mild degradation in some
applications.
• The user must accept the Spirent End User License Agreement (EULA) upon applying a license to
the TAS and the first subsequent user login after that.

P/N 77-005666 Rev. A, 5/18 Page 13 of 23


Landslide 16.8 Release Notes

API Compatibility Changes


Upgrades for any configurations saved before December 2015 (14.0) are no longer supported and not
guaranteed.
Be sure to re-save your configurations with the latest Landslide release.
Landslide 16.8 does not include any API Compatibility changes.
Landslide 16.6 contains the following API Compatibility changes.
• The "Add Prefix to Status Counter" feature in OCS Node is being upgraded. The single text field
for the prefix value is being replaced by a column in the table, so that each row can be
configured as a different value. When the prefix option is active, the Initial Status column will
accept -1 to indicate “no value” for Initial Status. (The status message is then based on the
prefix alone.)

Tcl Upgrade
If Add Prefix to Status Counter is checked, the value of "SyPolicyStatusPrefix" is upgraded to
"SyPolicyStatusPrefix_" + <#>, where # = 1 to "SyPolicyNumCounters" (max 30).
Changes to GUI/Tcl validation
▪ The validation of the Initial Status column has been changed to allow -1 when Add Prefix to
Status Counter is checked. If -1 is entered, the row must have a non-blank Status Counter
Prefix value.
▪ The validation of the single Status Counter Prefix value prior to upgrade did not allow
the field to be blank and was accepting all ASCII values. For the new individual row
values, blank prefixes will be allowed but whitespace characters will be rejected.
Landslide 16.4 contains the following API Compatibility changes.
• Prior to 16.4, there was a misspelling of a RESTful API attribute in test server objects ->
wwanInfos. The read only simadaptorStatus attribute has now been corrected to
simAdapterStatus.
• The feature enhancement “Upgraded Alternate Node Address fields to Dual Stack Test Nodes”
required Tcl variable upgrades for each impacted test case.
▪ Below is a list of the Tcl parameter upgrades.
Format is:
Test Case / Test Node – old Basic parameter name -> new TestNode parameter name
o HSGW Node / HSGW Node - HsgwSourceAddr->PdsnNodeV6Addr
o MME Nodal / SGW GTP User Node - SgwUserAltAddr->SgwAltUserAddr
o MME Nodal / Target SGW GTP User Node - MobSgwUserAltAddr->MobSgwAltUserAddr
o MME Node / SGW User Node - SgwUserAltAddr->SgwAltUserAddr
o MME Node / Target SGW User Node - MobSgwUserAltAddr->MobSgwAltUserAddr
o PGW Node / PGW Control Node - PgwSourceAddr->PdnGwAltAddr
o PGW Node / LMA Node - LmaSourceAddr->PdnGwV4Addr
o SGW Nodal / PDN GW Node - PgwSourceAddr->PdnGwAltAddr
o SGW Nodal / LMA Node - LmaSourceAddr->PdnGwV4Addr

P/N 77-005666 Rev. A, 5/18 Page 14 of 23


Landslide 16.8 Release Notes

o SGW Node / SGW User Node - SgwUserAltAddr->SgwAltUserAddr


o UMTS / PGW Control Node - PgwSourceAddr->PdnGwAltAddr

P/N 77-005666 Rev. A, 5/18 Page 15 of 23


Landslide 16.8 Release Notes

Limitations
• WebRTC support is limited to a maximum of 50,000 sessions in the 16.8 GA release. This will be
increased significantly in the near future.
• The following limitations apply to the Fireball feature.

o Test Server must be configured to use Fireball Data Gen Performance.


o Only supported for 1 - 4 processes. Not supported for 8 processes.
o Only supported in MME Nodal, SGW Nodal, PGW Nodal, IP Application Node and
Network Host test cases.

o Only the Basic UDP, Basic TCP, RTP, HTTP and HTTPS DMFs are currently supported.
o Only the Capacity test activity is supported.
o Data fragmentation is not supported.

o Advanced options like error injection is not supported.


o Traffic Start = “When Session Established” is not supported.
• The L-NIC-66 and L-NIC-27 cannot currently coexist in the same test server. If L-NIC-66 cards are
added to a system, the L-NIC-27 cards should be removed. Make sure to run ipcfg after any
change in card configuration.
• The L-NIC-73 and L-NIC-74 are only supported on the C100-M4 platform. Attempting to use
them in any other Landslide platform may cause recycling and other issues.
• The C100-S2 maximum capacities can be achieved with all test activities with 2 Basic DMFs or 2
Advanced flows like “HTTP 1.1 Persistent Connection”. However, adding additional dedicated
bearers, test nodes and Advanced DMFs with many commands can utilize additional memory
reducing the number of sessions that can be reliably run.
• VoLTE maximum capacity is achieved by running IP Application Node against the IMS Node test
case. VoLTE capacity in other test case types (SGW Nodal, Wifi Offload Gateway Nodal, etc.) will
be less.
• The maximum number of DASH ABR sessions that can be successfully run is limited to:
5,000 per process on a single process test server
5,000 per process on a four-process test server for a total of 20,000
4,375 per process on an eight-process test server for a total of 35,000
These maximum limits are only achievable when running a basic capacity test with no other data flows.
Other test activities, data flows, etc. may cause degradation and reduce the maximum number of
sessions that can be successfully run per process or test server.

• SIP VoIP in IP Application Node is not supported for MS Transport type IP/PPPoE. The SIP VoIP
checkbox has been disabled in Capacity Test when MS Transport = IP/PPPoE, and the IP/PPPoE
radio button is disabled for Inter- Technology Mobility, Command Mode, and Sequencer test
activities. The mobility and command mode features are for SIP VoIP Gm/I2.

P/N 77-005666 Rev. A, 5/18 Page 16 of 23


Landslide 16.8 Release Notes

• The new 802.11N Wi-Fi USB radios introduced in 15.5 are limited to a single RF client.

• Port Capture is not yet supported for RF AP Emulation. If enabled, the test session will not run.

• IMS tests provisioned with both VoLTE and regular DMFs must set the traffic-start mode the
same for both the VoLTE and regular data traffic. Using different settings for each will result in
the SIP client failing to start.

• EAP Authentication for RF Emulation currently only supports PSK, EAP-SIM, EAP-AKA, EAP-TLS
and EAP-PEAP-MSCHAPv2.

• The MME Nodal feature for configuring multiple DUT MMEs (more than 2) for S1-Based
handovers has an issue where the Target ENodeB's are only establishing a connection with the
1st Target MME SUT.
• L3 Client and Server measurements for the NIC-27 will be slightly different due to the NIC-27
including some additional header bytes on the Sent side.
• The Landslide Performance Test System may exhibit performance degradation when data
message flow transaction rates are set high enough that the provisioned throughput exceeds
that of the network, system under test or Landslide appliance. Packet loss and socket errors are
a common indicator of this and can be resolved by provisioning the data message flows to
operate within the bounds of all systems involved.
• The Command Sequencer Test Activity does not support specifying a range of mobile
subscribers or bearers for all commands. This means that if a test case is provisioned for
100,000 Mobile Subscribers, commands that do not support ranges of mobile subscribers will be
applied to all 100,000 subscribers. If finer granularity is desired, the user can create multiple
test cases with smaller sets of Mobile Subscribers.
• Landslide only supports a mobility rate of 200 per second when MME Node is configured to use
InterTech Mobility with Gn Interface Enabled and the GPRS protocol is used.
• For Test Applications licensed under Multiple Server or Multiple Server Extended System
licenses, the supported number of sessions assumes that any node emulation is disabled.
Adding node emulation or other features may decrease the number of sessions that the
appliance can support.
• The Dual Stack in the remote network host only supports eHRPD and LTE applications
• EAP-TLS/TTLS is very CPU intensive and limits the performance of the controlling application.
Please refer to the online help for capacity and throughput limits.
• Authentication algorithm AES-XCBC-MAC-96 for IKE is not supported by the IPSec accelerator
card; the tool may exhibit performance degradation due to using software IPSec.

• Data IPSec is not supported on secondary contexts for the GPRS application.
• The ability to save all Excel files in one report has the following limitations. Choosing "Summary
and Each Test Case in One File" is limited to 10 or fewer test cases in a session and a limit of
1000 intervals or less.

P/N 77-005666 Rev. A, 5/18 Page 17 of 23


Landslide 16.8 Release Notes

Known Problems
The known problems for Landslide 16.8 are listed below. Each item is given a severity code (A, B, C, D, E
or F). The meanings of the severity codes are as follows:
Severity A System Crash
Severity B Major Functionality Failure
Severity C Inconsistency in Measurement
Severity D Minor Functionality Failure
Severity E Inconsistency in GUI
Severity F Under Investigation

Landslide 16.8 contains the following known problems:

Ref # Description Work-around Severity


01209951 IMS - Unable to generate SMS over IP. Contact support for D
custom license.
01279562 AAA Server Node - Loss of connection with None F
the test server occurs and cannot be
connected to locally or remotely, requiring a
hardware reboot to recover.
01287545 PCRF Node - Test server recycles when None A
stopping a test with 2 Diameter TCP
connections on the Gx interface.
01290916 IPSec - An incorrect traffic selector is used None F
when we increase the number of sessions to
more than the number of IPSec tunnels.
01291647 MME Nodal - No Security Mode Complete None D
from Landslide with specific algorithm.
01292290 IMS Node - IMS fails to answer more than None F
32768 200OK messages in case of SIP IPSec.
01292382 Wifi Offload Gateway Nodal - RF Emulation - Check AP F
E10 starts dropping the number of clients configuration to
from 64 to single digits in the first hour. investigate root
cause of AP
disassociation.
01294100 DRA Node - Sy interface - Landslide replaced None F
destination host and realm in SNR message
which caused the DUT to reject the
message.
01294873 C100-M2 TS – Test server configured with 8 None F
processes does not achieve READY status.
01295553 Wifi Offload Gateway Nodal - RF Emulation - None F
The second UE fails to get a DHCP offer
message even though the DUT sends it.

P/N 77-005666 Rev. A, 5/18 Page 18 of 23


Landslide 16.8 Release Notes

Ref # Description Work-around Severity


01299101 Wifi Offload Gateway Nodal - GRE L2 - Test None A
Server Recycles when many DHCP requests
timeout.
01305139 VisionWorks - Invalid record detected from None F
Landslide.
01305478 PCRF Node - "Socket SCTP Packets Received" None C
is not incrementing.
01306473 MME Nodal - VoLTE registration / Investigate cause of
deregistration messages gradually fall off registration
after 30 minutes of running a session failures.
loading scenario.
01308869 UMTS - GPRS Dynamic - Landslide does not Add additional IP F
respond with NS Alive Ack to the correct Endpoints.
SGSN
01310034 MME Nodal - Dual Connectivity - Real MME None F
does not send the NR restricted bit but
MME Nodal considers it as NR restricted.
01310083 SGW Nodal - External data is not being sent None F
from the correct port.
01310156 MME Nodal - VoLTE - SIP Register maximum None F
registration retries does not work when a
connection has been closed and re-
established.
01310319 Wifi Offload Gateway Nodal - A client error None F
occurs when running EAP AKA and multiple
APNs.
01310630 MME Nodal - Inter Tech Mobility - Landslide None F
BSS is not sending BVC Reset when running
a 4g-2g RAU/TAU scenario in version
16.6.1.14.
01310634 MME Node - Landslide uses the wrong SGW None F
GTP-U IPv6 address for X2 handovers when
the SGW supports dual stack for user plane.
01310710 IMS Node - Client fails to handle “407 Proxy None F
Authentication Required” SIP messages.
01310766 SGW Nodal - 10 Gig port fail to generate None F
more than 5 Gbps traffic.
01310798 MME Nodal - C100-M4 test server recycles None A
when running a three process NB-IOT CP
test.
01311497 IMS Nodal - Mx interface - Test server None A
recycled on cleanup when only 1 VoLTE UE
was configured.

P/N 77-005666 Rev. A, 5/18 Page 19 of 23


Landslide 16.8 Release Notes

Other Issues/Anomalies
The following is a list of known issues/anomalies not reported by a customer:

Description Work-around Severity

Data - 40K Fireball HTTP test running on 8 ports and 4 None A


processes recycles on stop / cleanup.
Data - Fireball TCP and HTTP L3 Server Total Bytes Sent != None C
L3 Client Total Bytes Received.
DCCA - Send Error is reported at the beginning of the test. None F
HSS Nodal / HSS Node - Gr interface with a Gr test data None F
file on the HSS Node test case will cause invalid IMSIs
even though the Gr test data file is valid.
IMS Noda - VoLTE test hangs with "ERROR: attempting to None F
delete non-existent sipSocket" error message.
IMS Nodal -VoLTE - Mw Interface, IMSorig, NoReg - Test None F
session hangs or recycles on cleanup.
IP Application Node / Network Host – HTTP transactions None F
fail when running multiple network host nodes with
Fireball HTTP along with one or more other types of
Fireball DMFs (TCP or UDP).
Measurement - L4 Client | Socket SCTP Active Count is None F
always zero.
MME Nodal - VoLTE - Some Mobile to Mobile SIP calls None D
experience call failures when the number of UEs is > 2000.
MME Nodal - VoLTE test with 2 APNs, Data, Voice and None F
Video (POLQA / PEVQ) causes test server to recycle.
Mu DMF - L5-7 Client "Command Failed Transactions" None F
were reported.
RTP-Voice - Test server recycles when running VoLTE high Do not use locally F
scale + long call-length + mobile-to-mobile test with terminated RTP traffic.
locally terminated RTP traffic.
Virtual - The vmdk file provided by engineering does not Contact support for D
install and run correctly in ESXi 6 or ESXi 6.5. workaround utilizing an OVA
file.
Virtual - Virtual TS configured with SRIOV does not pass Do not use "Perform F
traffic when configured with "Perform Verification". Verification" if your virtual TS
is configured with SRIOV.
VoLTE - WebRTC - "Invalid value supplied" error message None F
occurs in realtime log.
VoLTE - WebRTC - Auth and L4 Server timeouts occur Do not run more than 50K F
when running > 50K sessions. sessions with the initial
WebRTC release.
VoLTE - WebRTC - L4 Server measurements tab always has None C
“Socket TCP Active Count”.

P/N 77-005666 Rev. A, 5/18 Page 20 of 23


Landslide 16.8 Release Notes

Description Work-around Severity

VoLTE - WebRTC pending sessions never reaches the None F


provisioned number of sessions.
AAA Nodal with EAP TLS PEAP - Under heavy loads the Decrease load A
Test Server may recycle.
Network Host Data Expansion does not achieve requested Use command/response F
quantity under heavy load structure to insure proper
expansion
Node level error injection does not work on some nodes None F
The maximum number of subscribers for HSGW Nodal has To connect all 200,000 F
been increased to 200,000 subscribers when running with subscribers, the activation
Extreme Capacity. Landslide is currently unable to rate must be reduced to 500
connect all 200,000 subscribers at the maximum activations per second or
activation rate of 1000 activations per second lower

TS Admin - “Cannot Create Route” will be reported if Do not use default routes in D
setting both IPv4 and IPv6 default routes in the [TS Test Server Administration
Configuration] - Routing tab
Data - Due to product enhancements, data performance None F
may exhibit mild degradation in some applications
Data - 6 Mu DMF flows with 10K subscribers failed with Use Max Mode F
Legacy mode on C100
Sessions using DHCP may not establish correctly with Use a different DHCP server, F
some vendor equipment Landslide DHCP Server Node
or static IPs in the test
session

P/N 77-005666 Rev. A, 5/18 Page 21 of 23


Landslide 16.8 Release Notes

Additional Information
This section includes additional information that will help when operating Landslide 16.8.

The Test Administration Server supports:


Up to 128 user accounts
Up to 48 simultaneous users
Up to 32 Test Appliances
Up to 512 SUT configurations
Maximum activation rate is based on the application and system license - refer to the online help to
determine system capabilities.
Maximum simultaneous sessions are based on the application and system license - refer to the online
help to determine system capabilities.

P/N 77-005666 Rev. A, 5/18 Page 22 of 23


Landslide 16.8 Release Notes

How to Contact Us
To obtain technical support for any Spirent Communications product, please contact our Support
Services department using any of the following methods:

Americas
E-mail: support@spirent.com
Web: https://support.spirent.com
Toll Free: +1 800-SPIRENT (+1 800-774-7368) (North America)
Phone: +1 818-676-2616
Hours: Monday through Friday, 05:30 to 18:00 Pacific Time

Europe, Middle East, Africa


E-mail: support@spirent.com
Web: https://support.spirent.com
Phone: +33 (1) 6137 2270 (France)
Phone: +44 1803 546333 (UK)
Hours: Monday through Thursday, 09:00 to 18:00, 9:00 to 17:00 Friday, Paris Time

Asia Pacific
E-mail: support@spirent.com
Web: https://support.spirent.com
Phone: +86 (400) 810-9529 (toll-free mainland China only)
Phone: +86 (10) 8233 0033 (China)
Operating Hours: Monday through Friday, 09:00 to 18:00 Beijing Time

The Spirent Customer Service Center (https://support.spirent.com) includes useful tools such as a
powerful Knowledge Base with tens of thousands of technical articles to serve your technical
information needs. The Knowledge Base offers an easy-to-use browse mode along with an intelligent
search that offers quick answers to your network analysis and measurement questions. New content is
added daily by Spirent’s communications and networking experts. Log in with your user ID and password
to gain access to additional content that is available only to customers - user manuals, help files, release
notes, technical bulletins, and more. When you log in, you also gain access to download software and
firmware, and to manage your SRs.

Information about Spirent Communications and its products and services can be found on the main
company website at http://www.spirent.com.

Company Address
Spirent Communications, Inc.
27349 Agoura Road
Calabasas, CA 91301
USA

© All of the company names and/or brand names and/or product names referred to in this document, in particular, the name
“Spirent” and its logo device, are either registered trademarks or trademarks of Spirent plc and its subsidiaries, pending
registration in accordance with relevant national laws. All other registered trademarks or trademarks are the property of their
respective owners.

P/N 77-005666 Rev. A, 5/18 Page 23 of 23

Das könnte Ihnen auch gefallen