Tolly Report Archive: 50 Most Recent Reports

Click on report title to go to the report abstract page. Report download requires registration and/or purchase.





Archeo Futurus Document number: 221141
AF F1-eco Server FPGA Cloud Server Performance vs. Power Consumption
Release date: 16 May 2022

Field-programmable gate arrays (FPGAs) are integrated circuits designed to be configured (programmed) by a designer after manufacturing. FPGAs can provide high performance usually associated with ASICs but with unprecedented flexibility.

Kyudoka Capital Corporation is a financial technology infrastructure company leveraging AF F1-eco technology to provide next generation, ultra high- performance systems that search, analyze, sort, and predict.

Archeo Futurus & Kyudoka commissioned Tolly to benchmark the cloud services server performance and power consumption of its AF F1-eco solution. The testing focused on measuring “worst case” small packet performance for three key web protocols: HTTPS (encrypted web), HTTP (standard web), and DNS (URL name resolution).

AF F1-eco server was able to process over 100,000 HTTPS responses per Watt, nearly one million HTTP responses per Watt, and over 5.5 million DNS responses per Watt.




SonicWall Document number: 222126
Webinar: Elevating Your Firewall Protection to the Cloud
Release date: 12 May 2022

Tolly benchmarked the throughput and connection performance of SonicWall’s NSv 470 virtual firewall in AWS. Tolly engineers used Keysight’s CyPerf cloud-native testing solution to provide the test infrastructure for standardized, repeatable performance tests.

Join Tolly Group CEO Kevin Tolly; Keysight Technologies Senior Product Mgr. Amritam Putatunda; and SonicWall Dir. of Product Marketing Ajay Uggirala as they explore:

• Which firewall services can secure the public cloud

• The best way to deploy and test a firewall in a public cloud infrastructure

• What sort of performance you can expect from your SonicWall NGFW in AWS cloud, as validated by experts at Keysight and Tolly Group

SonicWall Webinar View On-demand Landing Page.

The Tolly report can be downloaded from here.




New H3C Technologies Co., Ltd Document number: 222103
H3C AD-Campus Solution (Application-Driven Campus Solution) Functionality Validation
Release date: 12 May 2022

The H3C Application-Driven Campus (AD-Campus) Solution is an innovative campus network solution which aims to achieve great integration and convergence to easily reflect intent to network operation. With full lifecycle management, open architecture and deep intelligence, AD-Campus is committed to solve existing challenges and assist customers to accelerate digital innovation and transformation.

AD-Campus combines VXLAN and the concept of Software-Defined Networking (SDN) to create a new-generation flexible network. It converts campus network from "user adapts to network" to "network adapts to users", enabling users and devices to roam around campus seamlessly, while remaining consistent user experience and simplified network operation. It reduces complexity of network deployment and maintenance and meets the increased requirements of mobility and massive endpoint access on campus network.




New H3C Technologies Co., Ltd Document number: 221154
H3C AD-DC Solution (Application Driven Data Center Solution) Functionality Validation
Release date: 11 May 2022

As organizations of all sizes across all industries, such as governments and enterprises, continue to advance digital transformation and improve the agility and flexibility of their IT systems, and in doing so, improve organizational efficiency and competitive advantage. Hybrid IT environments and multi-clouds are being used as indispensable tools for this purpose. Data center networks support multi-cloud environments with agility, elastic scalability, security and operational efficiency, and with a consistent network architecture that meets the needs of local cloud data centers and extends to public and edge cloud environments.

The Application Driven Data Center (AD-DC) solution is H3C’s new generation data center network solution, based on the cloud and intelligence native architecture, integrating management, control and intelligent analysis functions. H3C commissioned Tolly to evaluate the AD-DC solution, and the results show that the H3C AD-DC solution provides complete data center network lifecycle automation, intelligent operation and maintenance, comprehensive security protection, flexible networking architecture, and multi-level high availability. This open platform provides programmability, which can meet the network requirements of organization's hybrid IT and multi-cloud environment, ensures the agility and flexibility of organization's IT environment, and greatly improve the business efficiency of customers.




New H3C Technologies Co., Ltd Document number: 222106
H3C S12500G-AF Series Data Center Intelligent Core Switch Performance Evaluation and Feature Validation
Release date: 25 April 2022

With the rapid development of new-generation technologies such as 5G, cloud computing, and AI, the accelerated integration of information technology and traditional industries, data centers, as the physical carrier for the operation of information systems in various industries, have become indispensable for economic and social operations.

H3C S12500G-AF is H3C's new generation of AI intelligent switches for the core layer of data centers, provides ultra-high switching performance and rich network features. H3C S12500G-AF uses CLOS+ architecture, which greatly improves the system bandwidth, and the switching capacity can be smoothly expanded. At the same time, S12500G-AF supports virtualization technology, visualization technology, RoCE, FCoE and other software features to create a green, smart, safe, efficient, and flexible data center.




New H3C Technologies Co., Ltd Document number: 222105
H3C S10500X Series Next Generation Multiservice Core Switch Performance Evaluation and Feature Validation
Release date: 25 April 2022

With the development of cloud computing and campus networks, the gradually increasing scale accelerates requirements of high-performance and feature-rich switches. Core switches need to support comprehensive Ethernet protocols, high bandwidth, high availability features, SDN features, and provide easy-to-use O&M functions. The switches need to guarantee good network service and handle massive network traffic easily.

H3C S10500X series switch is designed for the core layer of data centers and next-generation campus networks. The advanced CLOS architecture delivers outstanding bandwidth scalability. S10500X supports comprehensive data center, network service and high availability features, including Multi-tenant Device Context (MDC), Fiber Channel over Ethernet (FCoE), Telemetry, microsegmentation, MPLS VPN, In-Service Software Upgrade (ISSU), Graceful Restart (GR), etc. It is suitable as primary choice to be the core layer switch in different industries.

H3C commissioned Tolly to evaluate S10500X core switch’s performance, capacity and features.




SonicWall Document number: 222113
SonicWall NSv 470 Virtual Firewall Performance on Amazon Web Service Public Cloud Leveraging Keysight CyPerf Test Tool
Release date: 20 April 2022

The massive migration to cloud-based computing has raised the profile of cloud-based network infrastructure. Security is essential to cloud computing, and virtual next-generation firewalls (NGFW) are responsible for providing that security. Firewalls directly impact application performance -- and a firewall's performance, in turn, depends on the resource characteristics of the cloud instance where it runs. Thus, it is essential to establish key performance indicators (KPIs) for firewalls.

Tolly benchmarked the throughput and connection performance of SonicWall’s NSv 470 virtual firewall in AWS. Tolly engineers used Keysight’s CyPerf cloud-native testing solution to provide the test infrastructure for standardized, repeatable performance tests.

Tests were run with both encrypted and unencrypted traffic, as NGFWs provide multiple layers of traffic screening that are selectable by the network security team. These tests were run with different NGFW security profiles: basic firewall, intrusion prevention service (IPS), and threat prevention services. Threat prevention services consisted of IPS, anti-virus, anti-spyware, and application control features all enabled. Firewall throughput depends on traffic profile, encryption settings and security services that are enabled.




VMware, Inc. Document number: 221128IG
Infographic: User Experience with VMware SD-WAN Work-from-Anywhere with Dual WAN Links
Release date: 14 April 2022

VMware and Intel commissioned Tolly to benchmark the quality-of-service and remediation capabilities of VMware SD-WAN to improve the end-user experience for voice-over-IP (VoIP) and work-from-anywhere (WFA) applications using a dual WAN link deployment. Additionally, Tolly benchmarked the packet throughput of VMware SD-WAN.

View the Infographic on the key takeaways from the VMware SD-WAN Work-from-Anywhere with Dual WAN Links

The full Tolly report can be downloaded from here.




Cubro Document number: 222116
Cubro Custos Network Monitoring Functionality & Efficiency
Release date: 04 April 2022

When it comes to network monitoring, network size doesn’t matter. Local or global, small or large, it is essential for every company to have insights into network activity. Effective monitoring can provide critical insights into application usage, identify bottlenecks, and help reveal possible security threats. Cubro Custos is designed to be an intuitive and small-footprint network monitoring solution that provides critical insights into user and application activity.

Cubro Network Visibility commissioned Tolly to evaluate the usability, storage efficiency and approach to data structure used in Custos. Tests were run by evaluating a live network simultaneously using Cubro Custos and legacy NetFlow/ IP Flow Information Export (IPFIX) files.

Tests showed that the Custos 3D-style user interface provided insightful, immediately actionable network information, stored network data dramatically more efficiently than NetFlow/IPFIX, and implemented a human-oriented data structure that could be easily integrated into 3rd-party systems.




Xena Networks Document number: 222119
Tolly on Technology - Automotive Ethernet: The "Whys" & "Hows" of Testing - Conversation with Xena Networks
Release date: 11 March 2022

Tolly Group Founder, Kevin Tolly hosts a Video Podcast discussing Automotive Ethernet with Xena Networks.

The Tolly on Technology Video Podcast series is a thought leadership podcast that interview experts on trends and best practices for IT leaders.

Kevin is joined by Xena Networks' Thomas Schulze to discuss the "Whys" and "Hows" of testing Automotive Ethernet.

Tolly on Technology Landing Page.
(Note: There is no download for this Video Podcast item.)




VMware, Inc. Document number: 222118
Webinar: User Experience with VMware SD-WAN Work-from-Anywhere with Dual WAN Links
Release date: 11 March 2022

VMware and Intel commissioned the Tolly Group to benchmark quality of service and remediation capabilities of VMware SD-WAN™ to improve end user experience for VoIP and work-from-anywhere applications using a dual WAN link deployment.

Join Kevin Tolly, Founder at Tolly Group, Jen Horvath, Global Market Development at Intel, Swapnil Hendre, IT at VMware, for a webinar covering the quality-of-service and remediation capabilities of VMware SD-WAN to improve the end-user experience for voice-over-IP (VoIP) and work-from-anywhere (WFA) applications using a dual WAN link deployment. Additionally, Tolly benchmarked the packet throughput of VMware SD-WAN.

VMware Webinar View On-demand Landing Page.

The Tolly report can be downloaded from here.




Huawei Technologies, Co.Ltd Document number: 222111zh
华为 AirEngine 系列 Wi-Fi 6 无线接入点性能评估和功能验证
Release date: 10 March 2022

Wi-Fi 6 是最新商用化的 Wi-Fi 标准,被目前新发布的各类无线终端广泛采用。相较之前的标准,Wi-Fi 6 无线接入点(AP)能提供更大的带宽、更高的并发用户数、以及更低的时延。

Tolly 从市场上选取了几款华为最新 Wi-Fi 6 无线接入点 AirEngine 6761-21、AirEngine 5761R-11、AIrEngine 5761R-11E、AirEngine 5762-12、AirEngine 5762-12SW 以及 AirEngine 5762-15HW,验证了其部分最新功能。同时,Tolly 工程师测试了上述华为 Wi-Fi 6 AP 的单用户性能以及 AirEngine 6761-21T AP 的整机多用户性能。




Huawei Technologies, Co.Ltd Document number: 222111
Huawei AirEngine Series Wi-Fi 6 Access Points Performance Evaluation and Feature Validation
Release date: 10 March 2022

Wi-Fi 6 is the latest commercial Wi-Fi standard and is widely used by newly released wireless endpoints. Compared with earlier standards, Wi-Fi 6 access points (APs) provide higher bandwidth, a larger number of concurrent users, and lower latency.

Tolly tested some of the latest features of Huawei's latest Wi-Fi 6 APs: AirEngine 6761-21, AirEngine 5761R-11, AirEngine 5761R-11E, AirEngine 5762-12, AirEngine 5762-12SW, and AirEngine 5762-15HW. Tolly engineers also tested the single-user performance of Huawei Wi-Fi 6 APs and the multi-user performance of AirEngine 6761-21T.




Huawei Technologies, Co.Ltd Document number: 222112
Data Center Autonomous Driving Network – Huawei CloudFabric Solution Versus Cisco IBN Solution
Release date: 04 March 2022

The ultimate goal of full autonomous networks is a long-term process that needs to be implemented step by step. Based on the complexity of the communication network, the autonomous driving network levels are defined for data centers from the aspects of customer experience, manual involvement, and network environment complexity.

Tolly evaluated the Huawei CloudFabric solution and the Cisco IBN solution (ACI mode) for data center autonomous driving networks.

This test report compares and analyzes data center autonomous driving network solutions — Huawei CloudFabric and Cisco IBN from Day 0 — planning and construction, Day 1 — service provisioning, Day 2 — monitoring and troubleshooting, and Day N — change and optimization.




Huawei Technologies, Co.Ltd Document number: 222112ZH
数据中心自动驾驶网络 华为 CloudFabric 与 Cisco IBN (Data Center) 对比测试报告
Release date: 04 March 2022

Tolly 本次就数据中心自动驾驶网络华为 CloudFabric 与 Cisco IBN for Data Center 在四个维度进行了评估(思科方案采用 Cisco ACI 架构): Day0 规划建设:规划建设环节,包括基于业务意图系统⾃动理解,并转化为⽹络需求,⽣成⽅案,同时完成部署验证等物理⽹络就绪的能⼒。 Day1 业务部署:业务部署环节,包括意图理解,事前仿真,配置⾃动化,事后检验等业务部署时⽹络配置效率及准确性能⼒。 Day2 监控排障:监控排障环节,包括意图监控,问题定界定位、⽅案⽣成、评估决策、⽅案实施、业务验证等智能运维能⼒。 DayN 变更优化:变更优化环节,对⽹络变更或优化的意图进⾏⽅案设计、评估决策,⽅案实施和验证等,以提⾼⽹络运⾏效率的能⼒。

根据数据中心网络自动驾驶指数评价体系,Tolly 从数据中心生命周期 Day0、Day1、Day2、DayN 4 个阶段,规划设计、部署开通、业务部署、监控排障、⽹络变更、优化调参 6 个大类、39 个⼩类,通过 150+ 指标测试,华为 CloudFabric 解决⽅案在部署效率和准确性、易用性、可维性、可靠性、网络性能优化等指标上以整体 3.51 分领先 Cisco IBN(Data Center)解决方案的 2.8 分,是 Tolly 评估过的业界唯⼀实现跨越 L3.5 级⾃动驾驶的数据中心网络解决方案。




Huawei Technologies, Co.Ltd Document number: 222117ZH
华为 AirEngine 系列 Wi-Fi 6 无线接入点性能评估和功能验证
Release date: 23 February 2022

Wi-Fi 6 是最新商用化的 Wi-Fi 标准,被目前新发布的各类无线终端广泛采用。相较之前的标准,Wi-Fi 6 无线接入点(AP)能提供更大的带宽、更高的并发用户数、以及更低的时延。

Tolly 从市场上选取了几款华为最新 Wi-Fi 6 无线接入点 AirEngine 6761-21、AirEngine 5761R-11、AIrEngine 5761R-11E、AirEngine 5762-12、AirEngine 5762-12SW 以及 AirEngine 5762-15HW,验证了其部分最新功能。同时,Tolly 工程师测试了上述华为 Wi-Fi 6 AP 的单用户性能以及 AirEngine 6761-21T AP 的整机多用户性能。




Huawei Technologies, Co.Ltd Document number: 222114
Huawei CloudEngine S5731-S Series Switches Performance Evaluation and Feature Validation
Release date: 22 February 2022

Huawei CloudEngine S5731-S series switches are standard gigabit switches with GbE access ports and 10GbE uplink ports. They are ideal to be deployed in the aggregation or access layer of campus networks, and in the access layer of data center networks.

Tolly engineers evaluated Huawei CloudEngine S5731-S series switches’ performance and validated their features. Built upon Huawei’s high performance Versatile Routing Platform (VRP) software, CloudEngine S5731-S series switches can be configured locally or work in cloud- managed mode to be managed by Huawei Agile Controller. CloudEngine S5731-S series switches also support numerous security features and can interoperate with Huawei Cybersecurity Intelligence System (CIS) for Encrypted Communications Analytics (ECA) and network-wide threat deception.




Hughes Network Systems, LLC Document number: 222102
Benchmarking Hughes Hybrid Broadband vs. Terrestrial Broadband User Experience and Resiliency Evaluation
Release date: 17 February 2022

The importance of broadband Internet to families and households is well known, as it provides the connectivity required for remote learning, work-from-anywhere, video collaboration, telehealth, entertainment and other applications. A key metric that measures the effectiveness of broadband service in supporting these applications is Quality of Experience (QoE). The International Telecommunications Union (ITU) defines QoE as the “overall acceptability of an application or service, as perceived subjectively by the end user.” One example of a QoE metric is Mean Opinion Score (MOS) which measures user experience for Voice over IP (VoIP).

Hughes Network Systems, LLC (HUGHES), commissioned Tolly to benchmark the QoE of commonly used applications across their hybrid satellite and wireless broadband solution compared to a terrestrial broadband service. The Hughes hybrid solution is a multi- transport, high-performance, resilient service that supports high-bandwidth applications and latency-sensitive applications by combining satellite and wireless technology into a seamless end-user experience.

Applications tested included web browsing, videoconferencing, HD video streaming, gaming and VoIP. Results were judged both quantitatively (e.g., web browsing) and subjectively (e.g., video and gaming), using a 0-5 scale, where 0 is poor and 5 is excellent. Both the hybrid and the terrestrial services tested were configured for 100/20Mbps speeds.

Tests showed that the Hughes hybrid broadband solution provided a high quality user experience across all the different application types tested, delivering the highest score (excellent) across all applications.




Hughes Network Systems, LLC Document number: 222102Preview
Benchmarking Hughes Hybrid Broadband vs. Terrestrial Broadband User Experience and Resiliency Evaluation
Release date: 14 February 2022

The importance of broadband Internet to families and households is well known, as it provides the connectivity required for remote learning, work-from-anywhere, video collaboration, entertainment and other applications. A key metric that measures the effectiveness of broadband service in supporting these applications is Quality of Experience (QoE). ITU defines QoE as the “overall acceptability of an application or service, as perceived subjectively by the end user…” A good example of QoE metric is MOS (Mean Opinion Score) which measures user experience for VoIP.

Hughes Network Systems commissioned Tolly to benchmark the application QoE of commonly used applications across the Hughes broadband hybrid solution (HughesNet Fusion) and a terrestrial broadband solution. HughesNet Fusion is a hybrid, high-performance, highly resilient solution that supports both high-bandwidth applications and applications that require low latency by combining satellite and wireless technology into a seamless end-user solution.

Applications tested included web browsing, videoconferencing, HD video streaming, gaming and VoIP. Results were judged quantitatively (web browsing) and subjectively (video and gaming), using a 0-5 scale, where 0 is poor and 5 is excellent. Both systems were configured for 100/20Mbps bandwidths. .

Tests showed that the Hughes hybrid broadband solution provided the high quality user experience across all of the different application types tested, delivering the highest score (Excellent) across all applications.




New H3C Technologies Co., Ltd Document number: 222103Summary
H3C Application-Driven Campus (AD-Campus) Solution Feature Validation
Release date: 10 February 2022

Campus networks have great challenges in the face of increased mobility, emerging IoT and abundant applications. How to integrate applications with network infrastructure, ensure experience consistency, and simplify network management, it leads to a good subject for new generation campus solutions.

The H3C Application-Driven Campus (AD-Campus) solution converts campus network from “user adapts to network” to “network adapts to users”, enabling users and devices to roam around campus seamlessly and securely. Powered by H3C SeerAnalyzer and technologies such as gRPC, Telemetry Stream and ERSPAN etc, it reduces complexity of network deployment and maintenance and meets the increased requirements of mobility and IoT access in campus network in digital transformation.

The H3C AD-Campus solution adopts “cloud & intelligence native” architecture, which integrates management, control, and analysis capability with AI empowerment and unified management convergence of all scenarios covering campus network, WAN, and datacenter network.




Infoblox, Inc Document number: 222100
Infoblox BloxOne Threat Defense vs. Cisco Umbrella DNS-Layer Security Evaluation
Release date: 11 January 2022

Cyberthieves are constantly developing new methods to breach corporate networks, deploying various tactics that infiltrate typical cyberdefenses and create a “backdoor” in order to steal confidential data or deploy malicious tools such as ransomware.

For decades now firewalls and other security services have been in place to protect the direct interactions between corporate computers and external internet servers. As those security services protect against common attack techniques, hackers turned to other methods to evade detection, specifically for our discussion, the malicious use of Domain Name System (DNS) protocols.

DNS is used constantly by almost every IP-based device that needs to connect to other IP-based systems (e.g., computers, IoT devices and OT devices), and its presence is essential to the internet and IP networks in general. DNS translates queries for names of resources (like web sites or IoT/OT management servers) and returns IP address information that allows the connection to be established. The whole concept of DNS was to translate IP addresses to common names we can easily remember.

Because DNS originated as a relatively simple translation tool, it was considered benign, with DNS traffic typically allowed to pass through security solutions without additional inspection. Unfortunately, cyberattackers have developed new techniques to exploit DNS and use it to steal sensitive data from corporate networks as well as to infiltrate malware into the network.

Infoblox commissioned Tolly to evaluate the effectiveness of the Infoblox BloxOne® Threat Defense solution in key DNS-layer threat scenarios and compare those results against the Cisco Umbrella solution. Building on the Tolly report published in 2020, this report re-checks those scenarios and adds new scenarios. The Infoblox Threat Defense solution demonstrated greater effectiveness than Cisco Umbrella, as will be detailed shortly, and provided broader threat intelligence and ecosystem integration than the Cisco Umbrella offering.




New H3C Technologies Co., Ltd Document number: 221150
H3C SR6602-I ICT Converged Gateway Performance Evaluation and Feature Validation
Release date: 27 December 2021

In the cloud-era, and especially with the global change to remote working, gateway devices have become extremely important for ISPs and enterprises. Gateway devices need to provide comprehensive support for WAN protocols, multiple VPN types, advanced forwarding modes such as MPLS and SRv6, high availability features, easy operations and maintenance functions, strong security, and SD-WAN technology to provide good user experience for remote workloads and various cloud services.

The H3C SR6602-I ICT converged gateway is powered by the Intel Xeon CPU and H3C’s Comware v9 software with integrated network, compute and storage capabilities. Its open architecture supports hosting OpenStack VMs and Kubernetes pods for value-added services. It supports high performance with numerous carrier-grade and enterprise-grade gateway features which make it an ideal and future-proof choice to be the gateway of carriers, governments, power industry, finance, education, and enterprise organizations.

H3C commissioned Tolly to evaluate SR6602-I ICT converged gateway’s performance, capacity, and features.




Proofpoint Document number: 221135-IG
Infographic: Cloudmark Platform For Mobile
Release date: 14 December 2021

For decades, email users have had to contend with junk mail as well as dangerous messages showing up in the inbox. The deluge of nuisance and malevolent messages that have targeted email users also now target mobile messaging users: spam, malware, phishing, and social engineering.

View the Infographic on the key takeaways from Cloudmark’s Carrier-Grade Mobile Messaging Security Capabilities

The full Tolly report can be downloaded from here.




Proofpoint Document number: 221135
Cloudmark Platform For Mobile Understanding Cloudmark’s Carrier-Grade Mobile Messaging Security Capabilities
Release date: 10 December 2021

For decades, email users have had to contend with junk mail as well as dangerous messages showing up in the inbox. The deluge of nuisance and malevolent messages that have targeted email users also now target mobile messaging users: spam, malware, phishing, and social engineering.

The problems are manifold for both the mobile network operator (MNO) and the user. Studies have shown that users are more likely to read and interact with mobile messages, including SMS, MMS, and RCS message types, than they are with email.

Legitimate traffic can present challenges as well. Application-to-Person (A2P) SMS traffic continues to grow. Unfortunately, some users attempt to bypass higher A2P message charges by sending this traffic on Person-to-Person (P2P) communications routes. This practice, known as using “grey routes,” deprives the MNO of legitimate revenue.

Since its founding nearly two decades ago, Cloudmark’s core focus has been messaging security. Over that time Cloudmark has built a security solution that leverages both artificial intelligence (AI) and machine learning (ML) to enhance and automate message security. Cloudmark supports various mobile messaging standards including SMS, MMS, and Rich Communications Services (RCS) messaging.




New H3C Technologies Co., Ltd Document number: 221154Summary
H3C Application-Driven Data Center (AD-DC) Solution Feature Validation
Release date: 06 December 2021

The H3C Application-Driven Data Center (AD-DC) solution adopts “cloud & intelligence native” architecture, which integrates management, control, and analysis capability with AI empowerment and unified management convergence of all scenarios covering campus network, WAN, and data center network.

The H3C AD-DC solution provides rich network services (NaaS) and security services (SECaaS). It provides automated full-lifecycle data center network management and a unified network architecture to connect bare metal servers, virtual machines and containers. Powered by H3C SeerAnalyzer and technologies such as gRPC, Telemetry Stream, ERSPAN and in-band telemetry (INT), AD-DC could achieve millisecond-precision data capture, megascale VM data analysis, and real-time fault detection, reducing the OPEX of data center greatly. Besides, H3C AD-DC provides extensive integration with OpenStack, virtual machine managers, and customers’ existing management and orchestration frameworks and security devices to build an open and programmable platform.




Ruijie Networks Co., Ltd. Document number: 221153
Reyee Wi-Fi 6 (802.11ax) Access Points and Ethernet Switches Comparative Performance Evaluation vs. Aruba/Ubiquiti and Feature Validation
Release date: 06 December 2021

Wi-Fi 6 is the latest generation Wi-Fi technology that brings improvements in individual device and overall system throughput. Built upon more than 16 years experience in the WLAN and Ethernet switch market. Reyee (a sub-brand of Ruijie Networks Co., Ltd.) developed a series of Wi-Fi 6 wireless access points, Ethernet switches, and routers for small and medium-sized enterprise (SME) networks with powerful performance and easy-to-use cloud management features. Ruijie Cloud offers life-time free cloud management for the Reyee network devices. Users can manage and monitor the network using a Web browser or the Ruijie Cloud app anytime from anywhere via the Internet.

Ruijie commissioned Tolly to evaluate the performance of the Reyee wireless access points and Ethernet switches as well as their features. Test results demonstrated that the Reyee Wi-Fi 6 access points provide supervisor performance and outperform the access points from other vendors tested. The Reyee Ethernet switches support 100% line-rate forwarding using all ports for all standard frame sizes with zero frame loss. Reyee's self- organizing network feature provides a pioneering solution in the provisioning of network devices. Without a controller, Reyee devices automatically form a network, and the entire network can be managed visually. The easy-to-use cloud managed Reyee products are ideal to provide high performance wired and wireless networks for SMEs.




Ruijie Networks Co., Ltd. Document number: 221149
Reyee Wi-Fi 6 (802.11ax) Home WLAN Access Points Comparative Performance Evaluation vs. NETGEAR and TP-Link
Release date: 18 November 2021

Wi-Fi 6 is the latest generation Wi-Fi technology that brings improvements in individual device and overall system throughput. Built upon more than 15 years experience in the WLAN market, Ruijie Networks Co., Ltd. developed a series of Wi-Fi 6 access point models to cover different application scenarios. Now, Wi-Fi 6 technology is coming to the home market where demand for Wi-Fi connectivity and bandwidth has surged. Today, It is not uncommon for homes to have dozens of devices connected to Wi-Fi at any given time. In addition to computers and smartphones, Smart TVs, thermostats, cameras, doorbells, lighting, sensors and more now have persistent Wi-Fi connections.

Ruijie commissioned Tolly to evaluate the performance of its Reyee (sub-brand) standalone and mesh Wi-Fi 6 home access points against similar models from NETGEAR and TP-Link. Tests included multiple user tests of up to 78 simultaneous users, single-client maximum performance tests, and signal coverage tests. Tests were run both at 2.4GHz and 5GHz frequencies.




SonicWall Document number: 221148
SonicWall NSsp 13700 Next-Generation Firewall (NGFW) Strategic Analysis vs. Fortinet FG-2600F
Release date: 16 November 2021

Remote working and cloud computing have had a major impact on the way that enterprises conduct business. Universally, the shift to distributed work has put a focus on both security and connectivity. Or, in the context of this report, next- generation firewalls and SD-WANs. Given the array of services available, and the cost differential across vendors, it is prudent to analyze offerings before proceeding with an NGFW acquisition. SonicWall has designed its NSsp 13700 to excel in protection of large enterprises while maintaining an industry-leading price- performance ratio.

SonicWall commissioned Tolly to review the published specifications of its NSsp 13700 and compare it to Fortinet’s FG-2600F. Analysis was primarily focused on evaluating key total cost of ownership (TCO) metrics of the comparable solutions.

The Tolly analysis shows that SonicWall has a dramatically lower 3-year TCO for High-Availability (HA) deployments compared to Fortinet while providing comparable or better security feature sets and performance characteristics. The TCO is enhanced by SonicWall’s High Availability licensing policy allowing a single firewall license to be used for both the primary and secondary (HA) appliance.




VMware, Inc. Document number: 221128
User Experience with VMware SD-WAN Work-from-Anywhere with Dual WAN Links
Release date: 12 November 2021

The flexibility and ease-of-use of SD-WAN has made it extraordinarily popular as the “next-gen” WAN for organizations large and small. SD-WAN’s network overlay topology can also provide significant benefits for end-user experience while maintaining solid throughput performance. VMware SD- WAN™ can automatically remediate packet loss and deliver a high-quality experience even under adverse network conditions. Dual WAN link deployments further enhance the user experience by providing even greater flexibility, robustness and higher aggregate throughput.

VMware and Intel commissioned Tolly to benchmark the quality-of-service and remediation capabilities of VMware SD-WAN to improve the end-user experience for voice-over-IP (VoIP) and work-from-anywhere (WFA) applications using a dual WAN link deployment. Additionally, Tolly benchmarked the packet throughput of VMware SD-WAN.

VMware SD-WAN delivered good voice quality (MOS of 4.31) across dual links even with packet loss levels of 15% and latency of 150ms with 20ms jitter. See Figures 1 & 2 respectively. VMware SD-WAN demonstrated automatic optimization for dual WAN links by automatically preferring the low latency link. File download of a 250MB video from Microsoft OneDrive illustrated that download continued after one link was failed. With both links active, a single download session was able to use bandwidth from both links for a faster download. Additionally, VMware SD-WAN Edge 640 delivered 3Gbps of device throughput across a pair of devices.




VMware, Inc. Document number: 221128ZH
VMware SD-WAN ⽤户体验 使⽤双 WAN 链接随时随地⼯作
Release date: 12 November 2021

SD-WAN 的灵活性和易⽤性使其作为“下⼀代”⼴域⽹,在各类企业和机构中异常受 欢迎。SD-WAN 的 overlay ⽹络在保持稳定的吞吐量性能的同时,还能为终端⽤户 的体验带来显著的好处。VMware SD-WAN™ 可以⾃动补救数据包丢失,即使在 不佳的 WAN ⽹络条件下也能为⽤户提供⾼质量的体验。双 WAN 链路的部署提供 更⼤的灵活性、稳健性和更⾼的总吞吐量,进⼀步增强了⽤户体验。

VMware 和 Intel 委托 Tolly 对 VMware SD-WAN 的服务质量和对较差⽹络状况的 补救能⼒进⾏了基准测试,以评估该⽅案在使⽤双 WAN 链路部署时,承载 IP 语⾳ (VoIP)和随时随地⼯作(WFA)应⽤的终端⽤户体验。此外,Tolly 还对 VMware SD-WAN 的数据包吞吐量进⾏了基准测试。

即使在 WAN 链路有 15% 丢包率,150ms 延迟,20ms 抖动的情况下,VMware SD-WAN 在双链路上也提供了良好的语⾳通话质量(MOS 为 4.31)。请分别参⻅ 图 1 和图 2。 VMware SD-WAN 展示了对双 WAN 链路的⾃动优化,⾃动优先选 择低延迟的链路。从微软 OneDrive 下载⼀个 250MB 的视频,即使在⼀个链接故 障后,下载仍在继续。在两条链路都激活的情况下,单个下载会话能够使⽤两条链 路的叠加带宽,以实现更快的下载。此外,两台 VMware SD-WAN Edge 640 设备 间可实现总共 3Gbps 的设备吞吐量。




Apposite Technologies Document number: 221140
Apposite Netropy Traffic Generation L2-L3 & L4-L7 Ease of Use and Features
Release date: 04 November 2021

Benchmarking is essential if companies are going to deliver on service level agreements (SLA). Validating the traffic handling characteristics of networks, applications and security solutions is the only way to deliver services with confidence. Traffic generators have been available for quite some time. In many cases, though, the complexity and expense of traffic generators has kept them out of all but the larger enterprise labs. Apposite seeks to redefine the traffic generator with its Netropy series. Netropy Traffic Generation delivers a wide range of L2-L3 and L4-L7 functions all using a browser-based GUI and at a price point attractive even to smaller companies.

Apposite Technologies commissioned Tolly to evaluate the ease-of-use features of its Netropy Traffic Generation solution, specifically the Netropy TrafficEngine -one of four applications available. Testing was conducted using the Netropy 10G2 platform that provided four ports capable of 10GbE. In addition to confirming wire throughput capabilities, Tolly exercised a range of throughput testing scenarios.

Tolly tests confirmed that the Netropy 10G2 can send and receive zero-loss, wire-speed 10GbE traffic on both sets of ports simultaneously. Tolly engineers were able to configure both lower-level and upper-level protocol tests without any product training using the browser based GUI.




New H3C Technologies Co., Ltd Document number: 221142
H3C SD-WAN Solution H3C AD-WAN (Application-Driven SD-WAN) Functionality Validation
Release date: 02 November 2021

With the development of cloud computing, mobile Internet and other application modes, and the change of traffic pattern, the network needs to actively "adapt" to the demands of application traffic, and change as needed. The H3C Application-Driven SD- WAN (AD-WAN) solution can improve the remote user application experience, as fast and as secure as accessing local applications. It can meet various networking needs such as enterprise self-built and internet service provider-operated SD-WAN, and support all-scenario connectivity between headquarters, branches, data centers, and the cloud, as well as large-scale flexible networking and ISP POP networking.

H3C commissioned Tolly to evaluate the AD-WAN solution. The results show that the H3C AD-WAN solution can not only implement traditional SD-WAN functions, but also expand and extend SD-WAN.




New H3C Technologies Co., Ltd Document number: 221142ZH
新华三 AD-WAN(应用驱动 SD-WAN)解决方案 功能验证
Release date: 02 November 2021

伴随着云计算、移动互联网等应用模式的发展和流量模型的改变,网络需要主动“适应”应用流量的需求,做到随需而变。新华三 AD-WAN(应用驱动 SD-WAN)解决方案方案可以保证用户在各站点应用体验不变,像访问本地应用一样快,一样安全。可以满足企业自建和公有云等各种组网需求,支持总部、分支、数据中心以及云之间的全场景连接,支持大规模灵活组网和运营商 POP 组网。

H3C 委托 Tolly 评估了 AD-WAN 方案,结果显示新华三 AD-WAN(应用驱动 SD-WAN)解决方案不仅可以实现标准的 SD-WAN 功能,而且也进行了 SD-WAN 的扩展和延伸,主要体现在:

1. 降低客户成本

2. 提升用户体验

3. 全面的安全

4. 可视化智能化运维。

除此之外,新华三 AD-WAN(应用驱动 SD-WAN)解决方案支持多种设备形态,CPE,uCPE 以及 vCPE,支持路由器和防火墙的混合组网,以及 WAN & LAN 融合。




Spirent Communications Document number: 221151
Tolly on Technology - Leveraging Low-Latency 5G and Cloud Services - Conversation with Spirent
Release date: 26 October 2021

Tolly Group Founder, Kevin Tolly hosts a Video Podcast discussing Leveraging Low-Latency 5G and Cloud Services with Spirent Communications.

The Tolly on Technology Video Podcast series is a thought leadership podcast that interview experts on trends and best practices for IT leaders.

Kevin is joined by Spirent's Ken Rosenberg discusses the challenges of benchmarking 5G+Cloud Compute environments. Find out Spirent's perspective on Leveraging Low-Latency 5G and Cloud Services and what unique challenges it offers users.

Tolly on Technology Landing Page.
(Note: There is no download for this Video Podcast item.)




SonicWall Document number: 221139
SonicWall NSsp 13700 Next-Generation Firewall (NGFW) Strategic Analysis vs. Palo Alto Networks PA-5250
Release date: 19 October 2021

Remote working and cloud computing have had a major impact on the way that enterprises conduct business. Universally, the shift to distributed work has put a focus on both security and connectivity. Or, in the context of this report, next- generation firewalls and SD-WANs. Given the array of services available, and the cost differential across vendors, it is prudent to analyze offerings before proceeding with an NGFW acquisition. SonicWall has designed its NSsp 13700 to excel in protection of large enterprises while maintaining an industry-leading price- performance ratio.

SonicWall commissioned Tolly to review the published specifications of its NSsp 13700 and compare it to Palo Alto Networks’ PA-5250. Analysis was mainly focused on evaluating key total cost of ownership (TCO) metrics of the comparable solutions.

The Tolly analysis shows that SonicWall has a dramatically lower 3-year TCO for high-availability (HA) deployments compared to Palo Alto Networks while providing comparable or better security feature sets and performance characteristics. The TCO is enhanced by SonicWall’s High Availability licensing policy allowing a single firewall license to be used for both the primary and secondary (HA) appliance.




Huawei Technologies, Co.Ltd Document number: 221144ZH
华为 CloudEngine S5731-S 系列交换机 性能测试和功能验证
Release date: 04 October 2021

华为 CloudEngine S5731-S 系列交换机是标准型千兆交换机,采用华为自研 ARM 架构 CPU 和 Solar 交换芯片,具有全千兆电口接入和固定万兆上行端口。它们适合部署在企业园区接入和汇聚、数据中心接入等多种应用场景。

Tolly 工程师测试了华为 CloudEngine S5731-S 系列交换机的性能并验证了其功能。CloudEngine S5731-S 可以在本地配置,也可运行在云管理模式,通过华为 Agile Controller 进行管理。CloudEngine S5731-S 系列交换机还支持大量的安全功能,并可以和华为 Cybersecurity Intelligent System(CIS)联动实现全网安全协防,进行加密通信分析(ECA)和威胁诱捕。

测试结果适用于所有华为 CloudEngine S5731-S 型号,包括 CloudEngine S5731-S24T4X、CloudEngine S5731-S24P4X、CloudEngine S5731-S48T4X 以及 CloudEngine S5731-S48P4X。




Huawei Technologies, Co.Ltd Document number: 221145ZH
华为 CloudEngine S5736-S 系列交换机 性能测试和功能验证
Release date: 04 October 2021

华为 CloudEngine S5736-S 系列交换机包括 CloudEngine S5736-S 系列多速率交换机和 CloudEngine S5736-S 系列全光交换机。

CloudEngine S5736-S 系列全新一代全万兆多速率以太网交换机,提供 24 端口万兆多速率全电款型,上行 4 个 10GE 端口,同时提供一个扩展卡插槽。可广泛应用于大中型企业园区汇聚/接入、小微型数据中心接入等多种应用场景。

CloudEngine S5736-S 系列新一代标准型全光千兆以太网交换机,提供 48 光口款型,上行 4 个 10GE 端口。可广泛应用于城域接入、企业园区接入和汇聚、数据中心接入等多种应用场景。

Tolly 工程师测试了华为 CloudEngine S5736-S 系列交换机的性能并验证了其功能。




Huawei Technologies, Co.Ltd Document number: 221144
Huawei CloudEngine S5731-S Series Switches Performance Evaluation and Feature Validation
Release date: 04 October 2021

Huawei CloudEngine S5731-S series switches are standard gigabit switches with GbE copper access ports and 10GbE uplink ports. They are ideal to be deployed in the aggregation or access layer of campus networks, and in the access layer of data center networks.

Tolly engineers evaluated Huawei CloudEngine S5731-S series switches’ performance and validated their features. Built upon Huawei’s high performance Versatile Routing Platform (VRP) software, CloudEngine S5731-S series switches can be configured locally or work in cloud- managed mode to be managed by Huawei Agile Controller. CloudEngine S5731-S series switches also support numerous security features and can interoperate with Huawei Cybersecurity Intelligence System (CIS) for Encrypted Communications Analytics (ECA) and network-wide threat deception.




Huawei Technologies, Co.Ltd Document number: 221145
Huawei CloudEngine S5736-S Series Switches Performance Evaluation and Feature Validation
Release date: 04 October 2021

Huawei CloudEngine S5736-S series switches include CloudEngine S5736-S Series Multi-GE Switches and CloudEngine S5736-S Series All- Optical Switches.

CloudEngine S5736-S Series Switches standard multi-GE access switches are for the Wi-Fi 6 era, featuring 24 downlink ports, four 10 GE SFP+ uplink ports, and one extended slot. They are designed to work with Wireless Local Area Network (WLAN) Access Points (APs) in campus networks.

CloudEngine S5736-S Series Switches next generation standard all-optical GE switches have 48 downlink optical ports and four 10 GE uplink ports. They can be used as access or aggregation switches on campus networks or as access switches on Metropolitan Area Networks (MANs) or data center networks.

Tolly engineers evaluated Huawei CloudEngine S5736-S series switches’ performance and validated their features.




Huawei Technologies, Co.Ltd Document number: 221138
Competitive Test of Huawei Lossless Ethernet Solution for Hyper-converged Data Center Networks Centralized Storage: Huawei Ethernet-based NoF+ vs. Fibre Channel HPC: Huawei Lossless Ethernet vs. InfiniBand
Release date: 25 September 2021

Traditional data centers may be built on multiple fabrics – Ethernet for server interconnection, Fibre channel for storage networks, and InfiniBand for high performance compute clusters.

With new development of Ethernet, such as lossless Ethernet technologies, high performance Ethernet NICs supporting RDMA and MPI, NVMe over RoCE all-flash storage systems, Ethernet-based data center network solutions started to replace Fibre Channel and InfiniBand solutions to provide equivalent or better performance. Furthermore, Ethernet solutions are typically more cost effective. They are supported by more vendors. And 400G Ethernet switches are widely available on market now while current Fibre Channel switches typically only support up to 64G FC ports. For all these reasons, modern data centers are moving from the multi-protocol mode towards converged all-Ethernet.

Based on the considerations above, Huawei launched the hyper-converged data center networks CloudFabric 3.0 solution. It consists of two components: Huawei CloudEngine data center switches, and Huawei iMaster NCE-Fabric, an intelligent network management and control system.

Huawei commissioned Tolly to evaluate Huawei’s lossless Ethernet data center network solution, and compare it with Fibre Channel in storage area network test cases and with InfiniBand in high performance computing scenarios.




Huawei Technologies, Co.Ltd Document number: 221138ZHSummary
华为超融合数据中心网络无损以太网络方案对比测试 集中式存储:华为 NoF+ 方案 vs. FC 方案 vs. H3C 无损以太网方案 HPC:华为无损以太网络方案 vs. InfiniBand 方案
Release date: 25 September 2021

传统数据中心可能建立在多个架构(Fabric)上,包括用于服务器互连的以太网、用于存储网络的光纤通道(Fibre Channel - FC)以及用于高性能计算集群的 InfiniBand(IB)。

随着以太网的新发展,例如无损以太网技术、支持 RDMA 和 MPI 的高性能以太网网卡、以及 NVMe over RoCE 全闪存存储系统等,基于以太网的数据中心网络解决方案开始取代光纤通道和 InfiniBand 解决方案,并提供等效或更好的表现。此外,以太网解决方案通常更具成本效益,并得到了更多供应商的支持。现在市场上已广泛存在 400G 以太网交换机,而当前的光纤通道交换机通常最多只支持 64G FC 端口。 由于这些原因,现代数据中心正在从多协议模式转向融合全以太网。

基于以上考虑,华为技术有限公司推出了超融合数据中心网络 CloudFabric 3.0 解决方案。它由两部分组成:华为 CloudEngine 数据中心交换机和华为智能网络管控系统 iMaster NCE-Fabric。

华为委托 Tolly 对华为基于以太网的数据中心网络解决方案进行测试,并在存储测试用例中与光纤通道解决方案进行性能对比,以及在高性能计算场景中与 InfiniBand 方案进行性能对比。




Huawei Technologies, Co.Ltd Document number: 221138ZH
华为超融合数据中心网络无损以太网络方案对比测试 集中式存储:华为 NoF+ 方案 vs. FC 方案 vs. H3C 无损以太网方案 HPC:华为无损以太网络方案 vs. InfiniBand 方案
Release date: 25 September 2021

传统数据中心可能建立在多个架构(Fabric)上,包括用于服务器互连的以太网、用于存储网络的光纤通道(Fibre Channel - FC)以及用于高性能计算集群的 InfiniBand(IB)。

随着以太网的新发展,例如无损以太网技术、支持 RDMA 和 MPI 的高性能以太网网卡、以及 NVMe over RoCE 全闪存存储系统等,基于以太网的数据中心网络解决方案开始取代光纤通道和 InfiniBand 解决方案,并提供等效或更好的表现。此外,以太网解决方案通常更具成本效益,并得到了更多供应商的支持。现在市场上已广泛存在 400G 以太网交换机,而当前的光纤通道交换机通常最多只支持 64G FC 端口。 由于这些原因,现代数据中心正在从多协议模式转向融合全以太网。

基于以上考虑,华为技术有限公司推出了超融合数据中心网络 CloudFabric 3.0 解决方案。它由两部分组成:华为 CloudEngine 数据中心交换机和华为智能网络管控系统 iMaster NCE-Fabric。

华为委托 Tolly 对华为基于以太网的数据中心网络解决方案进行测试,并在存储测试用例中与光纤通道解决方案进行性能对比,以及在高性能计算场景中与 InfiniBand 方案进行性能对比.




Huawei Technologies, Co.Ltd Document number: 221138Summary
Competitive Test of Huawei Lossless Ethernet Solution for Hyper-converged Data Center Networks Centralized Storage: Huawei Ethernet-based NoF+ vs. Fibre Channel HPC: Huawei Lossless Ethernet vs. InfiniBand
Release date: 25 September 2021

Traditional data centers may be built on multiple fabrics – Ethernet for server interconnection, Fibre channel for storage networks, and InfiniBand for high performance compute clusters.

With new development of Ethernet, such as lossless Ethernet technologies, high performance Ethernet NICs supporting RDMA and MPI, NVMe over RoCE all-flash storage systems, Ethernet-based data center network solutions started to replace Fibre Channel and InfiniBand solutions to provide equivalent or better performance. Furthermore, Ethernet solutions are typically more cost effective. They are supported by more vendors. And 400G Ethernet switches are widely available on market now while current Fibre Channel switches typically only support up to 64G FC ports. For all these reasons, modern data centers are moving from the multi-protocol mode towards converged all-Ethernet.

Based on the considerations above, Huawei launched the hyper-converged data center networks CloudFabric 3.0 solution. It consists of two components: Huawei CloudEngine data center switches, and Huawei iMaster NCE-Fabric, an intelligent network management and control system.

Huawei commissioned Tolly to evaluate Huawei’s lossless Ethernet data center network solution, and compare it with Fibre Channel in storage area network test cases and with InfiniBand in high performance computing scenarios.




Dell Technologies Document number: 221129
Dell EMC CloudIQ for PowerEdge Server Infrastructure Insights
Release date: 22 September 2021

Managing datacenters can be very challenging. The rise of the internet of things (IoT) has driven growth in distributed edge computing and many system admins support systems from remote locations or home on a regular basis. Real intelligence is needed to manage systems effectively.

With these needs in mind, Dell Technologies several years ago introduced Dell EMC CloudIQ, a cloud-native application that combines machine intelligence and human intelligence, provides IT administrators with a single-pane-of-glass view of their storage systems globally. Dell EMC CloudIQ has now been extended to include Dell EMC PowerEdge Server systems.

Dell Technologies commissioned Tolly to validate the “Time to Value” and “Time to Insight” of CloudIQ in conjunction with managing Dell PowerEdge servers. Tolly found a rapid time to value of under 30 minutes and time to insight that is 3X faster for an average Dell EMC customer.




Keysight Technologies Document number: 221146
Tolly on Technology Video Podcast: Benchmarking Cloud Environments - Conversation with Keysight
Release date: 20 September 2021

Tolly Group Founder Kevin Tolly hosts a Video Podcast discussing Benchmarking Cloud Environments with Keysight Technologies.

The Tolly on Technology Video Podcast series is a thought leadership podcast that interview experts on trends and best practices for IT leaders.

Kevin is joined by Keysight Technologies, Amritam Putatunda, Technical Product Manager to discuss the challenges of benchmarking cloud environments. Find out Keysight Technologies perspective on Benchmarking Cloud Environments and what unique challenges it offers users.

Tolly on Technology Landing Page.
(Note: There is no download for this Video Podcast item.)




Citrix Systems, Inc. Document number: 221100KO
Citrix ADC VPX F5 BIG-IP Virtual Edition과 성능 비교
Release date: 08 September 2021

ADC(Application Delivery Controller)는 인터넷의 보이지 않는 일꾼입니다. 둘 이상의 서버로 구성된 모든 백엔드 애플리케이션은 프런트 엔드에 특정 유형의 ADC를 가지고 있어 사용자에게 전달을 최적화합니다. 
Citrix ADC VPX(구명칭 NetScaler)는 지연 시간이 짧은 고성능 트래픽 관리 기능을 제공하여 최종 사용자 환경을 개선하도록 설계되었습니다.

Citrix Systems 는 Tolly 에게 Citrix ADC VPX 가상 어플라이언스의 성능을
벤치마킹하고 F5 BIG-IP VE(Virtual Edition)와 비교하도록 의뢰했습니다.
테스트는 Amazon Web Services(AWS) 환경에서 실행되었으며 다양한 암호화 프로토콜을 사용하는 ADC 및 웹 애플리케이션 방화벽(WAF) 기능에 대한 테스트가 포함되었습니다. 테스트는 응답성, 트랜잭션 처리량 및 궁극적으로 최종 사용자 경험의 지표로 지연 시간을 측정하는 데 중점을 두었습니다. 테스트는 흐름의 최악의 1%의 지연 시간을 측정하는 P99 지연 시간을 측정했습니다.

Citrix ADC VPX 는 모든 테스트 시나리오에서 F5 BIG-IP VE 보다 성능이 
우수했으며, 비슷한 처리량 수준으로 벤치마킹할 때 낮은(더 좋은 성능)) 지연 시간과 낮은 CPU 사용률을 보였습니다. 그림 1 을 참조하십시오.




Huawei Technologies, Co.Ltd Document number: 221133
Huawei AirEngine Series Wi-Fi 6 Access Points Performance Evaluation and Feature Validation
Release date: 02 September 2021

Wi-Fi 6 is the latest Wi-Fi standard and is widely used by new mobile devices. Compared with earlier standards, Wi-Fi 6 access points (APs) provide higher bandwidth, a larger number of concurrent users, and lower latency.

Tolly verified some of the features of Huawei's latest mid-range Wi-Fi 6 indoor APs with smart antennas: AirEngine 6761-21T, AirEngine 5761-21, AirEngine 5761-11, AirEngine 5761-12W, AirEngine 5761-11W, and AirEngine 5761-11WD.

Tolly engineers also tested the performance of Huawei Wi-Fi 6 APs and compared their performance with those of Aruba, Cisco, H3C, and Ruijie Wi-Fi 6 APs in the same environment. Performance test results show that Huawei AirEngine indoor APs provide excellent performance and outperform counterpart products of other vendors in the areas tested.




NVIDIA Corporation Document number: 221125
NVIDIA Spectrum-3 vs Switch Built with Commodity Silicon 100/200/400GbE Performance Evaluation Evaluating Consistency & Predictability
Release date: 26 August 2021

Public/private cloud computing is the modern infrastructure model for delivering business-critical applications. The network fabric is the foundation of the modern data center. The network bandwidth of each tenant needs to be protected so that they are not negatively impacted by a “noisy tenant” sharing the same network infrastructure. Applications are built assuming that the network will deliver consistent and predictable performance with fair sharing of resources. Not all switches meet these basic requirements.

NVIDIA commissioned Tolly to benchmark the performance, fairness, and tenant isolation capabilities of its NVIDIA Spectrum-3 12.8Tbps switch and compared that to a switch built with a 12.8Tbps Commodity Silicon.




Broadcom Inc. Document number: 221134
Lenovo ThinkSystem Emulex LPe36002 Host Bus Adapter 64G Fibre Channel Performance vs. 32G and 16G HBA Modes
Release date: 24 August 2021

Data storage and retrieval is growing at an extraordinary pace. Analysts note that data grew world-wide by 4x in recent years and that database data warehousing will double in the next five years. Business Intelligence (BI) and Artificial Intelligence (AI) can dramatically increase data retrieval rates.

Next-generation Fibre Channel alone and in conjunction with next-generation PCIe 4.0 technology can provide dramatic improvements in application data throughput. Lenovo’s ThinkSystem Emulex Gen 7 LPe36002 64G Fibre Channel (64G) dual-port host bus adapter (HBA) leverages both 64G and PCIe 4.0.

Broadcom commissioned Tolly to benchmark the performance of the new adapter in terms of raw performance and compared to existing 32G Fibre Channel (32G) HBAs. The adapter demonstrated dual-port performance in excess of 11 million IOPS. Running relational database transaction benchmarks, the adapter effectively doubled performance by dramatically cutting run times. Similarly, the adapter leveraged PCIe 4.0 technology increasing application throughput to ~12,000MBPS compared to ~6,600MBPS maximum achieved on PCIe 3.0 servers.




Xena Networks Document number: 221114
Xena Networks Chimera Network Impairment Emulation Feature & Topology Support Evaluation
Release date: 23 August 2021

Unified Communication as a Service, UCaaS for short, has taken the world by storm of late. The Covid crisis necessitated remote working and remote working fueled UCaaS adoption. Assuring the quality of end-user experience (EUE) for VoIP and other UCaaS applications is an essential requirement. Understanding how VoIP and other apps behave under varying network conditions is a prerequisite for providing good EUE. Xena Networks Chimera provides sophisticated network impairment emulation to accomplish that task.

Xena Networks commissioned Tolly to evaluate the network impairment capabilities and topology support of Chimera. Chimera is available as a compact, 2-port standalone unit or as a module for greater port scaling in the Xena ValkyrieBay chassis.

Tolly tests confirmed the availability of a broad range of impairments that include drop, misordering, duplication, policing, shaping and others. Chimera also demonstrated flow corruption capabilities of IPv4 and also of the frame check sequence (FCS). Importantly, Chimera demonstrated transparent, line- rate traffic forwarding at 10, 25, 40, 50 & 100GbE link speeds.