Report Archive for

Click on a report title to go to the download page for that report.

Dell Technologies Dell EMC PowerEdge R7525 Virtual Desktop Infrastructure (VDI) Windows 10 Scalability vs. Prior-Generation Platform

Document number: 220108
Release Date: 20 Feb 2020

Virtualization of Windows 10 desktops is increasingly relied upon by organizations to provide a scalable and economical solution for large groups of corporate users. The new Dell EMC PowerEdge R7525 is built around the 2nd Gen AMD EPYC 7002 series CPU which boasts a re-architected memory structure to improve performance for VDI and other applications.

Dell Technologies commissioned Tolly to benchmark the VDI performance of the R7525 and compare that with performance of the prior generation platform. Additionally, tests were run to illustrate that 230 knowledge worker users per node could be supported on a 3-node system as well as graphical performance with GPUs. Tests focused on showing scalable VDI performance from a mid-range CPU.

Tolly found that the PowerEdge R7525 delivered better VDI performance than the predecessor system. Compared to public results from a prior test published in August 2018, the PowerEdge R7525 delivered better response time when lightly loaded as well as when running maximum load across 100, 140 and 200 users on a single system.
Virtualization
Lenovo Lenovo ThinkSystem NE2552E Flex Switch & QLogic QL45214 Ethernet Adapter Performance & Interoperability with Cisco Systems

Document number: 219147
Release Date: 04 Nov 2019

Virtualization and cloud computing environments demand both flexibility and high-performance switching. The Lenovo ThinkSystem NE2552E Flex Switch paired with the ThinkSystem QLogic QL45214 25Gb Ethernet adapter provides both. Slotting into the Lenovo Flex System Enterprise chassis, this switch offers up to 52 ports of 25GbE or 36 ports of 25GbE combined with 4 ports of 100GbE. The QL45214 provides high-performance, 25GbE server connectivity.

Lenovo commissioned Tolly to evaluate the performance and capacity of the NE2552E along with L2/L3 interoperability with the Cisco Systems Nexus 9000 switch. Testing also validated the performance benefits of using 25GbE rather than 10GbE for VMware vMotion virtual machine migration using the QLogic. QL45214 Ethernet adapter.

The Lenovo switches and QL45214 tested delivered wire-speed performance and low latency, demonstrated L2/L3 table capacity and illustrated the performance benefits of 25GbE for virtualized environments. Additionally, the switch demonstrated a range of L2 and L3 interoperability with the Cisco Systems 9000 switch.
Virtualization
Broadcom Inc. Broadcom NetXtreme® 25GbE Adapter Ethernet Adapter Impact on vSAN Performance: Competitive Comparison

Document number: 219123
Release Date: 04 Jun 2019

Hyperconverged infrastructure (HCI) combines virtualization, computer servers, the storage network and storage to provide a simplified architecture that offers both agility and lower total cost of ownership (TCO). HCI implementations such as VMware vSphere/vSAN can be optimized and deliver higher performance using 25GbE networking.

Broadcom commissioned Tolly to benchmark the vSAN storage networking performance of the Broadcom NetXtreme 25Gb Ethernet Adapter in a VMware hyperconverged environment and compare those results to similar Ethernet adapters from Intel, Marvell and Mellanox.

The Broadcom NetXtreme adapter outperformed the competing solutions in both IOPS and data throughput in all scenarios of 16KB blocks and higher.
Virtualization
Array Networks, Inc. Array AVX Platform Multi-Tenancy Benchmarks Performance and Scaling Benchmarks Using Next-Gen Firewall (NGFW)

Document number: 219116
Release Date: 13 May 2019

AVX Series network functions platforms host multiple Array and 3rd-party virtual appliances (VAs), providing the agility of virtualization with the guaranteed performance of dedicated appliances.

Depending on the model, the AVX Series runs up to 32 fully independent VAs in a single hardware platform. Dedicated CPU, SSL, memory, and I/O resources serve each virtual appliance. As a result, the AVX Series offers the equivalent of up to 32 dedicated physical appliances in two rack units, in which security and networking services can be assured of guaranteed and demonstrable performance.

Array Networks commissioned The Tolly Group to benchmark performance and scaling characteristics of the AVX platform using next-gen firewall (NGFW) virtual appliances from a market-leading vendor as an example application.

Tolly Group measured performance and scale by dividing the testing activity into three test scenarios. Test #1 consisted of running 16 small-sized NGFW virtual appliance instances on a single AVX9800 platform. Test #2 measurements were made with 8 medium-sized NGFW virtual appliance instances on a single AVX9800 platform. Test #3 measurements were taken with 4 large-sized NGFW virtual appliance instances on a single AVX 9800 platform.
Virtualization
Array Networks, Inc. Array Networks AVX Network Functions Platform Web Application Firewall (WAF) & Next-Gen Firewall (NGFW) SSL/TLS Offload Performance

Document number: 219113
Release Date: 09 Apr 2019

Virtual appliances (VAs) provide a cost-effective method for deploying perimeter security elements such as web application firewalls (WAFs) and next-generation firewalls (NGFWs). However, security solutions can suffer from severe performance degradation when cryptographic tasks like secure-sockets layer (SSL)/Transport Layer Security (TLS) processing are performed. By deploying on an Array Networks AVX Network Functions Platform – which provides hardware SSL/TLS acceleration – performance for 3rd-party security virtual appliances can be improved dramatically.

Array Networks commissioned Tolly to benchmark the performance of WAF and NGFW security VAs, from a market leading WAF vendor and from a market leading NGFW vendor. Testing was done first running unassisted and then benefiting from the Array Networks AVX hardware SSL/TLS offload capability. Tests showed dramatic improvement in both transaction processing and overall throughput when SSL/TLS processing was offloaded to the Array AVX platform.
Virtualization
Hewlett Packard Enterprise Proof of Concept - HPE Synergy Composable Infrastructure

Document number: 217120
Release Date: 23 Aug 2017

All hyperbole aside, “Composable Infrastructure” offers an approach to server provisioning that is a radical departure from prior solutions - and with radical benefits. HPE Synergy helps customers reduce complexity, deploy more rapidly and bring cloud-like speed to the corporate datacenter.

HPE commissioned Tolly to run common Proof of Concept (POC) test scenarios that would be applicable to most infrastructure customers. Tolly engineers worked through nearly 20 different scenarios across four key areas: infrastructure, stateless boot/streaming, storage provisioning, and network fabric configuration. The goal in each of these scenarios was to validate important capabilities of HPE Synergy.
Virtualization
Hewlett Packard Enterprise HPE BladeSystem Virtualized Desktop Infrastructure Performance HPE ProLiant WS460c Gen9 Graphics Server Performance with NVIDIA Tesla M6 GPUs

Document number: 217106
Release Date: 27 Jul 2017

Virtualized Desktop Infrastructure (VDI) solutions provide a scalable and efficient alternative to providing a standalone PC to each user. VDI has been deployed for high-end 3D CAD for over a decade. The benefits include faster model loads over high-speed data center networks, improved security and data leak prevention which enhances intellectual property protection. The HPE ProLiant WS460c Gen9 graphics blade server for HPE BladeSystem integrates NVIDIA technology to provide high-performance virtualization of graphics functions, thus positioning VDI as a viable solution to demanding graphics applications such as 3D computer-aided design (CAD) and visualization.

HPE commissioned Tolly to evaluate the VDI performance of the HPE ProLiant WS460c blade handling graphics-intensive tasks. Tests were conducted using virtualized Microsoft Windows 10 systems running on a VMware ESX 6.0 host.

Tests showed that the HPE/NVIDIA solution delivers effective virtualization of intense graphics functions thus providing a scalable virtualization solution for graphics-intensive users.
Virtualization
HP Inc HP t630 Thin Client Comparative Performance and User Experience Evaluation versus Dell Wyse 5060

Document number: 217123
Release Date: 19 Jul 2017

The growing popularity of cloud computing and the maturity of client virtualization ecosystems have brought forth new areas where thin client computing can provide cost effective solutions. Today’s thin client systems must have sufficient power to handle some levels of local processing and graphics demands including the latest-generation, high resolution UHD/4K displays.

HP commissioned Tolly to evaluate the performance and user experience of the HP t630 Thin Client and compare it to the Dell Wyse 5060 thin client solution. Tests encompassed both Windows and Linux operating systems.

The HP t630 Thin Client outperformed the comparable Dell Wyse system in a number of tests that included LAN/WAN visual experience, file upload/download of both Windows and Linux clients, and Windows-only 4K resolution playback and PassMark test suite.
Virtualization
Hewlett Packard Enterprise HPE NFV System Helion OpenStack Carrier-Grade Performance & Reliability Powered by Wind River Titanium Cloud

Document number: 216117
Release Date: 01 Jul 2016

NFVI performance is the basis for and key enabler of NFV deployment. Key components of NFVI that impact the performance are VIM, virtual switch, virtual compute, virtual storage and virtual network node. Benchmarking the performance of NFVI platforms provides insights into what type of performance service providers can achieve from VNFs hosted on the NFVI platform and the capacity of the NFVI platform in compliance with service level agreements (SLAs) for the VNFs.

Spirent Communications commissioned Tolly to evaluate the performance and reliability of the Hewlett Packard Enterprise (HPE) Helion OpenStack Carrier Grade (HCG) network functions virtualization (NFV) solution powered by Wind River Titanium Cloud. Tolly evaluated the solution performance in various virtual switch configurations and benchmarked recovery time in a variety of scenarios including VM Live migration, LAG failure, compute and controller failures. The solution delivered high-throughput, consistent performance and effective responses to failure scenarios.
Virtualization
Dell Technologies Dell PowerEdge FX2 Network Architecture Network Flexibility versus Cisco UCS

Document number: 216101
Release Date: 13 Jan 2016

While the introduction of rack server architecture has led to a revolution in the way that data centers are built, not all rack server solutions are the same. Differences in density, footprint, price and network architecture/performance can have a significant impact on the value proposition of a given solution. In particular, the goal of this project was to illustrate the practical and performance benefits of Dell’s flexible networking architecture.

Tests showed significant benefits of the Dell solution with respect to network architecture flexibility, network performance especially of “east/west” traffic, price, footprint and density.
Virtualization
Allot Communications Ltd. Allot Service Gateway Virtual Edition and Security VNF Carrier-Class Performance Evaluation: L4-7 Classification & URL Filtering

Document number: 215157
Release Date: 12 Oct 2015

Carrier environments need to be able to provide the highest network performance at a competitive price point. Network virtualization and virtualized services hold the key to achieving this goal. High-performance virtual network appliances built on standard, commercial off-the-shelf (COTS) hardware can deliver the “bang for the buck” that is sought after by network operators large and small.

Allot Communications commissioned Tolly to test a virtualized security service (i.e., Web URL Filtering) and the virtualized service framework that supports it - Allot Service Gateway Virtual Edition (Allot SG-VE). Together, they comprise an Allot Security virtualized network function (VNF) that is engineered to operate seamlessly in network functions virtualization (NFV) environments. That’s Allot’s vision for the future – to offer VNFs that have all the underlying capabilities built-in and pre-integrated so all a customer has to do is deploy an instance of the VNF and they are up and running.

The Allot Service Gateway Virtual Edition (referred to as “SG-VE” hereafter) demonstrated nearly 200Gbps of network throughput while running traffic classification and URL filtering functions common to carrier-grade networks.
Virtualization
Infoblox, Inc Infoblox Cloud Network Automation for VMware vRealize™ Suite Enabling Private/Hybrid Cloud with Core Network Services

Document number: 215106
Release Date: 13 Apr 2015

Enterprise IT departments are always striving to deliver high-quality, agile services to their business stakeholders – at the lowest possible cost. Deployments of virtualization platforms such as VMware provide server architects powerful flexibility in provisioning new environments for functions like application testing, staging and production rollouts. While underlying technologies used in private and hybrid clouds continue to improve, a gap in automation at the network layer drags down the speed and flexibility of truly realizing the power of elastic computing. Simply put, manual tasks and processes such as creating networks, assigning and tracking IP addresses and provisioning DNS records is a major bottleneck. While server and storage parameters can be configured and spun up in minutes, network setup tasks can take hours or days.

Infoblox commissioned Tolly to evaluate its Cloud Network Automation solution and the impact on the total cost of ownership (TCO) savings. This study focuses on the integration with VMware vRealize Automation* (formerly known as vCloud Automation Center) as a platform that leverages Infoblox functionality to decrease the amount of time and effort required to complete common tasks, eliminate provisioning delays and reduce business impacting errors in vRealize environments.
Virtualization
Symantec Corporation Symantec Backup Exec 2014 Performance Evaluation versus Symantec Backup Exec 2010

Document number: 214133
Release Date: 20 Nov 2014

Optimizing backup operations and reducing back-end storage via deduplication provide benefits that are both immediate and lasting. Symantec’s continuous development and investment in Backup Exec provides increased performance and contributes to improved operational efficiency.

Symantec commissioned Tolly to benchmark Symantec Backup Exec 2014 and compare key performance benchmarks with a predecessor version, Symantec Backup Exec 2010. Testing encompassed initial and incremental backup of Windows physical and virtual servers, as well as specialized application environments of Microsoft Exchange 2010 and Microsoft SQL Server 2012. Testing also evaluated deduplication which is critically important in virtualized environments.

Tests show that the short-term effort of upgrading results in long-term benefits of greater operational efficiency from the perspectives of both time and storage optimization.
Virtualization
Huawei Technologies, Co.Ltd Huawei CloudEngine 12800 Series Data Center Core Switch Performance, Virtualization, Data Center Features and Open Architecture Evaluation

Document number: 214119
Release Date: 24 Sep 2014

Huawei CloudEngine 12800 (CE12800) series switch is the high performance core switch developed by Huawei Technologies Co., Ltd. facing data centers and high end campuses.

Huawei commissioned Tolly to evaluate their CE12800 series switch’s performance, virtualization capability, data center features and open architecture.

Tolly engineers verified that the CE12800 series switch supported 1 million
FIB table entries, virtualization capability with Huawei’s Cluster Switch
System (CSS), Virtual System (VS) and “CSS+VS” technologies, numerous data
center features including TRILL, EVN, FCoE, DCB, VXLAN gateway and NVGRE
gateway as well as high availability with ISSU and NSR. Engineers also verified
that the 12*100GbE port line card on the CE12800 series switch provided
100% line-rate forwarding.
Virtualization
Huawei Technologies, Co.Ltd Huawei CloudEngine 7800/6800/5800 Series Data Center Switch Performance, Virtualization, Data Center Features and SDN Evaluation

Document number: 214120
Release Date: 24 Sep 2014

Huawei CloudEngine 7800/6800/5800 series switches are 40GbE/10GbE/GbE data center switches developed by Huawei Technologies Co., Ltd.

Huawei commissioned Tolly to evaluate their CE7800/6800/5800 series switch performance, virtualization capability, features and SDN functionalities.

Tolly engineers verified that the CloudEngine switches provided high performance with low power consumption, virtualization capability with Huawei’s iStack and SVF technologies, as well as numerous data center features including VEPA, TRILL, FCoE (FCF, NPV, FSB modes and DCB), and Huawei nCenter interoperation with VMware vCenter.

Tests also show that the CloudEngine switches supported OpenFlow SDN including interoperability with Huawei Agile Controller and the third party controller “Ryu”, L2/L3 line-rate forwarding, multiple flow tables, policy-based routing, and dynamic traffic engineering (TE).
Virtualization
Citrix Systems, Inc. Citrix CloudBridge 3000 Comparative Citrix XenDesktop WAN Optimization Evaluation

Document number: 214113
Release Date: 06 May 2014

WAN optimization buyers want to understand the performance of an appliance at reducing WAN bandwidth requirements while at the same time maintaining, or ideally, improving the user experience. The higher the compression of LAN data, the more value a WAN optimization solution provides. This higher compression means that a smaller leased circuit can be used, or the enterprise can accommodate more users in the future before migrating to a larger WAN connection. Citrix focuses on greater performance of the top enterprise applications, including Citrix XenDesktop and Citrix XenApp.

Citrix commissioned Tolly to evaluate the XenDesktop (HDX) WAN optimization performance of its CloudBridge 3000 and compare that to the performance of a commonly deployed WAN optimizer - referenced herein as Vendor X. The Citrix CloudBridge outperformed the competition in all tests.
Virtualization
Sophos Ltd. Sophos Antivirus for vShield v1.0 VMware Server and VDI Client Workload Performance versus Trend Micro Deep Security and McAfee MOVE Agentless

Document number: 214110
Release Date: 07 Apr 2014

A key element in the explosive growth of virtualization is the ability to drive the physical server hardware to higher, and more cost-efficient, utilization levels. With that in mind, it is important that server resources are not wasted by overly demanding antivirus (AV) solutions. VMware’s vShield Endpoint provides access to VM resources via a virtual appliance rather than by requiring agents on each VM.

Sophos commissioned Tolly to evaluate its Antivirus for vShield v1.0 solution and compare its performance to two other vShield-based offerings: McAfee MOVE Agentless 3.0 and Trend Micro Deep Security 9. Tests encompassed a range of VMware ESXi5.5 Microsoft Server 2008 virtual server applications including a web, database and file services. A virtual desktop infrastructure (VDI) environment with 120 Windows 7 Enterprise virtual machines on a host was also evaluated using a VMware View Planner 2.1 standard workload.

The Sophos solution demonstrated consistently better performance and, by inference, lower system resource demands than the McAfee and Trend Micro solution.
Virtualization
Kaspersky Lab Kaspersky Security для виртуальных сред 2.0 Сравнительный анализ производительности и эффективности антивирусной защиты в виртуальных средах VMware vSphere 5.1

Document number: 213132RU
Release Date: 16 Oct 2013

«Лаборатория Касперского» поручила компании Tolly оценить производительность и эффективность работы в виртуальных средах VMware vSphere 5 новой программы Kaspersky Security для виртуальных сред 2.0, не требующей установки антивирусных агентов, в сравнении с решениями конкурентов — Trend Micro Deep Security 8 SP2, McAfee MOVE Agentless Security 2.6 и Symantec SEP 12.1.2 (последний требует установки агентов).

Компания Tolly пришла к выводу, что Kaspersky Security для виртуальных сред 2.0 сочетает надежную защиту с эффективным использованием ресурсов гипервизора, обеспечивая меньшее среднее время отклика и более экономное использование физического диска по сравнению с другими решениями, участвовавшими в тестировании. Новое решение «Лаборатории Касперского» также предоставляет более высокий уровень защиты от угроз по сравнению с другими программами, не требующими установки антивирусных агентов
Virtualization
Kaspersky Lab Kaspersky Security for Virtualization v2.0 - Competitive Anti-virus Performance and Effectiveness in VMware vSphere 5.1 Virtual Environments

Document number: 213132
Release Date: 05 Aug 2013

In virtual environments, anti-virus (A/V) solutions can be implemented as a client-based agent, whereby all security processing takes place on the client, a virtual appliance that handles the A/V workload- or some hybrid of the two. As more users of virtual infrastructures begin to understand the advantages of virtualization-specific security solutions over traditional agent-based approaches, leading vendors have begun to take note, adding such virtualization-specific products to their portfolios. Efficient resource usage with minimal impact on the host and virtual infrastructure, specifically, are the primary benefits of using a solution optimized for a virtual environment.

Kaspersky Lab commissioned Tolly to benchmark the performance and effectiveness of its new, agentless Security for Virtualization v2.0 offering in VMware vSphere 5 virtual environments vs. agentless Trend Micro Deep Security 8 SP2 and McAfee MOVE Agentless Security 2.6 and agent-based Symantec SEP 12.1.2.

Tolly found that Kaspersky Security for Virtualization 2.0 blends efficient hypervisor resource usage with solid protection abilities by delivering lower average response times and disk usage than the other products tested. Kaspersky also defended against threats better than the the other agentless offerings under test.
Virtualization
Kaspersky Lab Kaspersky Security Center 9 Management of Physical and Virtual Environments vs. Trend Micro

Document number: 212118
Release Date: 21 Aug 2012

The benefits of server virtualization are so compelling that virtualized environments are now a part of business environments large and small. As with their physical counterparts, though, virtualized systems require security software to be installed and managed. Kaspersky Lab has designed their security management system to provide a consistent interface across both physical and virtual systems.

Kaspersky Lab commissioned Tolly to evaluate Kaspersky Security Management and comparable security management products from Trend Micro in a scenario where both physical and virtual systems are managed. Testing confirmed that Kaspersky users can administer both physical and virtual environments from a single security console, while users of the Trend Micro products need to install and use separate management products for physical and virtual environments.
Virtualization
Infoblox, Inc Infoblox IPAM Automation for VMware vCloud Director - IP Address and DNS Provisioning of VMware Virtual Machines

Document number: 212124
Release Date: 01 Aug 2012

Server virtualization platforms such as VMware vSphere provide enterprise server architects with enormous flexibility in provisioning new environments for functions like application testing, staging or production rollouts. For all its power, common functions, including creating and deleting collections of virtual machines (VMs), gathering information about the myriad virtual servers, virtual switches and virtual VLANs in one’s environment and provisioning a new physical server (ESXi host), still require manual networking configuration.

Infoblox commissioned Tolly to evaluate its IP address management (IPAM) automation solution for VMware. The Infoblox offering integrates with VMware vCenter Orchestrator as a plug-in and leverages Infoblox DNS functionality to decrease the amount of time and effort required to accomplish common tasks, eliminate errors and improve total cost of ownership (TCO) in VMware environments. With environments of 500 VMs, the staff costs of manual vApp provisioning and discovery can exceed $60,000. Since manual provisioning does not scale, effort increases linearly with the size of the virtual environment. According to Tolly calculations, the additional cost associated with manual provisioning in an environment of 5,000 VMs can exceed $600,000 per annum.
Virtualization
Symantec Corporation Symantec Endpoint Protection 12.1 vs. Trend Micro Deep Security 8 Anti-virus Performance in VMware ESXi Virtual Environments

Document number: 212117
Release Date: 07 May 2012

As IT architects scale deployments of virtual desktop infrastructure (VDI) solutions, they must be aware of the resource requirements of “always on” and high-use components such as endpoint security systems. In virtual environments, vendors can implement their solution as a client-based agent where all security processing takes place on the client, a virtual appliance that handles the anti-virus (A/V) workload or, possibly, some hybrid of the two approaches.

Symantec Corp. commissioned Tolly to benchmark the performance of its new Symantec Endpoint Protection (SEP) 12.1 within VMware ESXi 5 virtual environments vs. Trend Micro Deep Security 8. Specifically, this testing focused on the system resource requirements of each solution when performing on-demand and on-access scanning, and during distributed virus definition updates.
Virtualization
Quantum Corporation Quantum vmPRO Data Protection Solution for VMware An Evaluation of Ease-of-Implementation, Functionality, and Interoperability in VMware vSphere 5 Environments

Document number: 212100
Release Date: 02 Feb 2012

With virtualization’s ever-increasing adoption by small and medium size businesses (SMBs), and remote or branch offices (ROBOs), IT administrators face a major overhaul of the critical infrastructure that supports the expanding virtual environment.

In the data protection arena, while the environment will shift, the goal remains the same: to provide backup and restore capabilities to every server instance both as a whole, and as a file structure for individual recovery. The task then becomes choosing and implementing data protection for virtualized environments while maintaining interoperability and manageability with existing disaster recovery deployments.
Virtualization
Quest Software, Inc. Quest vRanger Pro 5.2
 Performance and Ease-of-Use Evaluation in VMware ESXi 4.1u1 Environments

Document number: 211134
Release Date: 05 Dec 2011

Small and medium size business (SMB) networks are facing increasing demands for data protection in their virtualized environments. As server consolidation continues, SMBs are unlikely to adhere to the level of redundancy sought by enterprise class datacenters. However, planning for the unexpected provides for a quick recovery in the event of an outage.

All SMBs can benefit from a flexible platform which can provide the desired backup, recovery, and replication features, while effortlessly integrating with their specific environment. A solution which can be implemented as a virtual or physical machine, on the LAN or SAN is preferable where storage may not be centralized, or additional servers may be hard to come by.
Virtualization
Hewlett Packard Enterprise HP t5740e Thin Client Video User Experience Comparative Evaluation vs. Wyse Z90S7 & Wyse Z90D7 Running Microsoft Windows Embedded Standard 7 SP1

Document number: 211124
Release Date: 27 Sep 2011

As thin client deployments become more common for complex, graphics- intensive applications, the demand for multi-display functionality continues to increase. Not only must thin clients offer flexible solutions for multi-monitor requirements, but they must also provide for good quality performance for high- resolution multimedia applications.

HP commissioned Tolly to evaluate the user experience and feature set of the newly-enhanced HP t5740e in three configurations, comparing those systems to the Wyse Z90S7 and Z90D7 thin client solutions. All systems ran the Microsoft Windows Embedded Standard (WES) 7 SP1 operating system in multi-monitor configurations with playback scenarios of high-definition video in popular formats.

Overall, the HP solutions delivered a user experience comparable to the Wyse solutions. Only the HP solution offers out-of-box support for simultaneous use of 4 monitors. Furthermore, HP supports DisplayPort, VGA and legacy PS2, serial and parallel ports as standard features.
Virtualization
Sophos Ltd. Sophos Endpoint Security and Control v9.7: Anti-virus Performance in VMware ESX Virtual Environments

Document number: 211125
Release Date: 26 Aug 2011

As IT architects scale deployments of virtual desktop infrastructure (VDI) solutions, they must be aware of the resource requirements of “always on” and high-use components such as endpoint security systems. In virtual environments, vendors can implement their solution as a client-based agent, where all processing for each client takes place on the client, a virtual appliance that handles the anti- virus (AV) workload or, possibly, some hybrid of the two approaches.

Sophos Ltd. commissioned Tolly to benchmark the performance of its new Sophos Endpoint Security and Control v9.7 within virtual environments. Specifically, this testing focused on the system resource requirements of the Sophos client-based agent when performing on-demand/on-access scanning and virus signature definition update tasks.
Virtualization
Symantec Corporation Symantec Endpoint Protection 12.1 vs. McAfee and Trend Micro Anti-virus Performance in VMware ESX Virtual Environments

Document number: 211123
Release Date: 17 Aug 2011

As IT architects scale deployments of virtual desktop infrastructure (VDI) solutions, they must be aware of the resource requirements of “always on” and high-use components such as endpoint security systems. In virtual environments, vendors can implement their solution as a client-based agent where all processing for each client takes place on the client, an virtual appliance that handles the a/v workload or, possibly, some hybrid of the two approaches.

Symantec Corp. commissioned Tolly to benchmark the performance within virtual environments of its new Symantec Endpoint Protection 12.1 vs. comparable solutions from McAfee and Trend Micro. Specifically, this testing focused on the disk input/output requirements of each solution when performing on-access scan, on- demand scan and virus definition update.

Virtualization
VMware Virtual Desktop Implementation and Maintenance: VMware View 4.6 Premier vs. Citrix XenDesktop 5 Platinum

Document number: 211115
Release Date: 27 May 2011

Deploying server-hosted virtual desktops can provide significant benefits to IT organizations. By moving desktop computing environments from user desktops on physical PCs to virtual machines hosted on servers in the data center, companies can realize significant cost-of-ownership reductions associated with the ongoing support and maintenance of their end-user computing resources.

As Desktop Virtualization technology matures, the latest versions of VMware View and Citrix XenDesktop represent an evolution in the Virtual Desktop Infrastructure (VDI) solutions towards ease of management and workflow efficiency, while aiming to deliver a rich user experience that is closer to using a physical PC. VMware’s PC over Internet Protocol (PCoIP) and Citrix’s HDX technologies make advances towards delivering smoother multimedia experience comparable to a physical PC. While Citrix XenDesktop 5 introduced several improvements - such as Machine Creation Services (MCS) and Desktop Studio - for creating and managing virtual desktops, VMware View 4.6 continues to offer a significantly simpler management and administration workflow using a single management interface. In contrast XenDesktop 5 continues to require the use of multiple interfaces - Desktop Studio, Provisioning Services Console, Active Directory, etc.. Combining these usability advantages with the lower licensing costs for a 1000 user deployment, View 4.6 delivers savings in both acquisition and ongoing administration costs over XenDesktop 5.
Virtualization
Trend Micro, Inc Trend Micro Deep Security 7.5 vs. McAfee and Symantec Anti-virus Performance in VMware ESX Virtual Environments

Document number: 211101
Release Date: 09 Feb 2011

Server and desktop virtualization are essential elements of any IT strategy that seeks to decrease capital and operational expenditures . In the rush to implement virtualization technologies, many organizations simply deploy the same anti-virus solution that is in use on their physical server and desktop systems. Because these traditional anti-virus solutions are not designed specifically for virtual environments, they can create significant operational issues such as anti-virus (AV) storms, resource wastage and administrative overhead, and hamper the organization’s objective of maximizing VM densities.

Trend Micro, Inc. commissioned Tolly to benchmark the performance within virtual environments of the Trend Micro Deep Security solution vs. McAfee Total Protection for Endpoint and Symantec Endpoint Protection 11.0. Specifically, this testing evaluated the impact each solution had on host system (physical server) resources especially as guest machine density increased to up to 100 virtual machines simultaneously running in a VMware ESX 4.1 environment.
Virtualization
Symantec Corporation Symantec Backup Exec 2010 R2: Exchange & VMware Backup & Restore vs CA ARCserve r15

Document number: 210149
Release Date: 18 Oct 2010

Symantec commissioned Tolly to evaluate the performance of its Backup Exec 2010 solution in Microsoft Exchange 2007 and VMware ESX 3.5/4 scenarios and compare that to CA’s ARCserve r15. Virtualization
Akamai Technologies, Inc. Akamai IP Application Accelerator Service: Real-world Performance Benchmarking of the Citrix Virtual Desktop Environment

Document number: 209121
Release Date: 21 Sep 2009

Akamai commissioned Tolly to evaluate the performance benefits of using Akamai IP Application Accelerator service when using a real-world deployment of the Citrix Virtual Desktop Infrastructure (VDI) solution

Tests evaluated the end-user experience when accessing the VDI solution over the standard Internet and compared the experience to that while using optimized delivery over the Internet using Akamai's IP Application Accelerator Service
Virtualization
VMware Application Virtualization: VMware ThinApp 4.0 versus Microsoft App-V 4.5 CU1 and Citrix XenApp 5.0

Document number: 209136
Release Date: 31 Aug 2009

VMware commissioned Tolly to evalute the packaging and deployment chracteristics of VMware ThinApp 4.0 and compare that solution with Microsoft App-V 4.5 CU1 and Citrix XenApp 5.0

Benchmark scenarios explored applications packaged for streaming as well as applications packaged for offline use.

Download the free report.
Virtualization
VMware Virtual Desktop Implementation: VMware View 3 Premier vs. Citrix XenDesktop Enterprise 3.0

Document number: 209119
Release Date: 31 Aug 2009

Testers set out to build and deploy a virtual desktop environment capable of supporting 30 to 40 users. Engineers layered the virtual desktop capabilities onto a pre-existing virtualization environment to serve as a starting point. Once virtual desktops were built, testers conducted an informal examination of application responsiveness for LAN-based VDI users when running traditional business applications, as well as when accessing high-definition multimedia.

The goal of the test was to help prospective users of the Vmware and Citrix desktop virtualization solutions better understand the process of setting up and managing the respective VDI environments. Current release offerings were used for each of the solutions.

The Vmware View 3 VDI solution deployed more simply and more rapidly than Citrix XenDesktop 3.0. Vmware provided more comprehensive, efficient image and storage management of virtual desktops. It provides end-users with a quality of experience on the LAN that matches or exceeds that offered by the Citrix solution.

Download the free report.
Virtualization
Symantec Corporation Symantec Backup Exec 12.5 & Symantec Veritas NetBackup 6.5.3: VMware ESX 3.5 Environment Data Protection Performance Versus CommVault Simpana 8

Document number: 209124
Release Date: 25 May 2009

Symantec Corporation commissioned Tolly to evaluate the data protection performance of Symantec Backup Exec 12.5 & Symantec Veritas NetBackup 6.5.3 and compare them with CommVault Simpana 8 in a VMware ESX 3.5 environment.

Testing evaluated backup performance and recovery performance for the full VMware ESX virtual machines as well as individual files residing within a given virtual machine.

Download the free test report.
Virtualization
Symantec Corporation Symantec Backup Exec 12.5 & Symantec Veritas NetBackup 6.5.3: VMware Environment Data Protection Performance Versus EMC NetWorker 7.5

Document number: 209118
Release Date: 17 May 2009

Symantec Corporation commissioned Tolly to evaluate the data protection performance of Symantec Backup Exec 12.5 & Symantec Veritas NetBackup 6.5.3 and compare them with EMC NetWorker 7.5 in a VMware environment.

Testing evaluated backup performance and recovery performance for the full VMware ESX virtual machines as well as individual files residing within a given virtual machine.

Download the free test report.
Virtualization
Citrix Systems, Inc. Citrix XenServer 5: Optimized Performance for XenApp Compared to VMware ESX 3.5u3

Document number: 209103
Release Date: 15 Apr 2009

Citrix Systems commissioned Tolly to evaluate the performance of Citrix XenApp when running on Citrix XenServer 5 and compare that with XenApp running on VMware ESX 3.5u3.

Testing focused on system scalability and user quality-of-experience. This test report was approved for publication by VMware. The VMware End User License Agreement (EULA) requires such approval.

Download the free report below.
Virtualization
VMware Virtual Desktop-Implementierung: VMware View 3 Premier verglichen mit Citrix XenDesktop Enterprise 2.1

Document number: 209101DE
Release Date: 09 Mar 2009

ZUSAMMENFASSUNG

Die VDI-Lösung View 3 von VMware lässt sich leichter und schneller implementieren als Citrix XenDesktop 2.1. VMware bietet eine umfassendere u n d e f fi z i e n t e r e I m a g e - u n d Speicherverwaltung für virtuelle Desktops. Endanwendern erhalten im LAN eine Erlebnisqualität, die der Citrix-Lösung gleichkommt bzw. diese übertrifft.
Virtualization
VMware Virtual Desktop Implementation: VMware View 3 Premier vs. Citrix XenDesktop Enterprise 2.1

Document number: 209101
Release Date: 09 Feb 2009

Testers set out to build and deploy a virtual desktop environment capable of supporting 30 to 40 users. Engineers layered the virtual desktop capabilities onto a pre-existing virtualization environment to serve as a starting point. Once virtual desktops were built, testers conducted an informal examination of application responsiveness for LAN-based VDI users when running traditional business applications, as well as when accessing high-definition multimedia. .

The goal of the test was to help prospective users of the VMware and Citrix desktop virtualization solutions better understand the process of setting up and managing the respective VDI environments. Current release offerings were used for each of the solutions.

The VMware View 3 VDI solution deployed more simply and more rapidly than Citrix XenDesktop 2.1. VMware provided more comprehensive, efficient image and storage management of virtual desktops. It provides end-users with a quality of experience on the LAN that matches or exceeds that offered by the Citrix solution.

Download the free report.
Virtualization
McAfee McAfee Total Protection for Virtualization Evaluation in VMware ESX and Microsoft Hyper-V Environments

Document number: 208344
Release Date: 30 Jan 2009

McAfee, Inc. commissioned The Tolly Group to evaluate the effectiveness of McAfee Total Protection (ToPS) for Virtualization, managed by ePolicy Orchestrator (ePO) 4.0, in providing a comprehensive suite of security services to virtualized Microsoft Windows Server 2003 and Windows Server 2008 environments — online and offline — under both VMware and Microsoft’s Hyper-V server virtualization platforms.

Tolly engineers built virtual server environments using both VMware ESX Server version 3.5 and Microsoft Hyper-V. In these environments they deployed virtual instances of Microsoft’s Windows Server 2003 and Windows Server 2008. Engineers then exercised an extensive set of functions to illustrate that McAfee could provide extensive management and protection of virtual server environments in both online and offline states.

Click on the report icon to purchase the report.
Virtualization
Oracle Oracle Corporation Oracle VM Performance Evaluation of Oracle VM Server Virtualization Software

Document number: 208322
Release Date: 22 Sep 2008

Oracle Corporation commissioned The Tolly Group to evaluate the performance of Oracle VM running in a 32-bit Linux server environment and supporting a variety of workloads.

Tolly Group engineers examined the performance of virtual servers running on Oracle VM compared to typical bare-metal servers that consume more real estate and cost more to deploy. Engineers also conducted the same tests on two virtual machines to prove the performance scalability of the Oracle VM virtualization technology.

Tests were conducted in July 2008.

Download the free report
Virtualization
Acresso, Inc / Citrix Systems, Inc. Acresso Software Citrix Systems, Inc. AdminStudio® 8.6 Optimizes Packaging of Applications for Streaming via Citrix XenApp

Document number: 208270
Release Date: 10 Sep 2008

Acresso Software, Inc. and Citrix Systems, Inc. commissioned The Tolly Group to illustrate the benefits of implementing Acresso’s AdminStudio packaging solution with Citrix XenApp™ as implemented using Citrix Presentation Server 4.5.

Tolly Group engineers used the Profiler, the packaging tool built into the application streaming feature of XenApp, to provide a baseline for virtualized application packaging preparation time for a number of common enterprise applications. Engineers then implemented Acresso AdminStudio and used the solution to prepare the same applications for streaming to quantify the benefits that Acresso can bring to system administrators deploying streaming applications in a Citrix XenApp virtual delivery environment.

Tests were conducted in July 2008.
Virtualization
Citrix Systems, Inc. Citrix Systems, Inc. XenServer Enterprise 4.1.0 Performance Evaluation of XenApp in a 64-bit Virtualized Server Environment Using XenServer

Document number: 208304
Release Date: 20 May 2008

Citrix Systems, Inc. commissioned The Tolly Group to evaluate the performance of XenApp when it is virtualized and optimized by its XenServer virtualization solution.

Tolly Group engineers examined the maximum number of concurrent users a single XenApp server could support in a 64-bit virtualized server environment using XenServer. Engineers measured the performance of XenApp running on a physical 64-bit server and both 32-bit and 64-bit virtualized environments. The aim was to prove that virtualizing XenApp with XenServer does not degrade user scalability significantly compared to a native physical server environment.

Tests were conducted in April 2008.

Virtualization
Parallels Parallels Desktop 3.0 for Mac Microsoft Windows XP Virtualization on Mac OS X: Feature Verification of Desktop Virtualization Software

Document number: 208260
Release Date: 19 Feb 2008

Parallels, Inc. commissioned The Tolly Group to evaluate a wide array of features of the Parallels Desktop 3.0 for Mac desktop virtualization software. Parallels Desktop 3.0 for Mac software aims to unify the user experience such that the virtual machines are integrated into the Mac operating system user interface providing a simple yet feature-rich user experience that enhances user productivity.

Users whose work requires access to both Windows-only and OS X-only programs, have several alternatives: They can use separate machines, they can use a single physical machine that, through a utility like Apple’s Boot Camp, can be bring up either a dedicated OS X or a dedicated Windows machine, or they can employ virtualization technology. Such technology allows a single physical machine to run both the native Mac OS X operating system and a full version of Windows XP simultaneously.

This report will examine the Parallels Desktop offering with respect to features that enhance user productivity. Tests were conducted in November 2007.

Virtualization
Citrix Systems, Inc. Citrix Systems, Inc. Presentation Server 4.5 Platinum Edition Bandwidth Consumption and Usability Study in Graphics-Rich Scenarios

Document number: 207207
Release Date: 14 Jul 2007

Citrix Systems, Inc. commissioned The Tolly Group to evaluate the bandwidth and graphics display benefits of its Speed-Screen Progressive Display feature available in the latest release of Presentation Server over a variety of network types in a simulated healthcare Picture Archiving and Communication Systems (PACS) application.

Tolly Group engineers evaluated the bandwidth usage benefits that the new SpeedScreen Progressive Display compression feature offers to enterprise end-users on multiple network links as compared to the SpeedScreen compression feature offered on Presentation Server 4.0. Engineers also objectively evaluated user experience improvements even in high latency networks. Tests were conducted in April 2007.

Virtualization
Citrix Systems, Inc. Citrix Systems, Inc. Presentation Server 4.5 Platinum Edition High Availability Study of Presentation Server 4.5 for Application Delivery

Document number: 207188
Release Date: 01 Jun 2007

Citrix Systems, Inc. commissioned The Tolly Group to evaluate the high application availability delivered by Presentation Server 4.5 when deployed in a server farm with 1,000 servers. Tests aimed to show that a cluster of back-end servers running Presentation Server 4.5 can offer very high levels of application availability even for the most demanding enterprises.

Tolly Group engineers evaluated the massive Presentation Server 4.5 farm’s ability to service large numbers of session requests to ensure application availability to thousands of simulated end-users. Moreover, engineers identified and validated the various components of Presentation Server that play an important role in application availability. Tests were conducted in March 2007.

Virtualization
Citrix Systems, Inc. Tolly Group White Paper Series Sponsored by Citrix Systems: Virtualization’s Impact on the Desktop

Document number: 206138
Release Date: 15 Sep 2006

Citrix Systems, Inc. — along with help from IBM and VMware, Inc. — commissioned The Tolly Group in June 2006 to conduct a comprehensive hands-on evaluation of a desktop virtualization environment combining solutions from Citrix, ESX Server software from VMware, Inc. and IBM System X and BladeCenter servers.

Tolly Group engineers examined a variety of capabilities delivered by the Citrix Access Suite when used in a desktop virtualization solution. The tested solution included IBM blade servers and VMware virtualization; providing virtualized Windows XP "desktops" that could be accessed via remote desktop applications running on the Citrix Presentation Server.

Tests focused on scalability, performance, and feature/functionality capabilities. Specifically, The Tolly Group focused on determining how many simultaneous remote control sessions could be supported by the "broker" machine. In addition, The Tolly Group performed functional testing aimed at assessing the solution's suitability for a remote deployment model. The report is informed reading for any company considering server virtualization.

Virtualization
Citrix Systems, Inc. Citrix Presentation Server 4 Enterprise Edition Performance and Scalability Value-Add to Microsoft Windows Server 2003 Terminal Services

Document number: 206146
Release Date: 30 Aug 2006

Citrix Systems, Inc. commissioned The Tolly Group to measure the performance and scalability boost that Citrix Presentation Server 4.0 brings to a Windows Server 2003 Terminal Services server deployment.

Tolly Group engineers measured the time taken to execute a specific task across 9 and then 18 simultaneous, simulated users on both Citrix Presentation Server and Microsoft Windows Server 2003 Terminal Services environments. Test scenarios for 9 and 18 simultaneous consisted of measuring the elapsed time (in seconds) needed to complete a simulated user task on both Citrix Presentation Server and Windows Server 2003 Terminal Services under three different scenarios: (1) the time with no additional processor load on the server, (2) the time with 50% processor load on the server and (3) the time with 80% processor load on the server.
Virtualization
Citrix Systems, Inc. Citrix Presentation Server 4, Performance Comparison to Sun Secure Global Desktop 4.2

Document number: 206127
Release Date: 18 Apr 2006

Citrix Systems, Inc., commissioned The Tolly Group to evaluate its Citrix Presentation Server 4, an application virtualization server that uses a centralized architecture, and how it performs in comparison to the Sun Microsystems’ Sun Secure Global Desktop 4.2.

Both products enable IT departments to centrally deploy and manage business applications in a secure environment, providing on-demand access to these resources for users at any location, on any device and on any network.

Tolly Group engineers measured the throughput (average Kbps), elapsed time in seconds, and bytes sent over the link in the areas of remote printing, audio and video display, 2D PowerPoint displays, and a WinBench99 2D graphic benchmark application using GDI/S/Text — Times New Roman 16. To provide a range of connection types, the results were measured using four simulated WAN connections: T1 (1.544 Mbps, 50 ms), DSL (1.5 Mbps/25 Kbps, 100 ms), Satellite/Wireless (512 Kbps, 500 ms), and Frame Relay (128 Kbps, 40 ms).
Virtualization