Frequently Asked Questions

Vendor Product Testing

Do you do conduct competitive testing?

Yes. We have been conducting competitive tests for over 20 years.

Do you do test cloud solutions?

Yes. We can evaluate specific features and functions of cloud services, Software as a Service (SaaS), Platform as a Service (PaaS). We have compared cloud services in areas like endpoint security and VoIP with traditional customer-premise solution.

We have also have evaluated hybrid solutions in security, WLAN and messaging where cloud elements are leveraged along with equipment at the customer premises.

What topic areas do your reports cover? I see lots of "speeds and feeds" reports.

We publish a great many "speeds and feeds" performance studies. In addition, though, we also publish reports that focus on other important topics including:

  • Total Cost of Ownership (TCO)
  • Ease-of-Use
  • Features and Functions
  • Management
  • Power Consumption
  • Interoperability
  • SaaS/PaaS

What technology areas do you work in?

We work with virtually every technology of relevance to Enterprise and SMB information technology, including:

  • Local Area Networking
  • Wide Area Networking
  • Storage and Networked Storage
  • Wireless LAN (business and consumer)
  • Power Consumption
  • Security (firewalls, endpoints, data loss prevention, etc)
  • Voice over IP (VoIP)
  • Video over IP
  • Virtualization/Virtual Desktop Infrastructure (VDI)
  • Backup and Recovery
  • SMB/Enterprise Servers
  • Thin Clients

Are there fixed test methodologies for each product category or can vendors request specific testing?

Both. Tolly has developed standard methodologies for major product areas as part of its Common Test Plan program (see info elsewhere on tolly.com). Most of our testing uses specific, custom test methodologies that are developed to provide testing proof-of-claim for our vendor customers.

Where does testing take place? Can it take place in our lab?

Most of our testing takes place in our main lab in South Florida. As long as testing is conducted correctly, it is not relevant where it takes place. In some cases, technology vendors have large, complex setups that are already in places. In such cases, Tolly can send our engineers to the vendor site - within the US/North America or anywhere around the world?

Are Tolly reports known outside of the US and English-speaking countries?

Yes. Our analysis shows that visitors to tolly.com emanate from close to 140 different countries - the vast majority of which are not English-speaking.

Further evidence of the power of the Tolly brand and Tolly Certified reports around-the-world is the fact that so many vendors localize their Tolly reports. Our reports have been localized into:

  • Chinese (Simplified and Traditional)
  • Spanish (European and Latin American)
  • Portuguese (European and Brazilian)
  • Japanese
  • Korean
  • German
  • Russian
  • French
  • Dutch
  • Italian
  • Thai

Will you test beta releases?

Yes. It is not uncommon for us to test pre-release software and/or hardware. Our reports make clear whether the solution tested was GA (production) or a pre-production (beta) version.

Because testing must take place well before release, it is not uncommon for us to test pre-release versions. There are times when our customers want to be sure that the final report references generally available, production product. In such cases, we can run the full test on the pre-release product and then run appropriate spot-checks on the full, generally available version prior to the publication of the report.