Performance Testing is the process of determining the speed, effectiveness, reliability, scalability and interoperability of the system, computer, network, program or application. The process can also check two or more application to compare system speed, data transfer rate, bandwidth, efficiency, and reliability.

1) LoadUI Pro

LoadUI Pro by Smartbear allows you to quickly create scriptless sophisticated load tests, distribute them on cloud using load agents and monitor performance of your servers as you increase load on them. You can access detailed reports and quickly automate your load tests on Jenkins, Bamboo, TFS and other automation frameworks – If you are using SoapUI already, you can convert the test cases into load tests with just 3 clicks– all without writing a single line of script.

Features:

  • Scriptless Load test creation
  • Preconfigured load test templates like spike, baseline, stress, smoke
  • Drag and drop load tests on distribution agents on cloud
  • Sophisticated analytics and statists features for reporting
  • Quick conversion of functional tests from SoapUI as load tests

Protocols:

  • HTTP, REST, SOAP, JSON ,JMS, Swagger, RAML , IODocs,
  • API Blueprint, JSON Schema, XML Schema, MQTT, CoAP, WSDL,WADL

Pros

Cons

  • Very user friendly – Does not require any scripts to be written
  • Build load tests from pre-configured templates in just a few clicks
  • Easily reuse existing functional tests from SoapUI in a few clicks
  • Visualize the effects of load on your servers with real time monitoring
  • Distributed load testing through on-premise or cloud based load agents (like Amazon EC2)
  • Supports only web services/API load testing
  • Less support for UI load testing
  • No direct support for FTP, SMTP protocols
  • Imports SoapUI but not JMeter scripts

Download LoadUI

2) Apache Jmeter

JMeter is an open source tool that can be used for performance and load testing for analyzing and measuring the performance of a variety of services. This tools mainly used for web and web service applications.

Features:

This tool doesn't demand state of the art infrastructure for load testing and supports multiple load injectors managed by a single controller

Protocols

  • Web : HTTP, HTTPS
  • WebServices : XML, SOAP, etc.
  • Java based protocols
  • FTP

Pros and Cons of JMeter:

Pros

Cons

  • Highly portable and supports 100% all the Java based apps
  • Less scripting efforts as compared to other tools because of its user-friendly GUI
  • Simple charts and graphs sufficient for analyzing key load related statistics and resource usage monitors.
  • Supports Integrated real-time, Tomcat collectors for Monitoring
  • Cannot record HTTPS Communication
  • Cannot intercept the AJAX traffic
  • Is not capable of monitoring any of Application server related statistics
  • Reporting framework has very limited features

Download JMeter

3) HP Performance Tester (LoadRunner)

This is an enterprise performance testing version of Loadrunner and a platform enabled both global standardization and formation Performance CoE.

Protocols:

All protocols are supported by Load Runner

Pros and Cons of HP Performance Tester tool:

Pros
Cons
  • Lower the cost of distributed load testing
  • Scale from single projects to a full-scale testing Center of Excellence (CoEs) that consolidates hardware, standardizes best practices, and leverages global testing resources
  • Reduce the risk of deploying systems that do not meet performance requirements through the use of effective enterprise load testing
  • Lower hardware and software costs by accurately predicting system capacity
  • Pinpoint the root cause of application performance problems quickly and accurately
  • Effective tool utilization tracking
  • Browser based access to global test resources and optimal usage of load generator farm.
  • Expensive compared to LoadRunner perpetual licenses
  • Additional investments needed to procure licenses for new protocol support
  • SaaS:The licensing model requires procuring "Controllers" &"Vusers pack" separately. For concurrent test execution, multiple "Controllers" have to be procured which may be expensive
  • Requires 24*7 support for technical assistance during execution

Download Loadrunner

4) WebLOAD

Description:

WebLOAD is an enterprise-scale load testing tool which features a comprehensive IDE, Load Generation Console, and a sophisticated Analytics Dashboard.

Application:

WebLOAD has built-in flexibility, allowing QA and DevOps teams to create complex load testing scenarios thanks to native JavaScripting. WebLOAD supports hundreds of technologies – from web protocols to enterprise applications to network and server technologies.

WebLOAD Features:

  • Flexible test scenario creation
  • Supports every major web technology
  • Powerful correlation engine
  • Automatic bottleneck detection
  • Generate load on-premise or in the cloud

WebLOAD Pros and Cons

Pros
Cons
  • Native JavaScript scripting
  • UI wizards to enhance the script
  • Supports many technologies
  • Easy-to-reach customer support
  • Does not support Citrix
  • Does not support SAP GUI
  • Does not support RDP and RTE

Read more about WebLOAD here

5) Silk Performer

Silk Performer tool is an enterprise class load and stress testing tool and has the ability to test multiple application environments with the thousands of concurrent users. It also supports the widest range of protocols.

Features:

There are good features in Silkperformer and those are listed as follows:

  • Components -> Workbench, True Log Explorer and Performance Explorer
  • Requires minimum hardware resources for virtual user simulation
  • Simulates modifiable virtual users
  • Generates reports with tables and graphs and allows customization.
    • Supports six models of workloads.
    • Provides Agent Health Control
    • Server side diagnostics
    • Resource Management
    • Version Control Management

Protocols

Following are the good number of protocols supported by silk performer of Borland Corporation:

  • App. Server/Component Model:

    Oracle Forms; CORBA; EJB; .NET Remoting; Tuxedo; Jacada

  • Web:

    HTTP/HTML; HTTPS/HTML; HTTP/HTTPS; Flash;

  • Web Services:

    XML/SOAP; .NET

  • Internet:

    Email (SMTP/ POP); FTP; TCP/IP; LDAP

  • ERP/CRM:

    PeopleSoft 8; Siebel; SAP GUI

  • Terminal Services:

    Citrix Metaframe

  • Wireless:

    WAP; i-Mode; Radius

  • Databases:

    Oracle; DB2; CLI; ODBC; ADO;

  • Unit Testing:

    Junit; N-Unit; .NET

  • Frame Works:

    JAVA; .NET; Visual Basic

Pros and Cons of the tool:

Following table discusses the pros and cons of the silk performer tools:

Pros

Cons

  • Supports integrated server monitoring
  • Customer friendly licensing
  • Correlation and Parameterization is user friendly
  • No License requirement for Controllers or Individual Protocols
  • Handles Load Test in Project approach
  • Pacing time feature is not readily available
  • Setting up Ramp down Pattern is not easy

Download Silk Performer

6) Rational Performance Tester

Rational Performance Tester(RPT) is a performance and load testing tool developed by IBM Corporation. It is performance test creation, execution, and analysis tool that helps development team to validate the scalability and reliability of web based applications before deployment into production.

Features:

There are good features which gives confidence to the users that all performance related bottlenecks are resolved. Following are some of the features of this tool:

  • No coding involved
  • Scheduled and event based testing
  • Real time reporting for immediate performance problem identification
  • Run with large multi users tests
  • Accurate user profile workloads
  • Automated test data variation
  • Automatic identification of dynamic server responses
  • Rendered HTML view of web pages visited during test recordings
  • Environment and Platform support
  • Entrust security protocol support
  • Java code insertion for customization

Protocols:

Some of the protocols supported by RPT are:

  • Citrix
  • Socket Recording
  • Web HTTP
  • SOA
  • SAP

Pros and Cons of RPT

Following are the PROS and CONS of the application;

Pros Cons
  • Supports XML
  • No Programming knowledge required
  • Automatic Correlation
  • Diagnostics of Websphere and Weblogic application servers
  • Java Applet based applications not supported
  • Ramp up or Ramp down of resources not possible
  • Scheduling is not possible
  • Random selection of data in parameter files are not available

Download Rational Functional Tester

Factors considered for selection of Performance/Load tools:

Don't Slog to Choose The Right Tool. Get Smart. Consider the following factors before your decide.

  • Desired Protocol Support
  • License Cost
  • Customer/Client Preference of load tool
  • Cost involved in training employees on tool
  • Hardware/Software requirements of load tool
  • Tool Vendor support and update policy.

Conclusion:

There is no best tool in the market. You need to find the best tool for your performance project goals.

 

YOU MIGHT LIKE: