Is your application slow? Choose your performance tool here...

Before learning about tools of performance testing, lets understand - 

What is Performance Testing?

Performance testing is the process of determining the speed, effectiveness, reliability, scalability and interoperability of the system, computer, network, program or application . The process can also check two or more application to compare system speed, data transfer rate, bandwidth, efficiency and reliability.

Can we do performance testing manually?

Its extremely difficult to find performance related information manually and check the system response.Best option is to use performance testing tool available in the market.

Performance Testing Tools:

Tool is a must for performance testing .Following are tools available in market for testing:

Commercial Tools:

HP Performance Tester (Load Runner)

This is an enterprise performance testing version of LoadRunner and a platform enabled both global standardization and formation Performance CoE.

Protocols:

All protocols are supported by Load Runner

Pros and Cons of HP Performance Tester tool:

Pros

Cons

  • Lower the cost of distributed load testing
  • Scale from single projects to a full-scale testing Center of Excellence (CoEs) that consolidates hardware, standardizes best practices and leverages global testing resources
  • Reduce the risk of deploying systems that do not meet performance requirements through the use of effective enterprise load testing
  • Lower hardware and software costs by accurately predicting system capacity
  • Pinpoint the root cause of application performance problems quickly and accurately
  • Effective tool utilization tracking
  • Browser based access to global test resources and optimal usage of load generator farm.

 

  • Expensive compared to LoadRunner perpetual licenses
  • Additional investments needed to procure licenses for new protocol support
  • SaaS:The licensing model requires procuring "Controllers" &"Vusers pack" separately. For concurrent test execution, multiple "Controllers" have to be procured which may be expensive.
  • Requires 24*7 support for technical assistance during execution

 

Borland SilkPerformer

Silkperformer tool is an enterprise class load and stress testing tool and has ability to test multiple application environments with the thousands of concurrent users. It also supports widest range of protocols.

Features:

There are good features in silkperformer and those are listed as follows:

  • Components
    1. Workbench
    2. True Log Explorer
    3. Performance Explorer
  • Requires minimum hardware resources for virtual user simulation
  • Simulates modifiable virtual users
  • Generates reports with tables and graphs and allows customization.
    • Supports six models of workloads.
    • Provides Agent Health Control
    • Server side diagnostics
    • Resource Management
    • Version Control Management

Protocols

Following are the good number of protocols supported by silk performer of Borland Corporation:

App. Server/Component Model:

Oracle Forms; CORBA; EJB; .NET Remoting; Tuxedo; Jacada;

Web Services:

XML/SOAP; .NET

ERP/CRM:

PeopleSoft 8; Siebel; SAP GUI

Wireless:

WAP; i-Mode; Radius

Unit Testing:

Junit; N-Unit; .NET

 

Web:

HTTP/HTML; HTTPS/HTML; HTTP/HTTPS; Flash;

Internet:

Email (SMTP/ POP); FTP; TCP/IP; LDAP

Terminal Services:

Citrix Metaframe

Databases:

Oracle; DB2; CLI; ODBC; ADO;

Frame Works:

JAVA; .NET; Visual Basic

 

Pros and Cons of the tool:

Following discusses on the pros and cons of the silk performer tools:

Pros

Cons

  • Supports integrated server monitoring
  • Customer friendly licensing
  • Correlation and Parameterization is user friendly
  • No License requirement for Controllers or Individual Protocols
  • Handles Load Test in Project approach

 

  • Pacing time feature is not readily available
  • Setting up Ramp down Pattern is not easy

 

Rational Performance Tester

Rational Performance Tester(RPT) is a performance and load testing tool developed by IBM Corporation. It is performance test creation, execution, and analysis tool that helps development team to validate the scalability and reliability of web based applications before deployment into production.

Features:

There are good features which gives confidence to the users that all performance related bottlenecks are resolved. Following are some of the features of this tool:

  • No coding involved
  • Scheduled and event based testing
  • Real time reporting for immediate performance problem identification
  • Run with large multi users tests
  • Accurate user profile workloads
  • Automated test data variation
  • Automatic identification of dynamic server responses
  • Rendered HTML view of web pages visited during test recordings
  • Environment and Platform support
  • Entrust security protocol support
  • Java code insertion for customization

Protocols:

Some of the protocols supported by RPT are:

  • Citrix
  • Socket Recording
  • Web HTTP
  • SOA
  • SAP

Pros and Cons of RPT

Following are the PROS and CONS of the application;

Pros

Cons

  • Supports XML
  • No Programming knowledge required
  • Automatic Correlation
  • Diagnostics of Websphere and Weblogic application servers
  • Java Applet based applications not supported
  • Ramp up or Ramp down of resources not possible
  • Scheduling is not possible
  • Random selection of data in parameter files are not available

Open Source tools:

 

Apache Jmeter

JMeter is an open source tool that can be used for performance and load testing for analyzing and measuring the performance of variety of services. This tools mainly used for web and web service applications.

Features:

This tool doesn't demand state of art infrastructure for load testing and supports multiple load injectors managed by a single controller

Protocols

  • Web : HTTP, HTTPS
  • WebServices : XML, SOAP, etc.
  • Java based protocols
  • FTP

Pros and Cons of JMeter:

Pros

Cons

  • Highly portable and supports 100% all the Java based apps
  • Less scripting efforts as compared to other tools because of its user friendly GUI
  • Simple charts and graphs sufficient for analyzing key load related statistics and resource usage monitors.
  • Supports Integrated real-time, Tomcat collectors for Monitoring

 

  • Cannot record HTTPS Communication
  • Cannot intercept the AJAX traffic
  • Is not capable of monitoring any of Application server related statistics
  • Reporting framework has very limited features

 

 

Factors considered for selection of Performance tools:

We have to consider some factors while selecting performance tools. Factors are as follows:

 

  • Customer Preference tool
  • Availability of license within customer machine
  • Additional protocol support
  • Availability of test environment
  • Efficiency of tool
  • License Cost
  • User Options for testing
  • Vendor support (IBM, Borland, HP support)

 

Technology V/s Performance Tools:

Following list down the choice of tools for each technology that we are going to test:

 

Technology/Protocols/Model

Selection of tools

SOA

Load Runner

Silk performer

SOA Test

SAP

Load Runner

Silk Performer

Rational Performance Tester

Peoplesoft, oracle

Load Runner

Silk performer

Rational Performance Tester

.Net and Desktop Client

Load Runner

Silk Performer

VSTS

Citrix related applications

Load Runner

Silk Performer

Rational Performance Tester

Web based applications

Load Runner

Silk Performer

JMeter

CoE Operational Model

Performance Center

Load Runner

Silk Performer

Java

SLAMD

Lobo

CLIF

OS Independent

Soap Stone

p-unit

Benerator

Allmon

Linux

Curl-loader

D-ITG

DOTS

Hammerhead

Javascript

Raw Load Tester

Cross Platform

Ostinato

 

Conclusion:

Thus, we concluded that performance testing tools is helping us to reduce risks and minimize costs. This is surely a complex testing which involved objectives of testing, cost, resources involved and potential return.

comments powered by Disqus

Follow Us!

Feedback

Your Feedback is very important to us. Please tell us what you think of these tutorials - http://goo.gl/aPc4K