Webinar: Delivering Applications in the Pink of Health with End-to-End Test Automation Register Now
<< Blog

Comparing QTP, Selenium, TestingWhiz - Test Automation Tools

Wednesday June 12, 2013

When it comes to web application test automation tools it is hard to choose between the available options in the test automation market and the right alternative that offers best of the latest technologies from the marketplace at the right budget. Open source tools provide the benefit of low initial investment, but, they’re not always the best alternative in the long run due to the lack of official support & training. Commercial automated testing tools, on the other hand, are highly expensive to implement, resulting in higher cost of failure. So, it becomes extremely important to choose the right test automation tool from the top automation tools comparison chart.

Automation is a continuous process and it’s very important to have the basics right:-

  1. Setting up the test environment

  2. Screening the available test automation tool options

  3. Creating a Proof of Concept with a few sample test scenarios for the application

  4. Preparing (automation) frameworks

  5. Building libraries of functions & methods

  6. Defining configuration parameters

To help test managers and automation engineers choose the right alternative, we have prepared a comparison matrix between the three closest contenders for the best test automation tool that are highly rated by Test Managers and Automation Engineers alike. Here is a comparison between HP QTP with Selenium and TestingWhiz.

Features & Integrations




Programming knowledge required?




Learning curve to be productive

3-4 months

2-3 months

1 week

Record & Playback

Can only be used in Microsoft Internet Explorer

Selenium IDE to be used

Out-of-box support for FAST™ recorder and playback on IE, FF, Chrome, Safari, and Edge.

Data Driven Testing

Complex VB Scripting required

Requires Extensive Coding

Built-in Test Data Tables

Database Support

With the help of DSN (ODBC32 Interface)

Requires Extensive Coding

Out-of-box support and Oracle, MS SQL Server, IBM DB2, My SQL. No scripting is required.

Object Repository

Official term is Window declarations. They can be edited directly from the Editor


Built-in Reusable Object Repository across Test Project

Test Case

Termed as Testcase. Each Testcase has a block of coding statements.

Termed as Automation Script

Termed as Test Case. No programming blocks are there. Set of keywords to form the script that can be re-used and exported to Excel

Language Support


Selenese, Java, Ruby, Perl, PHP, Python, C#, Groovy

290+ Drag & Drop Test Commands + Built in JavaScript Editor

Functional Testing, Load Testing, Service Monitoring from one test script

Complex code required

Not Available

WhizGrid™ available with WhizAgents for distributed Testing

Run tests in the Cloud, in your QA lab, or both




Results Reporting

Results are stored into *.res binary files. It can be converted into different formats. Multiple versions can be stored in a single file.

Basic Reporting

Advanced Reports with Screenshots & Reporting API. Environment details and minute details like time to execute a test step is captured. Reports can be emailed to concerned stakeholders on a mouse click.

Defect Management Integration

In Built Defect Reporting

Not Available

Out-of-the-box integration with Atlassian JIRA, Mantis, and Fogbugz Fogcreek

OS Platform Support

Windows Only

Only stable on Windows & Linux

Windows & Android

Test Management Integration

HP Quality Center

Not Available

HP Quality Center

Scheduled execution


Yes, but with complex code

Yes, intuitive and advanced UI to configure jobs


$6000 USD Per Seat, Plus $1500 Annual Maintenance

Free (GPL 2, Apache 2)

Free and Paid enterprise version are available. Request a quote for Enterprise version.

Download the Enterprise Version of TestingWhiz for 30 Days Now!


TestingWhiz is committed to providing innovative, automated software testing solution to global enterprises and software companies for their web, mobile and cloud applications.


Mack-Cali Centre III,
140 East Ridgewood Avenue
Suite 415 ST, Paramus,
NJ 07652, USA