Measuring Web Application Performance using Open Source Tools

Measuring Web Application Performance using Open Source Tools

“If your page does not load within 5 seconds, 50% of customers abandon your site”, that statement speaks a lot in itself about the increasing need of customers for high speed access to web applications. And with mobile web also causing significant traffic to websites and web applications, it is important to have the performance of your web application checked

With the need for analyzing the performance of your web application increasing, it is a good idea to evaluate some of the popular open source Performance testing tools. We will talk about why you should use an Open source performance test tool for your Performance testing needs and give an overview of some of the popular Open source performance test tools.

Why choose Open Source Performance Test tool:

  • No licensing cost – a commercial load testing tool can really burn your pockets when you want to test with heavy number of virtual users
  • Generate (almost) infinite amount of load on the web application without any additional licensing costs. The only limitation would be the resources available
  • Create your own plug-ins to extend the analysis and reporting capabiltiies
  • Integrate with other open source and commercial tools to drive end to end test cycles

Some of the Popular Open Source Performance Test tools:

Apache J Meter

Apache J Meter is an open source load testing tool built on the Java Platform. This testing tool is developed to test load test functional behavior and performance testing. It supports testing on static and dynamic resources such as Servlets, Java Objects, Perl Scripts, FTP servers, Data Bases, etc. It requires JVM 1.4 or higher to perform. Although it was designed initially to test web applications, today its scope has widened to other test areas.

With a vast user community and ever expanding list of Plugins, JMeter is a favorite for many organizations when it comes to Performance, stress and load testing.

Load UI

Load UI is a very popular open source stress testing tool used for web application performance testing. It supports testing of numerous web protocols such as AMF, REST, JMS, JDBC and web sites. Many testers agree that LoadUI is one of the most interactive and user-friendly testing tools around. This tool is integrated with a functional testing tool soapUI, which adds to its effectiveness. During the testing phase it allows testers to create, configure and update their tests. LoadUI features a high graphic interface that makes testing easier.

LoadUI also comes as LoadUI Pro to extend the features that the open source version provides.

Open STA (Open System Testing Architecture)

Open STA is the abbreviation for Open System Testing Architecture and it is built around COBRA. This GUI based testing tool is used by testers for load analyzing and load testing. This is a complex testing tools and is known to perform heavy test load for scripted HTTP and HTTPS. Here, the tests are performed using simple scripts, recordings and it also takes into account various results and statistics. During load tests, Open STA graphs resource utilization information from application servers, web servers, operating platforms and database servers that help in further analysis.


Using the Java implementation of Python (Jython), The Grinder is a script-only, feature rich load testing platform. Possibly the most powerful lightweight free load testers on the market, but also the most difficult to master. No GUI to speak of, very little in the way of examples… but at least it has a good FAQ. It isn’t useful for Front End Automation, but otherwise The Grinder is flexible and infinitely useful if you can master it. This is the programmer’s preferred load testing tool.

The Performance Engineering team at Gallop has helped many customers identify the key bottlenecks and helped fixing them. We have enabled the customers to utilize Open source tools like JMeter with their enterprise resources to generate higher loads, at no extra cost, to stress test their applications.

Gallop also helps you generate real time Mobile browser load with its huge set of devices in the Mobile Test Lab spread across geographic locations.

If you are unsure of your web performance strategies, you are losing many customers, write to us today at, and we will help your application reach its real performance potential!


The opinions expressed in this blog are author's and don't necessarily represent Gallop's positions, strategies or opinions.

Accelerate your Test lifecycle with these Automation tools

Accelerate your Test lifecycle with these Automation tools

Test automation works to accelerate your test life cycle, and enable you to increase test coverage. Although there are many test automation tools in the market, some tools have proven to be more effective in most enterprise environments, we will discuss about them in this blog post.

Enterprise Level Test Automation with HP QTP/UFT

HP QTP/UFT is one of the prominent tools and enables end to end Enterprise level test automation, with its huge support for enterprise level applications such as SAP, AS400, Web, Mobile and various other HRM, CRM applications. What could you consider when deciding on choosing HP QTP/UFT:


  • Ease of creating test scripts with VBScript as the scripting language driving the tests
  • Add-ins and support for many technologies on Desktop, Web and Mobile
  • Best of class Object Management and Object Recognition mechanism
  • Integration to ALM tools like HP ALM
  • REST, SOA and API automation integrated into HP UFT to enable true end to end test automation for Enterprise


  • High cost of license, might not be an appropriate choice when the technology the applications are built on is limited
  • Windows only support, works only with applications running on Windows OS

Functional and Web Service automation using SmartBear TestComplete

TestComplete by Smartbear is another great testing tool in the arena.


  • The tool supports integration of SoapUI NG, ServiceV, and SoapUI which allows you to go beyond the user interface and automate tests that invoke APIs or other Web services. This also enables shorter and faster release cycles.
  • TestComplete uses Real Scripting languages that enable easier coding and developing. Script files are stored as plain text; this lets you put the script under source control easily.
  • It helps save time on Regression tests. When you do a project on TestComplete it can be added in final builder. After you have finalized your functional test cases, you can pass them on to the Release Engineer. Then after you get the new build, you get the testlog together which really cuts down on time.
  • TestComplete’s customizable event handling and ‘local variables’ feature is one of its undeniable benefits. This and the ‘test suite’ feature makes data driven testing a real pleasure.
  • Integrate into CI servers such as Jenkins and TFS


  • Limitation on kind of frameworks that can be developed due to the project structure

Drive the Web and Mobile tests using Selenium + Appium

Selenium the open source Web application test automation tool has become very famous, and its extension to support mobile automation utilizing Appium enables testers now to test Web and Mobile with the same API. Here is when you might choose Selenium for your automation needs:


  • Execute tests in parallel on multiple OS, browser combinations using Selenium Grid
  • Extend your tests to run on Mobile browsers
  • Automate mobile applications using the Selenium API and Appium
  • Supports all the popular browsers and versions
  • Integrate with dev and CI environment seamlessly


  • Steeper learning curve as it uses programming languages such as Java, C#, Ruby etc
  • No in-built mechanism for Object Management and object identification(with a spying tool)

Telerik Test Studio

Telerik Test Studio is an all-in-one Windows based software testing tool.


  • It is considered to be one of the easiest testing tools you can come across. The most complex functional, load, and performance testing can be done with just a few clicks with the use of this tool.
  • Telerik Test Studio helps you with functional testing, as it supports test automation for web and desktop applications. In the mobile arena it covers iOS too.
  • It can support multiple data stores like flat file, in build table, database, excel etc.
  • Any action performed is page driven and are tied to specific elements in the UI. This means it isn’t driven by mouse movements or keyboard navigation, which makes this tool more resilient than most.


  • When it comes to in-depth custom coded automation frameworks and projects, it needs quite a bit of effort to get it set up due to high level of abstraction at code level

Not sure about the best approach to take and which tool to select for your needs? Get in touch and we can guide you through the test automation initiatives with our IP led automation services.

Join Gallop and SmartBear Co-Webinar on API Testing on May 21st 2015, 11:00 AM – 12:00 PM. Register now!

The opinions expressed in this blog are author's and don't necessarily represent Gallop's positions, strategies or opinions.

How to Succeed with Selenium: Open Source Test Automation Tool

How to Succeed with Selenium Open Source Test Automation Tool?

In software development, it is a common practice to adopt test automation, once the software completes the stable phase of manual testing. Every organization thinks of automated testing as a way to cut down manual testing costs. The cost of testing is significant for any software project and organizations are keen to invest in open source testing tools than expensive commercial testing suites. There are varieties of open source testing tools available online, but this blog explores factors to succeed with the open source web automation tool – Selenium.

Why Selenium Testing

Selenium is one of the popular automated website testing tools available online and is used to test GUI and functionality of the website. Selenium is easy to get started with and any novice tester can handle it with minimum difficulties. Here are more reasons to select Selenium:

  • Selenium can run on any mainstream browser.
  • Selenium supports tests in many languages such as JAVA, C#, Python, Ruby, Perl and more.
  • Selenium can be operated on your local computer, a third-party cloud server, on a server (with selenium remote) and on set of servers (with selenium grid).
  • Selenium allows testers to write their own tests and run them across multiple browsers.

However, here are certain things to keep in mind when you decide to go with Selenium:

  • Clear Understanding of Vision and Scope of Testing
    A thorough preparation is needed to succeed with Selenium. First of all you need to chart out a testing strategy and for that you need to outline following basics regarding the application– your revenue model, expected user behavior with application and type of browsers they might use and problems experienced with the application.
  • Select An Appropriate Programming Language for Test Automation
    Selecting an appropriate programming language for writing acceptance tests for your website or application is a very important step to consider. It is always a best practice to consult with your application development team and understand their experiences and proficiencies with a particular language. A point to remember: functional knowledge of a chosen language is critical to evaluate the appropriateness of automated tests.
  • Pick an Appropriate Text Editor
    In order to succeed with tests, you need to select an appropriate text editor. If you are a new tester and inexperienced with text editors, it is better to stick with something as basic as Sublime Text editor.
  • Features of a Good Acceptance Test
    While creating new acceptance tests, you should keep these things in mind – tests should be descriptive, autonomous, atomic, should cope up with a test runner and should adhere to version control. Ensure that you create resilient test cases that specify an action or the time.
  • Make it Robot and Human Friendly
    It is important to follow a simple testing architecture that is accessible to robots and humans as well.

    • Simplify test code with set up and tear down actions
    • Create a new spec file and store your tests in it
    • Follow simple tagging
    • Reporting – Junit, XML output (for robots) and screenshot, logs, videos for humans)
  • Scaling
    You can scale automated tests through cloud execution, continuous integration and parallelization.

If you are skeptical about the success of selenium automated tests, Gallop consultants can work with your team to maximize your productivity and returns with automated selenium tests.

Gallop has developed Gallop Test Automation Accelerator Kit (GTAAK) that offers tool agnostic framework, reusable object library as well as guidelines on best practices for automation. Get in touch with experts at Gallop to know more about Selenium Testing.


The opinions expressed in this blog are author's and don't necessarily represent Gallop's positions, strategies or opinions.

Top DevOps Tools for the Right Process

Devops Tools

If you are hearing about DevOps for the first time, read more on this link. Others, dive right in!

DevOps brings together the Development and the Operations process to make one great system. There are great minds at work behind the nuances of this revolution. DevOps essentially focuses on a multidisciplinary talent pool to get the Dev and the Ops together. And the result has been a truly magnificent repository of tools. We will have a look at some of them in this blog; but first, the types of tools out there.

Types of DevOps Tools

With DevOps, you have tools based on a script-based model and ones based on a container model.

Script-based model. A Linux user will love the tools whipped up on the script model. An endearing feature is that commands can be saved and run with replaceable parameters. A few tools based on this model are Chef (an open source model), Microsoft’s Windows Azure PowerShell CmdLets and Amazon Web Services’ CloudFormation.

Container model. Why you may like a container model (a.k.a Charm model) is because it allows you to “build up a set of reusable charms that describe application deployment and lifecycle”. This can be run as and when needed, which is of great benefit to cloud providers especially. An open-source project developed by Canonical Ltd. called Juju is one of the tools based on this container model.

The Right Tool

Finding the right tools that fit into your company’s strategy and goals needs some thought. There is no one-tool-that-fits-all out there. What we can talk about are the different DevOps tools that are out there, and let’s do it category-wise for clarity:

Continuous Integration and Configuration management: What tools in this category should enable is a track of changes to the software code base, an archiving and storing of files into a configuration management database, and a seamless solution to version control issues. 5 tools that have achieved this:

  • Chef
  • Puppet
  • Ubuntu Juju
  • Ansible

Continuous Delivery: This is the process that will get your product moving and you need the very right tools to get this done. Automation of releases is a major part of the DevOps process, and some tools that get it done right are:

  • Capistrano
  • Fabrics
  • Jenkins

Continuous Testing: Tools in this category should essentially enable smooth automation of the testing process. Also included therein, will be the developer tasks like compiling source code into binary and creating documents. Some reliable tools:

  • Ant
  • Gradle
  • Maven
  • Travis
  • BuildHive

Continuous Monitoring: This can be further classified into two types of tools i.e Application performance monitoring tools and Server Monitoring tools. These two come highly recommended:

  • New Relic APM
  • New Relic Server

Adopting DevOps in QA needs realignment of efforts to ensure all test cases are automated in a standardized environment to achieve near 100% code coverage. Discover how Gallop gives you the best of Development and Operations with DevOps testing.

The opinions expressed in this blog are author's and don't necessarily represent Gallop's positions, strategies or opinions.

Top 7 Cloud-based Software Testing tools


Testing in the cloud brings with it benefits of easy availability, high scalability and low cost. It allows for web and mobile testing in different environments and multiple machines without building your own infrastructure. Needless to say, the rising popularity of cloud testing has given rise to a slew of cloud-based testing tools in the market. Here are some of the hugely popular cloud-based software testing tools.

If you would like to get a new tool added to this list, please let us know through your comments.


1. SOASTA CloudTest

It enables four types of test automation on a single web platform – Mobile Functional & Performance testing and Web-based Functional & Performance testing. It can simulate millions  of geographically dispersed concurrent users visiting a website to test the application under huge loads. With real-time analytics & seamless integration between test design, monitoring and reporting, CloudTest enables convenient and efficient testing.

CloudTest Lite is a free version that comes with limited features.


2. LoadStorm

It is a load testing tool for web and mobile applications. It is easy to use and cost effective. It is ideal to check performance under excessive traffic or usage. It is highly scalable and can simulate as many virtual users as required to find the breaking point of a website or app. Various load testing scenarios are available which are also customizable.


3. BlazeMeter

It is used for end-to-end performance and load testing of mobile apps, websites and API. It is JMeter compatible and can simulate up to 1 million users. It facilitates realistic load tests and performance monitoring combined with real-time reporting.


4. Nessus:

It is a widely used vulnerability scanner which can detect vulnerabilities, mis-configurations and missing patches in a range of devices, firewalls, virtualized systems, cloud infrastructure etc. You can use it to detect threats like viruses, malware, backdoors and web services linking to malicious content. For sectors like healthcare and banking, it can also be used to perform compliance auditing. It generates scan reports and remediation recommendations in flexible formats including sending targeted emails.


5. App Thwack

It is a cloud-based simulator for testing Android, iOS and web apps on actual devices. It is compatible with popular automation platforms like Robotium, Calabash, UI Automation and several others. If you wish to test through clients other than the official site, there is a REST API which allows that. Other key features include  multi-platform support, customizable testing and detailed test reports.


6. Jenkins Dev@Cloud

It facilitates development, continuous deployment and integration on the cloud. It allows development in many languages and deployment to any number of services. It provides a wide array of mobile tools for development and allows connecting securely to existing systems via the cloud. It brings in benefits of third party systems like Google App Engine, Cloud Foundry and AWS Elastic Beanstalk.


7. Xamarin test cloud

It is a UI acceptance testing tool for mobile apps. It allows writing tests in C# using NUnit testing library through the UITest framework or in Ruby through the Calabash framework. The tool runs the test on over thousand physical devices and displays full-resolution screen shots of each step, including relevant data like CPU and memory usage and test time. It can be integrated into automated builds for continuous integration.


View on Demand Gallop’s webinar on security testing tools & get in touch with us to get an expert’s insight into security testing and the various tools available in the market that aid security testing

If you need assistance in selecting and deploying the right tool for your testing requirements, our experts would be more than happy to help you. Contact us.


The opinions expressed in this blog are author's and don't necessarily represent Gallop's positions, strategies or opinions.

StormRunner Load – Latest tool in Cloud based Performance Testing landscape


The steadily increasing access to internet is opening up greater opportunities for companies to create and expand their markets. As applications and software are increasingly being used to establish digital connections with the stakeholders, enterprises are looking for ways to consolidate concurrent user activity and avoid downtimes.

With the deployment of streamlined sales campaigns, spikes in transactions on festival seasons and countless such occasions, analytics driven marketing strategies demand the software and the computer environment to withstand enormous and often steep spikes in engagements. Some of the scenarios include the launch of a much awaited product on an e-commerce portal, the transfer of funds from online bank accounts at the beginning/end of the month and purchase/sale of shares on trading platforms etc.

The rise in such requirements has added a business dimension to load testing because enterprises have realized the importance of ensuring that software withstands the steep hike in user activity. Simulation of workloads through Cloud based Test Tools has been an amazing solution for enterprises which need to generate enormous loads in less time on a project basis.

The launch of HP’s StormRunner Load has added to the existing array of cloud based performance testing tools like BlazeMeter, CloudTest and NeoLoad. A pure play cloud solution for Performance Testing, StormRunner Load is an added advantage to the developers in an Agile environment.

From a business perspective, the tool offers four major benefits:

  1. Reduce effort and skill level: HP StormRunner Load provides easy to record and playback protocol support for Developers and testers with TruClient and TruAPI protocols. Agile teams can quickly automate the user stories and start running performance tests in quick time.
  2. Geographical location simulation: All Cloud based solutions offer simulating traffic from various geographical locations by choosing the LGs. StormRunner Load makes it simpler by just choosing the user load against a geographical location without having the need to calculate the number of load generators needed to simulate the target user load.
  3. Real time Analysis: StormRunner Load identifies the SLA violations and anomalies during the test based on the script, geographical location and elapsed time.
  4. Monitoring Servers: StormRunner can be integrated with monitoring tools like Sitescope to provide the resource utilization on the servers

In addition, StormRunner Load also has business friendly features the include

  • UI which includes a simple workflow of Upload scripts, Design performance tests and Run the tests
  • Scalability for web and mobile testing
  • The options to upload and save performance scripts in the cloud as assets for future use
  • Alerts in the UI which notify whether the script that is uploaded is supported by StormRunner Load or not while uploading
  • Comparison of the test results with previous runs
  • Ability to merge graphs during the  test and confirm the trends
  • Online and Offline defect detection with root cause analysis and anomaly detection


This tool falls into place to address a wide variety of business challenges by enabling performance testing in an agile environment which has short sprints and the participation of all the team members across all operations.  With an interactive UI and multiple features, StormRunner Load has the better edge in terms of ease of use by developers or other stakeholders working in an Agile environment.

By far the greatest USP of the tool is the ability to scale to enormous loads across geographical locations and capture analytics executing tests with two compelling parameters: precision and speed.

The opinions expressed in this blog are author's and don't necessarily represent Gallop's positions, strategies or opinions.