Skip to content

Analyze Load Test Results

The results table displays a row for each:

  • Load test result,
  • Debug result,
  • Har Import.

Gatling Test Results Menu

Depending on the type of result analysis related actions are possible:

Result Type / Actions Open Gatling Report Open Grafana Dashboard Delete
HAR import Never Never Always
Load test result At the end of the test Always At the end of the test
Debug result At the end of the test Never At the end of the test

Open Gatling Report

To open a gatling HTML generated report:

  1. Click on the Menu Icon button at the right of the results,
  2. A menu appears,
  3. Click on the Open Gatling Report menu item.

A new browser tab is opened. It displays the HTML report generated by Gatling at the end of the test:

Gatling HTML Report

Tip

To get performance metrics while the test is running, either:

Open Grafana Dashboard

To open a Grafana Dashboard:

  1. Click on the Menu Icon button at the right of the results,
  2. A menu appears,
  3. Click on the Open Grafana Report menu item.

A new browser tab is opened. It displays the Grafana dashboard, even while the test is running:

Info

Check out the Grafana load test analysis chapter to know more.

Warning

While the test is running, the dashboard is periodically updated. At the end of the test, Kraken modifies the dashboard to use fixed start and end dates.

If you already have the dashboard opened, it will continue periodically updating unless you press F5 to refresh it.

How to use Grafana?

One Grafana Dashboard is generated for each test run.

This allows you to customize each report individually. To update the default dashboard template, please checkout the advanced configuration documentation.

Grafana Connexion

You are prompted for credentials the first time you open a load test dashboard:

Grafana Login

The default values are admin / kraken. Check out this documentation page to customize your Grafana configuration.

Grafana Dashboard

This chapter describes how to use the default Grafana dashboard generated by Kraken to spot performance bottlenecks, section per section.

Please read Grafana's documentation to update this default dashboard to customize it according to your needs.

Tip

Please check out OctoPerf's load testing analysis tips to help you understand the metrics displayed in this dashboard.

The charts are different, but the concepts remain the same.

Note

You may notice a blank at the beginning of the time charts. This is due to the fact that no metrics are sent while the test is starting.

To change the default dates of the Dashboard:

  1. Click on the Settings button (cogs icon),
  2. In the General section, uselect the Hide time picker option,
  3. Save the dashboard and go back to it (blue arrow button on the upper right corner),
  4. Update the dashboard timerange.

General

Grafana Dashboard General

The first section of the default dashboard provides global information about the load test, any request combined:

  • User load,
  • Hit count,
  • Error percentage,
  • Response times.

Response Times

Grafana Dashboard Response Times

The second section of the default dashboard displays metrics related to response times.

The first two charts display response times over time :

  • With Minimum, Maximum and Average values,
  • With percentile values (50, 75, 95 and 99).

They allow you to identify if the performance of the application is consistent over the duration of the test (the user load might have changed during it).

The second two bar charts display, for each request:

  • Mean response times,
  • Percentiles response times.

These allow you to quickly identify which request suffers from poor performance.

Requests Status

Grafana Dashboard Requests Status

This section displays:

  • A pie chart with the global repartition of OK/KO statuses (any request combined) during the whole test,
  • A table with the count of OK and KO statuses for each request,
  • A line chart displaying the same information over time.

Combined with a ramp-up user load, these chart will quickly tell you how many concurrent users your application can handle before sending errors.

Filtered Request

Grafana Filter Request Result

For a pre-selected request, this sections displays:

  • A pie chart with the status repartition,
  • The same information in a line chart over time,
  • The response time (Average and Percentile 95) over time.

Change the selected request by clicking on the request filter, on top of the dashboard:

Grafana Request Filter

Injector

Grafana Dashboard Injector

This last section monitors the load injector. It displays general information such as the number of CPU and available memory, but all metrics about the overall health of the machine:

  • CPU usage and load,
  • Free and used memory,
  • Network IO,
  • Disk IO.

In case the number of hits generated during the load test does not increased proportionally to the user load, you may check if the inject is sized for the task.

Note

An increase of the application under test response times may also be the reason for such behavior.

Dashboards List

Click on the Dashboards menu (four squares icon) and then on Manage to display the list of dashboards:

Grafana Dashboards

Each dashboard has the name of the Run Description set while starting the load test.

An additional dashboard named Analysis Server displays monitoring metrics of the Kraken installation. It is provisioned during the Grafana Docker container startup.