Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Metric for user scenario success / failure #4381

Open
kubehe opened this issue Jan 25, 2023 · 4 comments
Open

Feature: Metric for user scenario success / failure #4381

kubehe opened this issue Jan 25, 2023 · 4 comments

Comments

@kubehe
Copy link

kubehe commented Jan 25, 2023

Please don't post questions here but use our community forum instead.

During load tests it would be great to have a OK/KO for single user scenario.
Currently there is granular per endpoint OK/KO, I'm missing full user journey metric to show management at which point users will be dissatisfied with our service.

@slandelle
Copy link
Member

Sorry, I don't get it.

@slandelle
Copy link
Member

During load tests it would be great to have a OK/KO for single user scenario.

@kubehe Could you please elaborate? I don't get if you're looking for metrics aggregated per scenario (available in Gatling Enterprise) or per user (which I'm not sure makes sense).

@kubehe
Copy link
Author

kubehe commented Feb 18, 2023

At the time I was thinking about a metric similar to what a group gives you.

My main use case would be to calculate availability of the system for end user during load test.
It's hard to see flow conversion from simple metric like ratio of success to total requests.

Issues that I have with Group metric:

  • You need to be explicit and remember to add it always to your scenario.
  • There is no error list with failed assertions provided.

Simple example:

    final case class UserEnd(
        scenario: String,
        groupHierarchy: List[String],
        startTimestamp: Long,
        endTimestamp: Long,
        cumulatedResponseTime: Int,
        errorMessages: List[String]
        status: Status
    ) extends LoadEvent {
      val duration: Int = (endTimestamp - startTimestamp).toInt
    }

@Amerousful
Copy link
Contributor

Amerousful commented Mar 7, 2023

@kubehe
My 2 cents: You can create the rate metric based on a first and a last request in your scenario first request rps / last requets rps.


In: 100
Out: 100
Rate: 1

In: 100
Out: 50
Rate: 0.5 (something went wrong)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

3 participants