Compare multiple vendors locally

[imilinovic]

Description

Please briefly explain the changes you made here.

Please delete either the [master < EPIC] or [master < Task] part, depending on what are your needs.

[master < Epic] PR

• Write E2E tests
• Compare the benchmarking results between the master branch and the Epic branch
• Provide the full content or a guide for the final git message
  • [FINAL GIT MESSAGE]

[master < Task] PR

• Provide the full content or a guide for the final git message
  • [FINAL GIT MESSAGE]

Documentation checklist

• Add the documentation label tag
• Add the bug / feature label tag
• Add the milestone for which this feature is intended
  • If not known, set for a later milestone
• Write a release note, including added/changed clauses
  • [Release note text]
• Link the documentation PR here
  • [Documentation PR link]
• Tag someone from docs team in the comments

[sonarcloud]

Quality Gate passed

Issues
4 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

[gitbuda]

@imilinovic Removing this from the v2.17.0 milestone because it won't end up there. It's not put in v2.18.0 because it's not critical to be there -> maybe we can even close this PR (if mgbench is in a good state)?

[imilinovic]

This has some useful stuff for local mgbench usage but we paused it to not mess with benchmarks since we discovered a few new issues on them at the time (and new release cycle came). I think its worth keeping, I just need to polish it a bit. Not a priority for sure @gitbuda