Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Various fixes around timing tests #795

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

Various fixes around timing tests #795

wants to merge 6 commits into from

Conversation

tomato42
Copy link
Member

@tomato42 tomato42 commented Jul 27, 2022

Description

Make the timing tests more useful/usable/reliable

Motivation and Context

Better handling of timing tests

Obsoletes #728

Checklist

  • I have read the CONTRIBUTING.md document and my PR follows change requirements therein
  • the changes are also reflected in documentation and code comments
  • all new and existing tests pass (see CI results)
  • test script checklist was followed for new scripts
  • new test script added to tlslite-ng.json and tlslite-ng-random-subset.json
  • new and modified scripts were ran against popular TLS implementations:
    • OpenSSL
    • NSS
    • GnuTLS
  • required version of tlslite-ng updated in requirements.txt and README.md

This change is Reviewable

@tomato42 tomato42 added the enhancement new feature to be implemented label Jul 27, 2022
@tomato42 tomato42 self-assigned this Jul 27, 2022
@tomato42 tomato42 added this to In progress in Usability via automation Jul 27, 2022
@lgtm-com
Copy link

lgtm-com bot commented Jul 27, 2022

This pull request introduces 2 alerts when merging 3f67967 into c56a143 - view on LGTM.com

new alerts:

  • 1 for Unused local variable
  • 1 for Unused import

@tomato42 tomato42 force-pushed the timing-fixes branch 3 times, most recently from a4f6937 to e251ac8 Compare August 2, 2022 17:55
@lgtm-com
Copy link

lgtm-com bot commented Aug 2, 2022

This pull request introduces 2 alerts when merging e251ac8 into ad0ec24 - view on LGTM.com

new alerts:

  • 1 for Unused local variable
  • 1 for Unused import

dnf install -y python3 python3-devel tcpdump gmp-devel swig mpfr-devel \
libmpc openssl-devel make gcc gcc-c++ git libmpc-devel python3-six \
meson openblas-devel gcc-gfortran lapack-devel zlib-devel \
libtiff-devel libjpeg-devel openjpeg2-devel zlib-devel freetype-devel \
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

zlib-devel is duplicated

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

actually, given the complexity of getting them all installed, I'll probably provide both commands, as it affects only people running tests on platforms other than x86_64 and aarch64

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

diff_stats["SD"] = np.std(diff)
quantiles = np.quantile(diff, [0.25, 0.5, 0.75])
diff_stats["median"] = quantiles[1]
diff_stats["IQR"] = quantiles[2] - quantiles[1]
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is not Q3-Q1...

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@tomato42
Copy link
Member Author

tomato42 commented Mar 9, 2023

@t184256 why did you push to this branch?

@t184256
Copy link
Collaborator

t184256 commented Mar 9, 2023

By mistake.

use to create a list of IDs from the legend file to allow analysis of
raw_times_detail.csv based on probe ID
include also the tuple ID for pairwise testing
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement new feature to be implemented
Projects
Usability
  
In progress
Development

Successfully merging this pull request may close these issues.

None yet

2 participants