New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MetricPipeline in not limited in n_resamples in tests #447

Open

yoavkatz opened this issue Jan 3, 2024 · 0 comments

Member

yoavkatz commented Jan 3, 2024

This is the root cause: https://github.com/IBM/unitxt/blob/main/src/unitxt/test_utils/metrics.py#L75

I think we need to test if the inner metric in MetricPipeline is GlobalMetri object and if so, set the n_resamples=3 to it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment