Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PNL - Test2 #153

Open
diogocruz17 opened this issue Nov 22, 2023 · 3 comments
Open

PNL - Test2 #153

diogocruz17 opened this issue Nov 22, 2023 · 3 comments

Comments

@diogocruz17
Copy link

Hello.
I was applying the PNL algorithm to some data and was getting unexpected results.
Upon running the tests, I get an error in test_pnl_simulation_2, for the p_value_forward_2 value.
Is there a known problem regarding this?
Screenshot from 2023-11-22 15-41-45
Thank you

@ErdunGAO
Copy link
Contributor

Hello. I was applying the PNL algorithm to some data and was getting unexpected results. Upon running the tests, I get an error in test_pnl_simulation_2, for the p_value_forward_2 value. Is there a known problem regarding this? Screenshot from 2023-11-22 15-41-45 Thank you

Thank you for bringing up this issue. I've run the second test myself, and it successfully passed.

image

I'm considering that the error might be raised from the update in some fundamental packages, such as scipSklearnlearn. Could you verify the precise values of p_value_forward_2 and p_value_backward_2? We're considering updating that asserting exact values to defining intervals, which we think will provide better resilience against potential minor issues arising from future updates to these core packages.

@diogocruz17
Copy link
Author

diogocruz17 commented Nov 29, 2023

That seems to be the problem, there is a small difference in the p_value_forward_2 to the simulated one.
image
Third test passes and the real case also has a small deviation.
image

@ErdunGAO
Copy link
Contributor

That seems to be the problem, there is a small difference in the p_value_forward_2 to the simulated one. image Third test passes and the real case also has a small deviation. image

Thanks for the reporting results! We have encountered a similar issue in some other implementations before, where updates to the underlying computation library caused the test examples to fail. Thank you for your information; we will update these assert statements ASAP.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants