Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Secondary Metric Exposure (and most likely Win Probability) doesn’t seem to work #21929

Open
jurajmajerik opened this issue Apr 29, 2024 · 0 comments
Labels
bug Something isn't working right feature/experimentation Feature Tag: Experimentation team-feature-success

Comments

@jurajmajerik
Copy link
Contributor

Bug Description

Bug description

I’m guessing this is once again due to an assumption about how exposure is determined (most likely using the $feature_flag_called event rather than the first event in the funnel. However these secondary metric win probaibliyt calculations don’t seem very trustworthy when the exposure says 1.

image

How to reproduce

Additional context

Debug info

- [ ] PostHog Cloud, Debug information: [please copy/paste from https://us.posthog.com/settings/project-details#variables]
- [ ] PostHog Hobby self-hosted with `docker compose`, version/commit: [please provide]
- [ ] PostHog self-hosted with Kubernetes (deprecated, see [`Sunsetting Kubernetes support`](https://posthog.com/blog/sunsetting-helm-support-posthog)), version/commit: [please provide]
@jurajmajerik jurajmajerik added bug Something isn't working right feature/experimentation Feature Tag: Experimentation team-feature-success labels Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working right feature/experimentation Feature Tag: Experimentation team-feature-success
Projects
None yet
Development

No branches or pull requests

1 participant