Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to evaluate performances in two-stage-decision #174

Open
NicoBiagi opened this issue May 22, 2023 · 5 comments
Open

How to evaluate performances in two-stage-decision #174

NicoBiagi opened this issue May 22, 2023 · 5 comments

Comments

@NicoBiagi
Copy link

Version of Experiment Factory:

Latest version, pulled from GitHub

Expected behavior

At the end of the experiment, the csv with the behavioural data gets downloaded, but I don't know which columns I need to look at in order to evaluate the performance

Actual behavior

Columns 'credit_var' and 'performance_var' in the downloadedare empty

Steps to reproduce behavior

Write here.

@vsoch
Copy link
Member

vsoch commented May 22, 2023

This sounds like something to figure out for the experiment, not necessarily the deployment mechanism?

@NicoBiagi
Copy link
Author

I agree. Do you know where I can find info on how to analyse the data for this specific task?

@vsoch
Copy link
Member

vsoch commented May 22, 2023

What is the experiment?

@NicoBiagi
Copy link
Author

The 'two-stage-decision' (https://expfactory.github.io/experiments/e/two-stage-decision/). I downloaded the folder and hosted it on a private server using CPanel.

@vsoch
Copy link
Member

vsoch commented May 22, 2023

Your best bet is to ask at https://github.com/expfactory/expfactory-experiments and you can see the folks that have worked on that experiment over the years: https://github.com/expfactory/expfactory-experiments/commits/master/two_stage_decision. I didn't make most of the experiments, just packaged them up, so I'm afraid I don't know the answer to questions about them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants