Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple reviews in the same project #1728

Open
psorianom opened this issue Apr 26, 2024 · 4 comments
Open

Multiple reviews in the same project #1728

psorianom opened this issue Apr 26, 2024 · 4 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@psorianom
Copy link

Feature Request

Is your feature request related to a problem? Please describe.

Hi, just starting to use asreview. I read in the asreview-insights documentation that in order to plot different simulations, we need to have two files, one for each simulation/model, such as :

with open_state("tests/asreview_files/sim_van_de_schoot_2017_1.asreview") as s1:
    with open_state("tests/asreview_files/"
                    "sim_van_de_schoot_2017_logistic.asreview") as s2:
        plot_recall(ax,
                    [s1, s2],
                    legend_values=["Naive Bayes", "Logistic"],
                    legend_kwargs={'loc': 'lower center'})

Describe the solution you'd like
I do wonder if it is possible to contain multiple simulations on the same ASReviewProject object, and then of course save it to disk.

Sorry if this has been covered elsewhere. Thanks for the library, it looks great 👍

@Rensvandeschoot
Copy link
Member

Are you perhaps looking for the functionality available in https://github.com/asreview/asreview-makita??

@J535D165 J535D165 added enhancement New feature or request help wanted Extra attention is needed labels Apr 30, 2024
@J535D165
Copy link
Member

@PeterLombaers what do you think? I think technically, everything is in place to make this work. The only thing that is lacking is a proper integration in the Project API. Shall we work on this for version 2?

@PeterLombaers
Copy link
Member

Yeah, that would be a nice step. Then you could also reuse feature matrices in case you use the same feature extraction method for multiple simulations. We can have a look!

@psorianom
Copy link
Author

Hi !
Thanks for your answers and interest in the topic.
I am looking at asreview-makita but I believe it is more oriented towards the use of the CLI, whereas we want to use the API. Having a single file for a single review with all the experiments/matrices inside seemed more practical to us.

We will use the multiple files method for now though, in order to keep in line with the library API :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

4 participants