Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: Option to Ignore Paper #328

Open
MaxvanHaastrecht opened this issue Aug 26, 2020 · 5 comments
Open

Feature request: Option to Ignore Paper #328

MaxvanHaastrecht opened this issue Aug 26, 2020 · 5 comments
Labels
front-end Issues related to front-end, UX and UI good first issue Good for newcomers help wanted Extra attention is needed
Projects

Comments

@MaxvanHaastrecht
Copy link

Feature Request

Is your feature request related to a problem? Please describe.
Duplicate papers can be contained in the set of papers used for ASReview. This can be the result of using multiple sources, where not each source provides the exact same data (meaning it is more difficult to detect duplicates). Currently, the only options in ASReview are to include or exclude a paper. For a duplicate paper, you want to do neither.

Describe the solution you'd like
A solution to this problem would be an option to mark a paper as duplicate. If there are other use cases for this option, you may want to call this option something generic such as 'ignore'. I would suggest to then completely retrain the model without the ignored paper and also exclude it from any future calculations. It should still be shown in the eventual output, since it was a decision made by the researcher that they would like to document.

Describe alternatives you've considered
In terms of duplicate detection, a feature within ASReview could be considered, to help out researchers (like myself) who struggle to properly remove duplicates. I cannot necessarily think of any other alternatives.

Teachability, Documentation, Adoption, Migration Strategy
When a reviewer realizes that the paper he is currently looking at is a duplicate, he can choose the 'ignore' button. A pop-up explaining the consequences of their decision is displayed and the reviewer is asked to agree with the consequences. The model is retrained and the paper is ignored in further calculations.

@J535D165
Copy link
Member

Sounds like a very useful feature and not that hard to implement after #322 is implemented. I like to have the 2 options: skip (this is a duplicate) and skip (I can't decide). Or something like this.

If anyone is interested in implementing this, please drop a message over here.

@J535D165 J535D165 added this to To do in ASReview via automation Aug 27, 2020
@J535D165 J535D165 added front-end Issues related to front-end, UX and UI good first issue Good for newcomers labels Aug 27, 2020
@Rensvandeschoot
Copy link
Member

Rensvandeschoot commented Oct 21, 2020

@J535D165 I agree with the first option (duplicate), but the second option is more problematic... what will you technically do? Show the next record in the queue? Or, train the model again without this record? I would strongly recommend the user of our software to make a decision. Maybe it helps if we add a comment field (see also this feature request)

@J535D165
Copy link
Member

Good one. We need some more discussion on this. But I do like the idea to start with starting with the option to add notes. Thereafter, we can think about the skip/ignore option. Let's keep this issue open for now, maybe someone is interested in working on this. That's fine.

@Rensvandeschoot
Copy link
Member

The option to add notes has been implemented in version 1, and @rohitgarud has built an extension to extract the notes from the project file.

@Rensvandeschoot
Copy link
Member

@j0sien has raised the issue of skipping records in #1297. So, let's open the discussion again :-)

@Rensvandeschoot Rensvandeschoot added help wanted Extra attention is needed good first issue Good for newcomers and removed Discussion labels Jan 30, 2023
@Rensvandeschoot Rensvandeschoot pinned this issue Jan 30, 2023
@Rensvandeschoot Rensvandeschoot changed the title Option to Ignore Paper Feature request: Option to Ignore Paper Jan 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
front-end Issues related to front-end, UX and UI good first issue Good for newcomers help wanted Extra attention is needed
Projects
ASReview
  
To do
Development

No branches or pull requests

4 participants