Scopus RIS: Cannot find proper encoding for data file

[gimoAI]

When importing a RIS exported from Scopus into ASReview the following error may occur:

WARNING:root:Invalid start tag in line 0:
 TI  - Relational antecedents of information flow integration for supply chain coordination
WARNING:root:Invalid start tag in line 0:
 TI  - Relational antecedents of information flow integration for supply chain coordination
WARNING:root:Invalid start tag in line 0:
 TI  - Relational antecedents of information flow integration for supply chain coordination
ERROR:asreview.webapp.start_flask:Exception on /api/projects/testtest213/data [POST]
Traceback (most recent call last):
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\flask\app.py", line 2525, in wsgi_app
    response = self.full_dispatch_request()
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\flask\app.py", line 1822, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\flask_cors\extension.py", line 165, in wrapped_function
    return cors_after_request(app.make_response(f(*args, **kwargs)))
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\flask\app.py", line 1820, in full_dispatch_request
    rv = self.dispatch_request()
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\flask\app.py", line 1796, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\asreview\project.py", line 84, in decorated_function
    return f(project, *args, **kwargs)
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\asreview\webapp\api.py", line 406, in api_upload_data_to_project
    project.add_dataset(data_path.name)
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\asreview\project.py", line 399, in add_dataset
    as_data = read_data(self)
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\asreview\webapp\io.py", line 110, in read_data
    data_obj = ASReviewData.from_file(fp_data)
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\asreview\data\base.py", line 196, in from_file
    df, column_spec = reader.read_data(fp)
  File "C:\Users\gijsm\anaconda3\envs\asreview1\lib\site-packages\asreview\io\ris_reader.py", line 156, in read_data
    raise ValueError("Cannot find proper encoding for data file.")
ValueError: Cannot find proper encoding for data file.
ERROR:root:Cannot find proper encoding for data file.

[gimoAI]

This happens if you uncheck the box "Source & document type" in the RIS export, see screenshot below. Each entry in a RIS file should start with the TY tag (RIS file format), but Scopus removes this tag entirely if this box is unchecked. Checking the box solves the issue.

[J535D165]

Nice find. Maybe we can reach out to the scopus team?

[gimoAI]

I sent them an email 👍