Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to apply easse to custom data? #101

Open
vegebun opened this issue Aug 28, 2022 · 1 comment
Open

How to apply easse to custom data? #101

vegebun opened this issue Aug 28, 2022 · 1 comment

Comments

@vegebun
Copy link

vegebun commented Aug 28, 2022

I am trying to evaluate a customized set of asset data. However, I am not very sure how to use the syntax. Currently I am using this syntax

!easse evaluate --refs_sents_paths ref_data --orig_sents_path orig_data --sys_sents_path test_pred_dir -t custom -m 'bleu,sari,fkgl' -q < easse/easse/resources/data/system_outputs/asset/test

which will report this error:

`

Fatal Python error: _PySys_BeginInit: is a directory, cannot continue

Current thread 0x00007f5625e9b780 (most recent call first):
`

I am using google collar, and all the path can correctly access the files.

image

image

image

Can you please let me know at which step is my syntax wrong ? Thank you so much!

@louismartin
Copy link
Collaborator

I think there are multiple errors:

  • Use either -sys_sents_path or < sys_path
  • Are you sure all your paths are files? I supsect one to be a directory

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants