How to change Rouge parameters?

[jamal833]

In command sumy_eval random modsum/some_name.2.txt --language=english --file=docs/text.txt --format=plaintext How I can change different parameters of Rouge evaluation like -a -c 95 -b 665 -m -n 4 -w 1.2?

[miso-belica]

Hi @jamal833, I am afraid you can't change them. I don't know where your args -a -c 95 -b 665 -m -n 4 -w 1.2 come from but feel free to define such functionality here and maybe create PR but I am afraid that because there are many evaluation methods this would lead to really many parameters. Maybe you can use the evaluation algorithms from Python script with your own tweaks.

[deepaksinghtopwal]

@miso-belica How can i evaluate the quality of summary (i.e. Rouge score etc.) if i am using Sumy an Non CLI command(i.e. sumy_test.py and ren running the script)?

[miso-belica]

Not sure what you are asking precisely but you can see examples in https://github.com/miso-belica/sumy/blob/master/sumy/evaluation/__main__.py