Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option to stop evaluation of a subtask on first 0 score. #1205

Open
RezwanArefin01 opened this issue May 11, 2022 · 0 comments
Open

Option to stop evaluation of a subtask on first 0 score. #1205

RezwanArefin01 opened this issue May 11, 2022 · 0 comments

Comments

@RezwanArefin01
Copy link

The Problem

It is often a problem that CMS runs all files for each submission. In most OI styles problems, there is usually a subtask where very worse complexity solution can pass. Many participants usually code that first and submit. But since this is run on all the files, the later subtasks take up huge unnecessary judging time that it often jams up the server (low spec servers), especially in the beginning of the contest, sometimes even crash it (from experience)!

The Solution

For minimum in subtask scoring, stop evaluating more files once at least one of the file gets score 0. (This may also be related to feedback level full / restricted).
It may not be the default, but having an option for this will be very helpful!
Although it may be difficult to implement, since in CMS evaluation is done in parallel, in contrary to other online judges that stop on first wrong answer.

Alternative

Current way to overcome this problem is to just have small number of input files. Which can be a bad thing for some problems.

@wil93 wil93 added this to the P2 milestone Nov 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

2 participants