Student's solution with input() passes "Validate", but fails on "Autograde"

[lahwaacz]

Steps to reproduce the actual behavior

For example, give students this assignment (I'll omit the description as it is self-explanatory):

def count_digits(n, d):
    ### BEGIN SOLUTION
    n = abs(n)
    return str(n).count(str(d))
    ### END SOLUTION

Let's assume just one simple public test case:

assert count_digits(112233, 2) == 2

Let's say that a student changes the cell with the assignment as follows:

a = input("Enter an integer")
b = input("Enter a digit")

def count_digits(n, d):
    n = abs(n)
    return str(n).count(str(d))

s = count_digits(int(a), int(b))
print(s)

Now there is an issue: when the student clicks on the "Validate" button in JupyterLab to validate their assignment, nbgrader executes it just fine and says that the solution passes all the tests. However, when the instructor runs autograde, it fails with the following error:

StdinNotImplementedError: raw_input was called, but this frontend does not support input requests.

Expected behavior

Validate and autograde should behave consistently with respect to the input() function: either both should succeed, or both should fail with the same error.

Operating system

Arch Linux

nbgrader --version

Python version 3.11.5 (main, Sep  2 2023, 14:16:33) [GCC 13.2.1 20230801]
nbgrader version 0.9.1

jupyterhub --version (if used with JupyterHub)

4.0.2

jupyter notebook --version

7.0.6

jupyter lab --version

4.0.7

[brichet]

Thanks @lahwaacz for reporting this issue.
After some inspection, it seems intentional that using the validate button only return errors on grade cells.

nbgrader/nbgrader/validator.py

Line 251 in 9876829

if utils.is_grade(cell):

There is even an option to validate the whole notebook, c.Validator.validate_all = True (default to False).

nbgrader/nbgrader/validator.py

Lines 92 to 95 in 9876829

	validate_all = Bool(
	False,
	help="Validate all cells, not just the graded tests cells."
	).tag(config=True)

I don't have the history of these choices...