Skip to content

OP Test Input Shape Requirements (English Version)

zhupengyang edited this page Jan 19, 2020 · 5 revisions

OP Test Specification:OP test must use large size inputs.

Specification summary:

  • Section 1, Explanations Of The Specification
  • Section 2, Check Of The Specification
  • Section 3, Check Of CI
  • Section 4, Suggestions Of Check Failure

Supplementary note:

  1. You may find some aspects that are not taken into account in the existing specifications, which need to be continuously supplemented and improved during the implementation process. Please feel free to give your feedback.

1. Explanations Of The Specification

There is a problem that the input shape is too small in several OP tests, which leads to incomplete test. The grad check of some kernels is related to the size of the input shape. If the input shape is too small, the grad check passes, but it may still have problems.

In order to better ensure the coverage of OP tests, this specification is proposed. The corresponding detections are added to Op tests, and CI will check the white list of this specification.

2. Checks Of The Specification

  • Op tests shape rule: The product of the input dimension of all test cases must be greater than or equal to 100.

3. Check Of CI

specific cases:

  • Shape check will be skipped if the op test is decorated by skip_check_grad_ci.
  • Please contact one of specific people for approval.

4. Suggestions for Check Failure

  • enlarge input shapes of all cases to 100+
  • Please use skip_check_grad_ci to skip the shape check for specific cases,and add "[skip shape check]" at the beginning of the reason. Refer to PR#22332

If you encounter other problems, please contact @zhupengyang

Clone this wiki locally