Inference doesn't work on CPU

[davidkflau]

Hi, I tried to run the inference on the CPU but got the below error.

 File "\inference\predict_from_raw_data.py", line 494, in predict_logits_from_preprocessed_data
    prediction += self.predict_sliding_window_return_logits(data).to('cpu')
RuntimeError: Inplace update to inference tensor outside InferenceMode is not allowed.You can make a clone to get a normal tensor before doing inplace update.See https://github.com/pytorch/rfcs/pull/17 for more details.

[mdeleeuw1]

Same happens to me, but only when trying to perform inference using more than 1 fold.

[ykirchhoff]

Hi @davidkflau, @mdeleeuw1,

CPU inference should usually work fine, but might be that some changes broke something somewhere...
Let me check if I can reproduce your issue and get back to you.

Best,
Yannick

[abhisuri97]

Also ran into the same error. using nnunetv2≥2.2.1, torch≥2.0.0 and python ≥ 3.9