RuntimeError: Unknown Layout in CUDA Kernel Execution

[fantasysee]

Dears,

Thank you for sharing the fantastic open-source project awq.

However, during my reproduction process (see attached opt_mine_sh.txt), it seems that the CUDA Kernel is not running correctly, and instead, I'm encountering a RuntimeError: Unknown layout (refer to the attached run.log). Could you provide insights into the possible reasons for this issue and suggest a solution?

Appreciate your assistance!

Best regards,
Chao