rigidbody drifting uncontrollable

[nchuxyz]

Description

Generic Spring Constraint seems not completely restrict the movement and rotation, the rigidbody still drift when set "Angular" and "Linear" to 0. This may cause some penetration in certain situation, any workaround?

Reproduce

See the attachment blender 3.3 file.
rigid_drift_test.zip

Play the animation, in frame 26:
Go to Pose Mode, select the bone(name is "Bone")
Go to Bone Constraint, compare the bone position by enable and disable constraint "mmd_tools_rigid_track", you will find it drifting obviously. But it's not supposed to move when I set "Angular" and "Linear" to 0.