The matching effect of similar images is too different

[NPUXJH]

Hello! I tried using LightGlue and encountered this problem: the matching effect of two similar scene images A and B and another image C is very different. For example, the matching effect of image A and image C is very good, but the matching effect of image B is very different. The match with image C is poor. Among them, the angle of view and scale of image A and image B are very similar. What is the reason for this?

[Phil26AT]

Hello @NPUXJH, i cannot answer this question without more information. Could you upload the images A, B, C here or send them to me privately?

[NPUXJH]

Hello @NPUXJH, i cannot answer this question without more information. Could you upload the images A, B, C here or send them to me privately?

OK, I have sent the relevant pictures and results to the email address of your homepage, and I look forward to further replies. Thank you!

[Phil26AT]

Hi @NPUXJH

Indeed this is a weird failure case, I tested your example with different numbers of keypoints, and it seems the confidences get confused here, but only for 2K keypoints:

1K keypoints:

2K keypoints:

4K keypoints:

Disabling early stopping results in:

Going forward, I suggest to increase the early stopping confidence.

[noahzn]

@Phil26AT I have met the same problem. Increasing the early stopping confidence doesn't help.

[erdemkkok]

@Phil26AT hi,
have you trained your data before this matching results ?
if you trained your data before this results how can i train LightGlue weigths according to my data ? and
How can i fine-tune that ?