speed and memory

[egbertYeah]

my inference size is 640 x 480, tested in 3090, when i set if_local as False, the pipe time is 1.22s, memory costing is large to 22G. however, when setting if_local to True, the pipe time is 2s, memeoy costing is 5.4G.

pats/configs/test_demo.yaml

Line 9 in 98d2e03

if_local: False

the result is so difference, Any suggestions for solving this problem?

[xuanlanxingkongxia]

The "if_local" choice try to pre-decide the matched pairs from multiple possible ones, and reduce the space cost. It just can provide a trade-off beween time and space.

[xuanlanxingkongxia]

But our pre-decision algorithm here is not efficient enough and seems to crop some of useful pairs incorrectly, maybe you can write a more efficient one?

[egbertYeah]

I have some problems with the code implementation. Could you please explain roughly what these functions do? Thanks.

pats/models/first_layer.py

Line 122 in 98d2e03

self.est_position(scores, scales, left.shape[2:], patch_scale)

pats/models/first_layer.py

Line 135 in 98d2e03

cycle_num, second_layer_set, third_layer_set = split_patches(sum_cycle[0], height, width, max_cycle)

pats/models/first_layer.py

Line 140 in 98d2e03

(new_left, new_right, x_scale_new, y_scale_new, average_new) = Compute_imgs(x_scale_reproj,