Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a way to have SAM2 track the same person across scenes when there are scene cuts? #334

Open
runshouse opened this issue Sep 27, 2024 · 0 comments

Comments

@runshouse
Copy link

Using Meta's SAM2 demo, the masks often swap onto a different person when there is a scene cut.

I know manually re-tagging the person in each scene is an option, but I wanted to explore if there's an automated solution available.

Thanks!

  1. I tried using Meta's SAM2 demo at https://sam2.metademolab.com/ using a montage of Lebron
  2. I was hoping for it to track Lebron across the entire video
  3. I found it only did so in the first scene, and occasionally when Lebron was the only or main person in the shot

Below is an example:
https://github.com/user-attachments/assets/cfa028c6-838b-498f-b1ea-00ff1444b019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant