Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a script to auto-download SPANet Checkpoint #205

Open
amalnanavati opened this issue Nov 14, 2024 · 1 comment
Open

Add a script to auto-download SPANet Checkpoint #205

amalnanavati opened this issue Nov 14, 2024 · 1 comment

Comments

@amalnanavati
Copy link
Contributor

The default context adapter is SPANet, and by default it looks for this checkpoint. However, it expects a certain repository structure, plus this checkpoint has to be downloaded.

We should add a convenience script that auto-configures the repository structure and downloads this checkpoint.

@jjaime2
Copy link

jjaime2 commented Dec 2, 2024

I resolved the AcquireFood issue by doing a couple of things:

  1. Manually add food_spanet_all_rgb_wall_ckpt_best.pth to the expected directory
  2. Map the weights to cpu as follows: ckpt = torch.load(ckpt_file, map_location=torch.device('cpu')). Since I'm fairly sure I used something like pip install cv2 or equivalent, CUDA is not enabled by default. I'm guessing this was done on lovelace, so we should probably add explicit instructions to set that up on other production machines.
  3. Install Pillow version 9.5.0: pip install Pillow==9.5.0. In later versions, you will get AttributeError: module 'PIL.Image' has no attribute 'ANTIALIAS', so we should probably add this to requirements.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants