Skip to content

index folder too long for windows #5301

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
3 tasks done
Lavaerius opened this issue Apr 23, 2025 · 3 comments
Open
3 tasks done

index folder too long for windows #5301

Lavaerius opened this issue Apr 23, 2025 · 3 comments
Assignees
Labels
area:indexing Relates to embedding and indexing ide:vscode Relates specifically to VS Code extension kind:bug Indicates an unexpected problem or unintended behavior os:windows Happening specifically on Windows

Comments

@Lavaerius
Copy link

Before submitting your bug report

Relevant environment info

- OS: Windows (WSL Dev container)
- Continue version: 1.0.6
- IDE version: VSCode 1.99.3
- Model: n/a
- config:

  
  OR link to assistant in Continue hub:

Description

When attempting to index my codebase in a WSL backed dev container, the indexer fails with a
Generic LocalFileSystem error: Unable to create dir error
digging in, I think it has to do with the length of the folder being created.

Max limit for windows folders is 260 characters, folder attempted to be created is:
vscode-remotedev-container2B7b227265706f7369746f727950617468223a226769744067697465612e6c6f63616c3a7075626c696357616773486f6d652f7267622d6c65642d626f6172642e676974222c22766f6c756d654e616d65223a225f5f554e495155455f5f222c22666f6c646572223a227267622d6c65642d626f617264222c22636c6f6e65496e666f223a7b2275726c546f436c6f6e65223a226769744067697465612e6c6f63616c3a7075626c696357616773486f6d652f7267622d6c65642d626f6172642e676974227d2c22696e7370656374566f6c756d65223a66616c73657dworkspacesrgb-led-boardNONEvectordb_TransformersJsEmbeddingsProviderall-MiniLM-L6-v2500.lance

I attempted to enabled longPathNames, but that appears to have no effect in more recent versions of windows

To reproduce

  1. clone git repo to container volume
  2. witness log error in developer tools logging

Log output

@dosubot dosubot bot added area:indexing Relates to embedding and indexing ide:vscode Relates specifically to VS Code extension kind:bug Indicates an unexpected problem or unintended behavior labels Apr 23, 2025
@RomneyDa
Copy link
Collaborator

@Lavaerius thanks for the report
Thinking solution. might be to truncate to LAST < 260 characters

@Patrick-Erichsen
Copy link
Collaborator

Yeah there's no reason it needs to be the full path name just something unique.

Is this something you'd be able to contribute @Lavaerius ? I believe the fix would be here: https://github.com/continuedev/continue/blob/main/core/indexing/LanceDbIndex.ts#L83-L85

@dosubot dosubot bot added the os:windows Happening specifically on Windows label May 7, 2025
@RomneyDa
Copy link
Collaborator

Fixed by #5632

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:indexing Relates to embedding and indexing ide:vscode Relates specifically to VS Code extension kind:bug Indicates an unexpected problem or unintended behavior os:windows Happening specifically on Windows
Projects
None yet
Development

No branches or pull requests

3 participants