[Question] How can I just make it to search only based on my folders

[ForeverSRC]

Seems the search result is not based on my folders, it returns quite generic answer sometime.

Compared to the traditional RAG based on vector database, this system seems not good.

[wangxingjun778]

It appears to be a recall issue. If the pre-retrieval module in Sirchmunk fails to recall relevant information, it falls back to the LLM's free-talk mode. (If this experience is unsatisfactory, I can provide a switch later to bypass the LLM fallback.)

Additionally, could you please provide the document type and scale of the target document path?

Also, please check the logs during execution for any warnings regarding missing components (e.g., rga adapters, etc.). If such warnings exist, please share them. :)

[ForeverSRC]

I did an experiment to search with

1. Narrow file path (folder that contains the doc) with FAST
2. Narrow file path (folder that contains the doc) with DEEP
3. Border filter path (parent path) with FAST

The result is

1. Can get the content from file, result is a summary
2. Can get the content from file, result contains more deeper information
3. Get result from other document

Seems I need to give the path that contains what I want, otherwise the result will be bad. Also search with DEEP.

For warn logs, it is related to rga returned exit code 2 with partial errors. Seems it cannot handle some .pdf files, but this is OK.

[wangxingjun778]

Likely causes:

(1) FAST is greedy and single-file–centric, so a wide search root makes wrong-doc wins much more likely when several files share keywords; DEEP is multi-candidate / richer evidence, so answers are deeper and often better under ambiguity.

(2) rga/PDF partial failures can be ignored when the target files do not contain relevant information.

Additionally, we are currently conducting benchmark evaluations on tasks such as HotpotQA FullWiki. We plan to implement significant optimizations for both FAST and DEEP modes, which should address the issues mentioned above.

[ForeverSRC]

Glad to here this and looking forward to see the optimizations.

[wangxingjun778]

Try the latest version pip install sirchmunk>=0.0.6post3

Release notes:

• https://github.com/modelscope/sirchmunk/releases/tag/v0.0.6post3
• https://github.com/modelscope/sirchmunk/releases/tag/v0.0.6post2