Removing SearchableText from portal_catalog yields to plone.restapi warning

[sauzher]

When using collective.solr 5.0.3 it is safe, as suggested, to remove SearchableText from portal_catalog and free up a lot of memory footprint.

With collective.solr 6.0a2 (as well as master branch), every search logs:
WARNING plone.restapi.search.query No such index: 'SearchableText

[tisto]

@sauzher can you please elaborate?

[sauzher]

Doc, reports:

[using solr...] also reduce the memory footprint of your Plone instance by allowing you to remove the SearchableText, Description and Title indexes from the catalog.

After 5.0.3, c.solr uses plone.restapi to make searches but, if you do actually remove SearchableText from portal_catalog, eventlog reports WARNING plone.restapi.search.query No such index: 'SearchableText for every search.

This warning does not affect the search itself, it simply pollutes the event log without a real reason.

Perhaps it is related to plone.restapi rather than c.solr.

thanks,
alessandro.

[tisto]

@sauzher do you have a real URL as a pointer?

[sauzher]

@tisto I apologize, but I didn't get what do you asking for :-/

[tisto]

@sauzher a URL that points to what you cite in "Doc, reports".

[sauzher]

@tisto https://github.com/collective/collective.solr#current-project-status

[tisto]

@sauzher thank you! :) Could you provide me with the full trace and maybe add a pointer to the code in c.solr/p.restapi that raises that warning? I am happy to help with this but I am rather busy these days...

[sauzher]

It's a warning, so I've no a real traceback to provide but this:
2018-09-24 10:37:43 WARNING plone.restapi.search.query No such index: 'SearchableText'

Here it is the call done by c.solr:

• collective.solr/src/collective/solr/static/src/index.jsx

  Line 112 in 323d62c

  }/@search?metadata_fields=Creator&metadata_fields=modified${sortonQuery}${filterQuery}&SearchableText=${

and here it is where the warning is fired by plone.restapi:

• https://github.com/plone/plone.restapi/blob/5168dab3bb4c23408b60ed454289e71de84413fd/src/plone/restapi/search/query.py#L103

A little analysis, HTH
the plone.restapi.search.query.ZCatalogCompatibleQueryAdapter.__call__() method cycles on all indexes in the query parameter and tries to adapt each with IIndexQueryParser to normalize all possible incoming values.
A missing 'SearchableText' in the catalog yields to jump this normalizing process avoiding the "could not adapt" error and logging the warning.

Now the search process still works, because the SearchableText value is always of type of a simple string and it remains unaltered in the query dict passing throught to the catalog.searchResluts(), as well as to Solr.

@tisto You're very welcome :)

[sauzher]

I partially solved adding a fake index to the catalog

index: SearchableText (indexed attributes: FAKE_SearchableText)

In this (dirty) way, the index is kept free of data, and the restapi is pleased to find an index with that name before committing the search.

[sauzher]

Perpahs plone/plone.restapi#1087 fixes this #193 too...
I will check asap.