Conversation search endpoint returns inconsistent number of results

[Peym4n]

Expected Behaviour

The returned number of results (numFound) should stay the same between each request, when no new messages were added.

Actual Behaviour

The returned number of results (numFound) changes unexpectedly (decrease and increase by 1) after each request, even when no new messages were added.

Environment

• Smarti-Version: v0.7.3

[westei]

As this might be releated to the embedded Solr server we will delay this until we switched to en external Solr Server (see SolrCloud support)

[westei]

Their are two reasons why this can happen:

1. This Query Provider performs a query in Solr and loads the Data from the MongoDB. If Solr provides a result that is not present in the MongoDB it gets filtered. So if the Solr <-> MongoDB is not in Sync the number of actual results can differ from the numFound in Solr
2. This Query Provider uses contextual information for the query. So the Results context may overlap. If this is the case unique results of the Solr query are merged into a single result. In case of merged results the actual results may be less as the numFound provided by Solr.

Both cases can only be solved if we re-implement this query provider to work solely on the Solr Index. While this was not possible with 0.8.0 the Conversation Index updates #302 implemented for 0.9.0 and espacialy the Conversation Segmentation part of #303 could now support such an implementation (as it is now possible to avoid overlapping Solr Results using Solr collapse/expand functionality)