Skip to content
This repository has been archived by the owner on Aug 30, 2022. It is now read-only.

Make Conversation Cloud Sync Epoch and Batch size Configureable #300

Closed
westei opened this issue Feb 18, 2019 · 0 comments
Closed

Make Conversation Cloud Sync Epoch and Batch size Configureable #300

westei opened this issue Feb 18, 2019 · 0 comments
Assignees
@westei
Labels
enhancement
Milestone
v0.8.0

Comments

@westei
Copy link
Member

westei commented Feb 18, 2019

As described by #299 the Batch size of cloud sync contributes to the high memory footprint.

To reduce the heap pressure of indexing this will make the Cloud Sync

  • Epoch size (number of conversation IDs loaded in one epoch)
  • Batch size (number of conversations loaded within an Epoch)

configurable.

The default epoch size of 10000 will be kept. The minimum Epoch size will be set to 100. The default batch size will be reduced to 1 (disabled) from the old value of 10
@westei westei self-assigned this Feb 18, 2019
@westei westei added this to the v0.8.0 milestone Feb 18, 2019
@westei westei mentioned this issue Feb 18, 2019
Closed
westei added a commit that referenced this issue Feb 18, 2019
@westei
implementation of #300
7c1ff15 
* The cloud sync is now configureable (epochSize and batchSize)
* added the new options to the application.properties (commented)
* described the new configuration in the documentation
@westei westei removed the in review label Mar 18, 2019
@westei westei closed this as completed Mar 18, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@westei westei

Labels
enhancement
Projects
None yet
Milestone
v0.8.0
Development

No branches or pull requests
1 participant
@westei