You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We have a keyed Aggregation that computes an array of substantial objects.
The output of these aggregation goes straight into a flat map to explode this array.
It would be awesome if there were a way to return a Traverser from an aggregation.
Each object in the array can be in the 100's of MB, and the array can contain 100's of elements.
With the default queue settings, the ram requirements to queue this with the default settings are large.
We used the toDag method to convert the pipeline then manually set the outbound queue sizes.
This approach does works. It is a bit inconvenient and does rely on the deprecated toDag method.
The text was updated successfully, but these errors were encountered:
Hello,
We have a keyed Aggregation that computes an array of substantial objects.
The output of these aggregation goes straight into a flat map to explode this array.
It would be awesome if there were a way to return a
Traverser
from an aggregation.Each object in the array can be in the 100's of MB, and the array can contain 100's of elements.
With the default queue settings, the ram requirements to queue this with the default settings are large.
We used the
toDag
method to convert the pipeline then manually set the outbound queue sizes.This approach does works. It is a bit inconvenient and does rely on the deprecated
toDag
method.The text was updated successfully, but these errors were encountered: