FME Workbench permits multiple data streams, each of which passes through its own set of transformers.
A key concept in FME is the ability to have multiple processing streams within a workflow:
The user can combine these streams of data into one, or split one stream into several.
| .1 UPDATE |
| The Bufferer and SpatialFilter transformers in the above screenshot gained <Rejected> ports in FME 2016.1 |
| TIP |
| Similar terms to 'stream' that people use are 'flows,' 'pipes,' or 'pipelines.' |
Splitting data can occur in a number of ways. Sometimes a transformer with multiple output ports (a Tester transformer is a good illustration of this) will divide data into several output streams.
Additionally, a full stream of data can be duplicated by simply making multiple connections out of a single output port. In effect it creates a set of data for each connection.
Here, 50 road features are being read but, because there are multiple connections from the feature type, multiple copies of the data are being created.
Multiple streams are useful when a user needs to process the same data, but in a number of different ways.
When multiple streams are brought into the same input port no merging takes place. The data is simply accumulated into a single stream. This is often called a "Union".
Here, three streams of 50 features each, converge upon a single AreaCalculator:
Notice how no merging has taken place; the data simply accumulates into 150 output features.
To carry out actual merging of data requires a specific transformer such as the FeatureMerger.
| .1 UPDATE |
| The AreaCalculator transformer in the above screenshot gained a <Rejected> port in FME 2016.1 |