Skip to content

Commit

Permalink
add file size
Browse files Browse the repository at this point in the history
  • Loading branch information
Nidheesh-Panchal committed Jul 24, 2024
1 parent ae9d43a commit edd6ccf
Showing 1 changed file with 8 additions and 9 deletions.
17 changes: 8 additions & 9 deletions docs/source/getting_started/deploy.rst
Original file line number Diff line number Diff line change
Expand Up @@ -191,17 +191,16 @@ Deploy resources using the Cloud Formation template
Now all your resources are ready to be used.


.. _Handling Multiple Inputs:

Handling Multiple Inputs
-------------------------

The pipeline will process files in the input folder sequentially in the order of upload.
Only one file will be processed at a time. Once a file is finished be processed the
pipeline will start with the next file in the queue automatically.
The pipeline will process files in the input folder sequentially in the order of upload.
Only one file will be processed at a time. Once a file is finished be processed the
pipeline will start with the next file in the queue automatically.

.. note::
**Small input files:** For best performance, it is not recommended to upload many
small files due to the startup time overhead of SageMaker jobs.
It is recommended to aggregate small inputs into larger input files.
.. You may now go to the step :doc:`end_to_end_test` to start testing your application.
**Small input files:** For best performance, it is not recommended to upload many
small files due to the startup time overhead of SageMaker jobs.
It is recommended to aggregate small inputs into larger input files.

**Handling Large Input Files:** Currently the pipeline can handle upto 100,000 events in single input file. Be mindful of the input file that is used as input.

0 comments on commit edd6ccf

Please sign in to comment.