s3

S3

stoQ plugin that reads and writes data to Amazon S3 buckets.

Plugin Classes

• Archiver
• Connector

Configuration

All options below may be set by:

• plugin configuration file
• stoq command
• Stoq class

Options

• access_key [str]: AWS Access Key
• secret_key [str]: AWS Secret Key

Archiver

• archive_bucket [str]: S3 Bucket to read/save archived files from

• use_sha [True/False]: When archiving files, should archived files be saved in a directory structure based on the first five characters of the sha1 hash.

  For example, if the sha1 hash of the payload is da39a3ee5e6b4b0d3255bfef95601890afd80709, the payload will be archived to gs://$archive_bucket/d/a/3/9/a/da39a3ee5e6b4b0d3255bfef95601890afd80709.

Connector

• connector_bucket [str]: S3 Bucket where results will be saved to