- Add MessageId for tracking task executions
- Drop Py2 support
- Add new SimpleProcessWorker (#76)
- Fix broken pickle of botocore clients.
- Add events hooks for pre and post processors.
- Improve behavior when a queue is created after a worker has started. The worker will now refresh the queues every 30 seconds to check for new queues.
- Change PPID checking to check for actual parent ID, instead of PID 1. This fixes issues running on docker containers where PPID of 1 is expected.
- 419ce2e Merge pull request #56 from orangain/honor-aws-region
- 7c793d0 Merge pull request #55 from orangain/fix-indentation-error
- 0643fbb Honor aws region configured by .aws/config or env var
- f5c1db9 Fix indentation error
- cdae257 Merge pull request #52 from cedarai/master
- a2ac378 Merge pull request #53 from p1c2u/fix/nosetest-remove-stop-parameter
- dbaa391 Merge pull request #51 from p1c2u/fix/pep8-styles-fixes
- 1577382 Nosetest remove stop parameter
- b7420e3 Add current directory to PYTHONPATH
- 8d04b62 Graceful shutdown logging msg fix
- 796acbc PEP8 styles fixes
- 72dcb62 Merge pull request #50 from hobbsh/add_example
- d00d31f Update readme
- dfbf459 Use .delay() to submit messages
- 612158f Merge pull request #49 from hobbsh/no_log_0_msg
- 09a649f Use logger.debug for success SQS log line
- dfd56c3 Fix typos in readme
- a774155 Add example flask app
- 17e7b7c Don't log message retrieve success when there are 0 messages
- 14eb827 Add shutdown signal logging.
- Fix KeyError on accounts without queues
- Upgrade to boto3
- Fix Python 3 support
- Allow overwriting the delay_seconds attibute at call time
- Add ability to tune
PREFETCH_MULTIPLIER
with--prefetch-multiplier
.
- Respect
--batch-size
when sizing internal queue on ManagerWorker
- Add ability to run with tunable BATCHSIZE and INTERVAL. Thanks to @masayang
- Add ability to create tasks with a visibility delay. Thanks to @joshbuddy
- Add ability to create tasks with a custom function location, allowing cross project tasks
- Convert Changelog to .rst
- Add Changelog to long description on Pypi. Thanks to @adamchainz
- Fix typos in README
- Add notes on Dead Letter Queues to README
- Switch README to reStructuredText (.rst) format so it renders on PyPI
- Process workers will kill themselves after attempting to process 100 requests, instead of checking the internal queue 100 times.
- If we find no messages on the internal queue, sleep for a moment before rechecking.
- Process workers will kill themselves after processing 100 requests
- Process workers will check a message's fetch time and visibility timeout before processing, discarding it if it has exceeded the timeout.
- Log the
process_time()
used to process a task to the INFO level.
- Only pass SQS Queue ID to internal queue. This is attempting to fix a bug when processing messages from multiple queues.
- Remove extraneous debugging code
- Add additional debugging to investigate message deletion errors
- Give each process worker its own boto connection to avoid multiprocess race conditions during message deletion
- Change long polling interval to a valid value, 0<=LPI<=20
- Switched to long polling when pulling down messages from SQS.
- Moved message deletion from SQS until after message has been processed.
- Added capability to read JSON encoded celery messages.
- Switched shutdown logging to INFO
- Added brief sleep to message retrieval loop so that we don't look like we are using a ton of CPU spinning.
- Switching task failure logging to ERROR (actually this time)
- Moved task success logging to INFO
- Added INFO level logging for number of messages retrieved from an SQS queue.
- Moved Reader and Worker process counts to DEBUG
- Added ability to pass
region
,access_key_id
andsecret_access_key
through to Boto when creating connections - Switched logging of task failure to the
ERROR
logger, fromINFO
.