- Pin Redis to 2.x
- Adds ability to provide a custom callback to the Part context manager in place of sending a reduce message
- Modify the Part context manager to ensure the reduce message gets sent only once per job
- Send SNS messages in batch using boto3 thread safe method
- add a utils module
- Implement delete method for redis backend
- Pass kwargs to redis connection
- raise exception for missing jobid
- Refactor WatchbotProgress class to provide pluggable backends (#12)
- Implement a Redis backend (#13)
- Command line interface tools rewritten to use the backend interface.
- BREAKING CHANGE: the
Part
context manager will not fail the entire job by default. - Added
fail_job_on
, a list exceptions which will mark the job failed.
watchbot-progress-py
command line interface for tracking jobs
- send metadata with map and reduce messages #5
- implement
set_metadata
method to associate an arbitrary mapping to a job - pass
metadata
kwarg tocreate_job