Releases: pytask-dev/pytask-parallel
v0.5.1
v0.5.0
Highlights
✨ pytask-parallel v0.5.0 is released. What is new?
🚀 pytask supports more backends, like dask and even more importantly, coiled.
coiled allows you to execute individual tasks in virtual machines from the cloud provider of your choice (AWS, GCP, Azure) as serverless functions.
You can also execute every task in a project in a coiled cluster.
There are also some smaller improvements.
- The documentation is now available under https://pytask-parallel.readthedocs.io/en/stable/.
stdout
andstderr
of subprocesses are being forwarded to the main process and displayed in case of errors.
What's Changed
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #83
- Simplify code since loky is a dependency. by @tobiasraabe in #85
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #87
- Restructure the package. by @tobiasraabe in #89
- Add a registry for the parallel backend. by @tobiasraabe in #90
- Update handling of
Traceback
. by @tobiasraabe in #88 - Redirect stdout and stderr. by @tobiasraabe in #92
- Add support for dask. by @tobiasraabe in #86
- Add documentation on rtd. by @tobiasraabe in #93
- Implement a none backend as default. by @tobiasraabe in #94
- Formalize backends and apply wrappers automatically. by @tobiasraabe in #95
- Handle local paths in remote workers. by @tobiasraabe in #96
- Schedule all ready tasks. by @tobiasraabe in #99
- Manage project with rye. by @tobiasraabe in #100
- Enable
@coiled.function
. by @tobiasraabe in #97 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #91
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #103
- Sync local paths in remote environments with the same OS. by @tobiasraabe in #101
- Schedule only all ready tasks when there are coiled functions. by @tobiasraabe in #106
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #105
- Remove
status
frompytask_execute_task_log_start
. by @tobiasraabe in #107 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #108
- Polish the documentation. by @tobiasraabe in #109
- Prepare release of v0.5. by @tobiasraabe in #110
Full Changelog: v0.4.1...v0.5.0
v0.4.1
What's Changed
Some little changes to comply with the new pytask release v0.4.5.
- Update pre-commit. by @tobiasraabe in #69
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #70
- Move to
pyproject.toml
. by @tobiasraabe in #72 - Bump actions/setup-python from 4 to 5 by @dependabot in #73
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #74
- Update publishing to PyPI. by @tobiasraabe in #75
- Bump sigstore/gh-action-sigstore-python from 2.1.0 to 2.1.1 by @dependabot in #77
- Bump actions/download-artifact from 3 to 4 by @dependabot in #76
- Bump actions/upload-artifact from 3 to 4 by @dependabot in #78
- Add tests for Jupyter and fix parallelization with PythonNodes. by @tobiasraabe in #79
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #81
- Fix testing for pytask v0.4.5. by @tobiasraabe in #82
- Support partialed functions. by @tobiasraabe in #80
Full Changelog: v0.4.0...v0.4.1
v0.4.0
The new release for pytask v0.4.0 with some improvements.
What's Changed
- Deprecate Python 3.7. by @tobiasraabe in #62
- Align with v0.4.0rc2. by @tobiasraabe in #64
- Deactivate parallelization for dry-runs. by @tobiasraabe in #66
- Update dependencies and syntax. by @tobiasraabe in #67
- Better error message when entering the debugger while parallelizing. by @tobiasraabe in #68
Full Changelog: v0.3.1...v0.4.0
v0.4.0rc1
A rc that works with pytask v0.4.0rc2. Support for loky is reenabled again!
v0.3.1
What's Changed
Notably, the default backend is switched from loky
to processes
even when loky is installed. Users should not notice any changes. The reason is that there is a problem with loky and the upcoming pytask v0.3.2.
- Refactor ProcessPoolExecutor. by @tobiasraabe in #56
- Some housekeeping. by @tobiasraabe in #57
- Switch default backend to
processes
even when loky is installed. by @tobiasraabe in #59
Full Changelog: v0.3.0...v0.3.1
v0.3.0
What's Changed
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #47
- Add Python 3.11 to CI. by @tobiasraabe in #48
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #49
- Deprecate INI configuration. by @tobiasraabe in #50
- Add ruff and refurb. by @pre-commit-ci in #51
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #52
- Use mambaforge for CI. by @tobiasraabe in #53
Full Changelog: v0.2.1...v0.3.0
v0.2.1
What's Changed
- Add docformatter. by @tobiasraabe in #43
- Capture warnings. by @tobiasraabe in #44
- Make sleeping between scheduling dynamic. by @tobiasraabe in #46
Full Changelog: v0.2.0...v0.2.1
v0.2.0
What's Changed
- Add test for pytask-dev/pytask#216. by @tobiasraabe in #36
- Align with pytask v0.2. by @tobiasraabe in #37
- Add types to the package. by @tobiasraabe in #31
Full Changelog: v0.1.1...v0.2.0
v0.1.1
What's Changed
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #29
- Remove unnecessary content from tox.ini. by @tobiasraabe in #30
- Skip concurrent CI builds by @tobiasraabe in #33
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #32
- Deprecate Python 3.6 and add support for Python 3.10. by @tobiasraabe in #34
Full Changelog: v0.1.0...v0.1.1