v0.4.0rc1

[tobiasraabe]

This is the first release candidate for the v0.4.* release series.

The final release still requires some changes. For example, the documentation needs to be extended. But, the essential parts are already there, and it is time to collect some final feedback! Let me know what you think and what needs to be improved. You can comment in the discussion for this release.

Now, let's take a look at the changes.

What's Changed

New

• Dependencies and products of tasks have new interfaces that are explained in this tutorial.
• You can also now declare products by allowing task functions to return. Follow this guide.
• If you have inputs to task functions that should be hashed to detect any changes, follow this guide.
• Before, only pathlib.Paths received special treatment as dependencies or products to task functions. Now, it is possible to define your own nodes that simplify, for example, loading pickle files as this guide explains. But many more extensions are possible, like defining data in an S3 bucket as a dependency or product.
• The functional interface has been reworked and now accepts tasks directly, allowing you to execute pytask on the command line or in Jupyter notebooks. The documentation must still be written, but here is your starting point.

Removals

• Python 3.7 is no longer supported.
• @pytask.mark.parametrize is removed. Follow this tutorial instead.

Deprecations

• @pytask.mark.depends_on, @pytask.mark.produces are deprecated and will be removed in v0.5.0.
• @pytask.mark.task is deprecated. Use @pytask.task instead.
• Paths defined as strings are deprecated and should be replaced with proper pathlib.Path objects.

Full list of changes

• Remove Python 3.7 support and add a new action for mamba. by @tobiasraabe in Remove Python 3.7 support and add a new action for mamba. #323
• Replace pony with sqlalchemy>=1.4.36. by @tobiasraabe in Replace pony with sqlalchemy>=1.4.36. #387
• Remove @pytask.mark.parametrize. by @tobiasraabe in Remove @pytask.mark.parametrize. #391
• Parse dependencies from all args if depends_on is not used. by @tobiasraabe in Parse dependencies from all args if depends_on is not used. #384
• Add products with typing.Annotation. by @tobiasraabe in Add products with typing.Annotation. #394
• Refactor pybaum to _pytask.tree_util. by @tobiasraabe in Refactor pybaum to _pytask.tree_util. #395
• Replace pybaum with optree and add paths to PythonNode names. by @tobiasraabe in Replace pybaum with optree and add paths to PythonNode names. #396
• Add support for NamedTuple and attrs classes in @pytask.mark.task(kwargs=...). by @tobiasraabe in Add support for NamedTuple and attrs classes in @pytask.mark.task(kwargs=...). #397
• Deprecate decorators for depends_on and produces. by @tobiasraabe in Deprecate decorators for depends_on and produces. #398
• Use protocols instead of ABCs. by @tobiasraabe in Use protocols instead of ABCs. #402
• Allow tasks to return products. by @tobiasraabe in Allow tasks to return products. #404
• Tracking changes in v0.4.0. by @tobiasraabe in Tracking changes in v0.4.0. #400
• Bump peter-evans/create-pull-request from 5.0.1 to 5.0.2 by @dependabot in Bump peter-evans/create-pull-request from 5.0.1 to 5.0.2 #390
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in [pre-commit.ci] pre-commit autoupdate #388
• Allow to use prefix trees as nodes to parse function returns. by @tobiasraabe in Allow to use prefix trees as nodes to parse function returns. #406
• Remove .value from Node protocol. by @tobiasraabe in Remove .value from Node protocol. #408
• Make .from_annot an optional feature of nodes. by @tobiasraabe in Make .from_annot an optional feature of nodes. #409
• Allow to pass functions to PythonNode(hash=...). by @tobiasraabe in Allow to pass functions to PythonNode(hash=...). #410
• Add protocols for tasks. by @tobiasraabe in Add protocols for tasks. #412
• Remove scripts to generate .svgs. by @tobiasraabe in Remove scripts to generate .svgs. #413
• Allow more ruff rules. by @tobiasraabe in Allow more ruff rules. #414
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in [pre-commit.ci] pre-commit autoupdate #407
• A new functional interface. by @tobiasraabe in A new functional interface. #411
• Deprecate @pytask.mark.task in favor of @pytask.task. by @tobiasraabe in Deprecate @pytask.mark.task in favor of @pytask.task. #417
• Simplify and fix code in dag.py. by @tobiasraabe in Simplify and fix code in dag.py. #418
• Convert DeprecationWarning to FutureWarning for deprecated decorators. by @tobiasraabe in Convert DeprecationWarning to FutureWarning for deprecated decorators. #420
• Remove deprecation warning for produces. by @tobiasraabe in Remove deprecation warning for produces. #421
• Document new interface. by @tobiasraabe in Document new interface. #392
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in [pre-commit.ci] pre-commit autoupdate #415

Full Changelog: v0.3.2...v0.4.0rc1

---

This discussion was created from the release v0.4.0rc1.