zenml

release-notes

<p>It’s been a couple of weeks, so it’s time for a new release! 0.9.0 brings two whole new orchestrators, one of which was contributed by a community member just one day after we unveiled new documentation for orchestrator extensibility! The release also includes a new secrets manager, a Slack integration, and a bunch of other smaller changes across the codebase. (Our new orchestrators are exciting enough that they’ll get their own blog posts to showcase their strengths in due course.)</p><p>Beyond this, as usual, we included several smaller bugfixes and documentation changes to cumulatively improve the experience of using ZenML as a user. For a detailed look at what’s changed, glance at our full release notes.</p><p><br></p><h2>🤯 Github Actions as Orchestrator</h2><h2><br></h2><p>Who says you need a complicated infrastructure set up to run your pipeline? Just use GitHub Actions. With&nbsp;<a href="https://github.com/zenml-io/zenml/pull/685" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">this new addition</a>&nbsp;to ZenML’s ever-growing list of built-in orchestrators, you can run your pipelines using GitHub Actions to manage the dependencies between steps.</p><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/github_actions_ui_141163c57a.png" alt="github_actions_ui.png"></p><p><br></p><p>You wouldn’t want your secrets floating around openly in your code commits, so we made sure to integrate with&nbsp;<a href="https://docs.github.com/en/actions/security-guides/encrypted-secrets" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">the way GitHub stores secrets</a>&nbsp;as encrypted environment variables.</p><p>Needless to say, the GitHub Actions orchestrator is an exciting new addition to ZenML that will help you get going with your deployed pipelines even faster.&nbsp;<a href="https://zenml.io/slack-invite/" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">Let us know</a>&nbsp;if you are excited by this new integration!</p><p><br></p><h2>☁ Vertex AI Orchestrator: To Google and Beyond!</h2><h2><br></h2><p>We previously added a way to run individual steps on&nbsp;<a href="https://cloud.google.com/vertex-ai" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">Vertex AI</a>&nbsp;as step operators. One of our amazing community members,&nbsp;<a href="https://github.com/gabrielmbmb" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">Gabriel Martín Blázquez</a>, has&nbsp;<a href="https://github.com/zenml-io/zenml/pull/640" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">added a way</a>&nbsp;to orchestrate your entire pipelines using Vertex AI Pipelines.</p><p>The most exciting thing about this new orchestrator is that it came as a direct result of our documentation and extensibility improvements in&nbsp;<a href="https://blog.zenml.io/zero-eight-zero-release/" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">our last release</a>. We look forward to seeing what other integrations users add to their stacks…</p><p><br></p><h2>🍏 Fruits of the ZenHack Day: Slack Alerters and Azure Secrets Manager</h2><h2><br></h2><p><a href="https://youtu.be/8qb5IABTZ-s" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">Our community-focused ZenHack day</a>&nbsp;included several features that were implemented alongside one another. Among those was a&nbsp;<a href="https://www.atlassian.com/blog/software-teams/what-is-chatops-adoption-guide" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">ChatOps</a>-inspired Alerter component, with Slack as its first inbuilt implementation.</p><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/slack_alerter_9367d82b62.png" alt="slack-alerter.png"></p><p><br></p><p>You can now define interfaces where you can interact with and make decisions around how your steps get executed through Slack commands. Because seriously, who’d rather do this in the terminal when you can get a friendly Slack ping instead?</p><p>We also&nbsp;<a href="https://github.com/zenml-io/zenml/pull/654" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">implemented an Azure Secrets Manager</a>&nbsp;integration, completing our cloud secrets manager coverage. We’ve got a cloud-agnostic implementation of this in the works, but more about that next release!</p><p><br></p><h2>⌨️ CLI Improvements</h2><h2><br></h2><p>Barely a release passes without some user-facing CLI improvements, and this one is no exception. We added two small changes that just might bring a bit of UI 🌞 to your day:</p><ul><li>If you want to register a stack component but aren’t sure exactly which attributes to register for your particular component, we&nbsp;<a href="https://github.com/zenml-io/zenml/pull/695" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">added an interactive CLI flow</a>&nbsp;that guides you through everything you need to include.</li></ul><p><br></p><ul><li>We previously added the ability to update a pre-existing stack in place, but sometimes you want to duplicate a stack and make a slight modification to the one you already configured. In this release, we’ve given you that option with the easy&nbsp;<code style="background-color: rgb(240, 240, 240); color: rgb(232, 62, 140);">zenml stack copy</code>&nbsp;command.</li></ul><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/interactive_9ab0f93c05.png" alt="interactive.png"></p><h2><br></h2><h2>📖 Documentation &amp; User Guides</h2><h2><br></h2><p>User-facing documentation is really important for us at ZenML, and we keep our main documentation page up-to-date. With the latest release, we’ve made sure we’re just as consistent with the internal code documentation in the form of docstrings. We’ve added CI checks using&nbsp;<code style="background-color: transparent; color: inherit;"><a href="http://www.pydocstyle.org/en/stable/" rel="noopener noreferrer" target="_blank">pydocstyle</a></code>&nbsp;and&nbsp;<code style="background-color: transparent; color: inherit;"><a href="https://github.com/terrencepreilly/darglint" rel="noopener noreferrer" target="_blank">darglint</a></code>&nbsp;that ensure that all our functions and modules include correct and consistently presented docstrings.</p><p>We switched out how we check for spelling errors, too, and we’re now using&nbsp;<code style="background-color: transparent; color: inherit;"><a href="https://facelessuser.github.io/pyspelling/" rel="noopener noreferrer" target="_blank">pyspelling</a></code>&nbsp;everywhere to make sure we stay typo-free!</p><p>This release includes several other smaller documentation fixes and additions.</p><p>asdas</p><h2>➕ Other Updates, Additions and Fixes</h2><h2><br></h2><p>The latest release include several smaller features and updates to existing functionality:</p><ul><li>Schedules can now be defined using ‘cron’ expressions</li><li>The detection of whether a step was cached or not is now done without querying the metadata store. This reduces the step execution by ~10secs.</li><li>We now allow for the passing of authentication credentials to all artifact stores and container registries as secrets</li><li>We made the dependencies that are part of the ZenServer optional. If you wish to install the ZenServer, be sure to use the following command:&nbsp;<code style="background-color: rgb(240, 240, 240); color: rgb(232, 62, 140);">pip install zenml[server]</code>.</li><li>We fixed some broken or deprecated CLI commands listed in our examples.</li><li>We made some internal changes to how code is organized within the core&nbsp;<code style="background-color: rgb(240, 240, 240); color: rgb(232, 62, 140);">src/zenml</code>&nbsp;directory, notably for the&nbsp;<code style="background-color: rgb(240, 240, 240); color: rgb(232, 62, 140);">utils</code>&nbsp;module and for all the cloud integrations.</li><li><br></li></ul><h2>🙌 Community Contributions</h2><h2><br></h2><p>We received several new community contributions during this release cycle. We mentioned Gabriel’s Vertex AI orchestrator above already, but we also saw the following contributions:</p><ul><li><a href="https://github.com/anencore94" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">@anencore94</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/644" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">https://github.com/zenml-io/zenml/pull/644</a></li><li><a href="https://github.com/hectorLop" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">@hectorLop</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/648" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">https://github.com/zenml-io/zenml/pull/648</a></li><li><a href="https://github.com/gabrielmbmb" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">@gabrielmbmb</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/640" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">https://github.com/zenml-io/zenml/pull/640</a></li><li><a href="https://github.com/ketangangal" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">@ketangangal</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/628" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">https://github.com/zenml-io/zenml/pull/628</a></li><li><a href="https://github.com/Reed-Schimmel" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">@Reed-Schimmel</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/684" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">https://github.com/zenml-io/zenml/pull/684</a></li></ul><p><br></p><h2>👩‍💻 Contribute to ZenML!</h2><h2><br></h2><p>Join our&nbsp;<a href="https://zenml.io/slack-invite/" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">Slack</a>&nbsp;to let us know if you have an idea for a feature or something you’d like to contribute to the framework.</p><p>We have a&nbsp;<a href="https://zenml.io/roadmap" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">new home for our roadmap</a>&nbsp;where you can vote on your favorite upcoming feature or propose new ideas for what the core team should work on. You can vote without needing to log in, so please do let us know what you want us to build!</p><p>[Photo by&nbsp;<a href="https://unsplash.com/@allisonh328" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">Allison Louise</a>&nbsp;on&nbsp;<a href="https://unsplash.com/photos/xABgmlX4ABE" rel="noopener noreferrer" target="_blank" style="color: rgb(43, 217, 120); background-color: transparent;">Unsplash</a>]</p>

0.9.0 brings two whole new orchestrators, one of which was contributed by a community member just one day after we unveiled new documentation for orchestrator extensibility! 

What's New in v0.9.0: Everyone Gets an Orchestrator!

pipeline

Test

<p>It’s been a couple of weeks, so it’s time for a new release! 0.9.0 brings two whole new orchestrators, one of which was contributed by a community member just one day after we unveiled new documentation for orchestrator extensibility! The release also includes a new secrets manager, a Slack integration, and a bunch of other smaller changes across the codebase. (Our new orchestrators are exciting enough that they’ll get their own blog posts to showcase their strengths in due course.)</p><p>Beyond this, as usual, we included several smaller bugfixes and documentation changes to cumulatively improve the experience of using ZenML as a user. For a detailed look at what’s changed, glance at our full release notes.</p><p><br></p><h2>🤯 Github Actions as Orchestrator</h2><h2><br></h2><p>Who says you need a complicated infrastructure set up to run your pipeline? Just use GitHub Actions. With&nbsp;<a href="https://github.com/zenml-io/zenml/pull/685" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">this new addition</a>&nbsp;to ZenML’s ever-growing list of built-in orchestrators, you can run your pipelines using GitHub Actions to manage the dependencies between steps.</p><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/github_actions_ui_141163c57a.png" alt="github_actions_ui.png"></p><p><br></p><p>You wouldn’t want your secrets floating around openly in your code commits, so we made sure to integrate with&nbsp;<a href="https://docs.github.com/en/actions/security-guides/encrypted-secrets" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">the way GitHub stores secrets</a>&nbsp;as encrypted environment variables.</p><p>Needless to say, the GitHub Actions orchestrator is an exciting new addition to ZenML that will help you get going with your deployed pipelines even faster.&nbsp;<a href="https://zenml.io/slack-invite/" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">Let us know</a>&nbsp;if you are excited by this new integration!</p><p><br></p><h2>☁ Vertex AI Orchestrator: To Google and Beyond!</h2><h2><br></h2><p>We previously added a way to run individual steps on&nbsp;<a href="https://cloud.google.com/vertex-ai" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">Vertex AI</a>&nbsp;as step operators. One of our amazing community members,&nbsp;<a href="https://github.com/gabrielmbmb" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">Gabriel Martín Blázquez</a>, has&nbsp;<a href="https://github.com/zenml-io/zenml/pull/640" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">added a way</a>&nbsp;to orchestrate your entire pipelines using Vertex AI Pipelines.</p><p>The most exciting thing about this new orchestrator is that it came as a direct result of our documentation and extensibility improvements in&nbsp;<a href="https://blog.zenml.io/zero-eight-zero-release/" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">our last release</a>. We look forward to seeing what other integrations users add to their stacks…</p><p><br></p><h2>🍏 Fruits of the ZenHack Day: Slack Alerters and Azure Secrets Manager</h2><h2><br></h2><p><a href="https://youtu.be/8qb5IABTZ-s" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">Our community-focused ZenHack day</a>&nbsp;included several features that were implemented alongside one another. Among those was a&nbsp;<a href="https://www.atlassian.com/blog/software-teams/what-is-chatops-adoption-guide" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">ChatOps</a>-inspired Alerter component, with Slack as its first inbuilt implementation.</p><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/slack_alerter_9367d82b62.png" alt="slack-alerter.png"></p><p><br></p><p>You can now define interfaces where you can interact with and make decisions around how your steps get executed through Slack commands. Because seriously, who’d rather do this in the terminal when you can get a friendly Slack ping instead?</p><p>We also&nbsp;<a href="https://github.com/zenml-io/zenml/pull/654" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">implemented an Azure Secrets Manager</a>&nbsp;integration, completing our cloud secrets manager coverage. We’ve got a cloud-agnostic implementation of this in the works, but more about that next release!</p><p><br></p><h2>⌨️ CLI Improvements</h2><h2><br></h2><p>Barely a release passes without some user-facing CLI improvements, and this one is no exception. We added two small changes that just might bring a bit of UI 🌞 to your day:</p><ul><li>If you want to register a stack component but aren’t sure exactly which attributes to register for your particular component, we&nbsp;<a href="https://github.com/zenml-io/zenml/pull/695" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">added an interactive CLI flow</a>&nbsp;that guides you through everything you need to include.</li></ul><p><br></p><ul><li>We previously added the ability to update a pre-existing stack in place, but sometimes you want to duplicate a stack and make a slight modification to the one you already configured. In this release, we’ve given you that option with the easy&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">zenml stack copy</code>&nbsp;command.</li></ul><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/interactive_9ab0f93c05.png" alt="interactive.png"></p><h2><br></h2><h2>📖 Documentation &amp; User Guides</h2><h2><br></h2><p>User-facing documentation is really important for us at ZenML, and we keep our main documentation page up-to-date. With the latest release, we’ve made sure we’re just as consistent with the internal code documentation in the form of docstrings. We’ve added CI checks using&nbsp;<code style="color: inherit; background-color: transparent;"><a href="http://www.pydocstyle.org/en/stable/" rel="noopener noreferrer" target="_blank">pydocstyle</a></code>&nbsp;and&nbsp;<code style="color: inherit; background-color: transparent;"><a href="https://github.com/terrencepreilly/darglint" rel="noopener noreferrer" target="_blank">darglint</a></code>&nbsp;that ensure that all our functions and modules include correct and consistently presented docstrings.</p><p>We switched out how we check for spelling errors, too, and we’re now using&nbsp;<code style="color: inherit; background-color: transparent;"><a href="https://facelessuser.github.io/pyspelling/" rel="noopener noreferrer" target="_blank">pyspelling</a></code>&nbsp;everywhere to make sure we stay typo-free!</p><p>This release includes several other smaller documentation fixes and additions.</p><p><br></p><h2>➕ Other Updates, Additions and Fixes</h2><h2><br></h2><p>The latest release include several smaller features and updates to existing functionality:</p><ul><li>Schedules can now be defined using ‘cron’ expressions</li><li>The detection of whether a step was cached or not is now done without querying the metadata store. This reduces the step execution by ~10secs.</li><li>We now allow for the passing of authentication credentials to all artifact stores and container registries as secrets</li><li>We made the dependencies that are part of the ZenServer optional. If you wish to install the ZenServer, be sure to use the following command:&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">pip install zenml[server]</code>.</li><li>We fixed some broken or deprecated CLI commands listed in our examples.</li><li>We made some internal changes to how code is organized within the core&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">src/zenml</code>&nbsp;directory, notably for the&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">utils</code>&nbsp;module and for all the cloud integrations.</li><li><br></li></ul><h2>🙌 Community Contributions</h2><h2><br></h2><p>We received several new community contributions during this release cycle. We mentioned Gabriel’s Vertex AI orchestrator above already, but we also saw the following contributions:</p><ul><li><a href="https://github.com/anencore94" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">@anencore94</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/644" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/644</a></li><li><a href="https://github.com/hectorLop" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">@hectorLop</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/648" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/648</a></li><li><a href="https://github.com/gabrielmbmb" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">@gabrielmbmb</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/640" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/640</a></li><li><a href="https://github.com/ketangangal" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">@ketangangal</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/628" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/628</a></li><li><a href="https://github.com/Reed-Schimmel" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">@Reed-Schimmel</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/684" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/684</a></li></ul><p><br></p><h2>👩‍💻 Contribute to ZenML!</h2><h2><br></h2><p>Join our&nbsp;<a href="https://zenml.io/slack-invite/" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">Slack</a>&nbsp;to let us know if you have an idea for a feature or something you’d like to contribute to the framework.</p><p>We have a&nbsp;<a href="https://zenml.io/roadmap" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">new home for our roadmap</a>&nbsp;where you can vote on your favorite upcoming feature or propose new ideas for what the core team should work on. You can vote without needing to log in, so please do let us know what you want us to build!</p><p>[Photo by&nbsp;<a href="https://unsplash.com/@allisonh328" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">Allison Louise</a>&nbsp;on&nbsp;<a href="https://unsplash.com/photos/xABgmlX4ABE" rel="noopener noreferrer" target="_blank" style="background-color: transparent; color: rgb(43, 217, 120);">Unsplash</a>]</p>

<p>It’s been a couple of weeks, so it’s time for a new release! 0.9.0 brings two whole new orchestrators, one of which was contributed by a community member just one day after we unveiled new documentation for orchestrator extensibility! The release also includes a new secrets manager, a Slack integration, and a bunch of other smaller changes across the codebase. (Our new orchestrators are exciting enough that they’ll get their own blog posts to showcase their strengths in due course.)</p><p>Beyond this, as usual, we included several smaller bugfixes and documentation changes to cumulatively improve the experience of using ZenML as a user. For a detailed look at what’s changed, glance at our full release notes.</p><p><br></p><h2>🤯 Github Actions as Orchestrator</h2><h2><br></h2><p>Who says you need a complicated infrastructure set up to run your pipeline? Just use GitHub Actions. With&nbsp;<a href="https://github.com/zenml-io/zenml/pull/685" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">this new addition</a>&nbsp;to ZenML’s ever-growing list of built-in orchestrators, you can run your pipelines using GitHub Actions to manage the dependencies between steps.</p><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/github_actions_ui_141163c57a.png" alt="github_actions_ui.png"></p><p><br></p><p>You wouldn’t want your secrets floating around openly in your code commits, so we made sure to integrate with&nbsp;<a href="https://docs.github.com/en/actions/security-guides/encrypted-secrets" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">the way GitHub stores secrets</a>&nbsp;as encrypted environment variables.</p><p>Needless to say, the GitHub Actions orchestrator is an exciting new addition to ZenML that will help you get going with your deployed pipelines even faster.&nbsp;<a href="https://zenml.io/slack-invite/" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">Let us know</a>&nbsp;if you are excited by this new integration!</p><p><br></p><h2>☁ Vertex AI Orchestrator: To Google and Beyond!</h2><h2><br></h2><p>We previously added a way to run individual steps on&nbsp;<a href="https://cloud.google.com/vertex-ai" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">Vertex AI</a>&nbsp;as step operators. One of our amazing community members,&nbsp;<a href="https://github.com/gabrielmbmb" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">Gabriel Martín Blázquez</a>, has&nbsp;<a href="https://github.com/zenml-io/zenml/pull/640" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">added a way</a>&nbsp;to orchestrate your entire pipelines using Vertex AI Pipelines.</p><p>The most exciting thing about this new orchestrator is that it came as a direct result of our documentation and extensibility improvements in&nbsp;<a href="https://blog.zenml.io/zero-eight-zero-release/" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">our last release</a>. We look forward to seeing what other integrations users add to their stacks…</p><p><br></p><h2>🍏 Fruits of the ZenHack Day: Slack Alerters and Azure Secrets Manager</h2><h2><br></h2><p><a href="https://youtu.be/8qb5IABTZ-s" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">Our community-focused ZenHack day</a>&nbsp;included several features that were implemented alongside one another. Among those was a&nbsp;<a href="https://www.atlassian.com/blog/software-teams/what-is-chatops-adoption-guide" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">ChatOps</a>-inspired Alerter component, with Slack as its first inbuilt implementation.</p><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/slack_alerter_9367d82b62.png" alt="slack-alerter.png"></p><p><br></p><p>You can now define interfaces where you can interact with and make decisions around how your steps get executed through Slack commands. Because seriously, who’d rather do this in the terminal when you can get a friendly Slack ping instead?</p><p>We also&nbsp;<a href="https://github.com/zenml-io/zenml/pull/654" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">implemented an Azure Secrets Manager</a>&nbsp;integration, completing our cloud secrets manager coverage. We’ve got a cloud-agnostic implementation of this in the works, but more about that next release!</p><p><br></p><h2>⌨️ CLI Improvements</h2><h2><br></h2><p>Barely a release passes without some user-facing CLI improvements, and this one is no exception. We added two small changes that just might bring a bit of UI 🌞 to your day:</p><ul><li>If you want to register a stack component but aren’t sure exactly which attributes to register for your particular component, we&nbsp;<a href="https://github.com/zenml-io/zenml/pull/695" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">added an interactive CLI flow</a>&nbsp;that guides you through everything you need to include.</li></ul><p><br></p><ul><li>We previously added the ability to update a pre-existing stack in place, but sometimes you want to duplicate a stack and make a slight modification to the one you already configured. In this release, we’ve given you that option with the easy&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">zenml stack copy</code>&nbsp;command.</li></ul><p><br></p><p><img src="https://zenml-strapi-media.s3.eu-central-1.amazonaws.com/interactive_9ab0f93c05.png" alt="interactive.png"></p><h2><br></h2><h2>📖 Documentation &amp; User Guides</h2><h2><br></h2><p>User-facing documentation is really important for us at ZenML, and we keep our main documentation page up-to-date. With the latest release, we’ve made sure we’re just as consistent with the internal code documentation in the form of docstrings. We’ve added CI checks using&nbsp;<code style="color: inherit; background-color: transparent;"><a href="http://www.pydocstyle.org/en/stable/" rel="noopener noreferrer">pydocstyle</a></code>&nbsp;and&nbsp;<code style="color: inherit; background-color: transparent;"><a href="https://github.com/terrencepreilly/darglint" rel="noopener noreferrer">darglint</a></code>&nbsp;that ensure that all our functions and modules include correct and consistently presented docstrings.</p><p>We switched out how we check for spelling errors, too, and we’re now using&nbsp;<code style="color: inherit; background-color: transparent;"><a href="https://facelessuser.github.io/pyspelling/" rel="noopener noreferrer">pyspelling</a></code>&nbsp;everywhere to make sure we stay typo-free!</p><p>This release includes several other smaller documentation fixes and additions.</p><p><br></p><h2>➕ Other Updates, Additions and Fixes</h2><h2><br></h2><p>The latest release include several smaller features and updates to existing functionality:</p><ul><li>Schedules can now be defined using ‘cron’ expressions</li><li>The detection of whether a step was cached or not is now done without querying the metadata store. This reduces the step execution by ~10secs.</li><li>We now allow for the passing of authentication credentials to all artifact stores and container registries as secrets</li><li>We made the dependencies that are part of the ZenServer optional. If you wish to install the ZenServer, be sure to use the following command:&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">pip install zenml[server]</code>.</li><li>We fixed some broken or deprecated CLI commands listed in our examples.</li><li>We made some internal changes to how code is organized within the core&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">src/zenml</code>&nbsp;directory, notably for the&nbsp;<code style="color: rgb(232, 62, 140); background-color: rgb(240, 240, 240);">utils</code>&nbsp;module and for all the cloud integrations.</li><li><br></li></ul><h2>🙌 Community Contributions</h2><h2><br></h2><p>We received several new community contributions during this release cycle. We mentioned Gabriel’s Vertex AI orchestrator above already, but we also saw the following contributions:</p><ul><li><a href="https://github.com/anencore94" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">@anencore94</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/644" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/644</a></li><li><a href="https://github.com/hectorLop" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">@hectorLop</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/648" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/648</a></li><li><a href="https://github.com/gabrielmbmb" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">@gabrielmbmb</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/640" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/640</a></li><li><a href="https://github.com/ketangangal" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">@ketangangal</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/628" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/628</a></li><li><a href="https://github.com/Reed-Schimmel" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">@Reed-Schimmel</a>&nbsp;made their first contribution in&nbsp;<a href="https://github.com/zenml-io/zenml/pull/684" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">https://github.com/zenml-io/zenml/pull/684</a></li></ul><p><br></p><h2>👩‍💻 Contribute to ZenML!</h2><h2><br></h2><p>Join our&nbsp;<a href="https://zenml.io/slack-invite/" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">Slack</a>&nbsp;to let us know if you have an idea for a feature or something you’d like to contribute to the framework.</p><p>We have a&nbsp;<a href="https://zenml.io/roadmap" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">new home for our roadmap</a>&nbsp;where you can vote on your favorite upcoming feature or propose new ideas for what the core team should work on. You can vote without needing to log in, so please do let us know what you want us to build!</p><p>[Photo by&nbsp;<a href="https://unsplash.com/@allisonh328" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">Allison Louise</a>&nbsp;on&nbsp;<a href="https://unsplash.com/photos/xABgmlX4ABE" rel="noopener noreferrer" style="background-color: transparent; color: rgb(43, 217, 120);">Unsplash</a>]</p>

ZenML boasts a ton of production-ready MLOps features that help go from experimentation to production with machine learning pipelines.

ZenML features

Write local, run anywhere

Extensibility

ZenML allows you to centralize configuration of all your MLOps infrastructure.

Centralized MLOps Stacks

Automated Metadata Tracking

ZenML allows you to continously train and deploy your ML models.

Continous Training and Deployment (CT/CD)

ZenML allows an entire team of machine learning practitioners to collaborate together seamlessly, from data scientists to ML engineers.

Collaboration

ZenML boasts a ton of production-ready MLOps features that help go from experimentation to production with machine learning pipelines. Write local, run anywhere. Extensibility. Centralized MLOps stacks. Automated metadata tracking. Collaboration. Continuous training and deployment.