We’re excited to announce that, starting with the November release, all DataOps.Live orchestrators will be based on Ubuntu 24.04 LTS, an upgrade from the previous version, Ubuntu 20.04 LTS. This update reflects our commitment to providing the most secure, reliable, and feature-rich environment for your data operations.Why the Upgrade?The primary motivation for this upgrade is to ensure continued support and security for the operating system and the underlying packages. Canonical will end support for Ubuntu 20.04 LTS in April 2025, which would mean no further updates or security patches for the OS packages beyond that date. Moving to Ubuntu 24.04 LTS extends that support until at least April 2029, giving you peace of mind that your data operations are running on a system that will continue to receive critical updates.Key Benefits of the UpgradeUpgrading the operating system brings several significant benefits that will enhance the overall performance, functionality, and security of the
As Snowflake shifts to stronger security by replacing passwords with Service Users and keypair authentication, DataOps.live is here to help make this transition as smooth as possible for our customers. Here's an update on where we’re at and what to expect.Key Updates1. Strengthening Orchestrator SecurityWe’re actively working on implementing keypair authentication for those orchestrators connecting to Snowflake that do not already support it. This will ensure that automated workflows are more secure by using Service User accounts instead of traditional passwords. The shift will enhance security and reliability in orchestrations, and while this is still in development, we’re moving steadily towards full integration to support smooth and secure operations.2. Service User Setup (Managed via SOLE)Right now, Service Users can be managed through SOLE, the DataOps.Live orchestrator for managing your Snowflake configuration. While the setup process is a bit more manual, it’s fully functional.
As part of our ongoing improvements to SOLE Gen and SOLE Gen for Data Products, we’ve introduced an opt-in feature designed to give you more control over how procedure and function statements are stored. Previously, all statements were stored directly inside the YAML configuration, but now you have the flexibility to offload longer statements to external files based on your preferences. This keeps your YAML files clean and more manageable, especially for large projects.Why This Feature is ValuableThe new --inline-statement-limit feature gives you more control and flexibility over how procedure and function statements are stored. By setting a limit, you can keep your YAML files clean and manageable, with longer statements automatically offloaded to external files while shorter ones remain inline. This is especially useful for projects with a mix of short and long procedures.How to Opt - In Enable External File Storage: Use the -o option to enable external file storage. This ensures that
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.