Documentation
- - Knowledge base overview
Academy
Product Updates
Blogs

Home
Community
Welcome

Welcome

Everything you need to know about the DataOps.live community

9 Topics

Recently active

Most replies Most views Newest first

DataOps.liveCommunity Manager

published in Announcements

Upcoming DataOps.Live Orchestrators Powered by Ubuntu 24.04 LTS: What You Need to Know

We are excited to announce the release of our 5-latest orchestrators in October, powered by Ubuntu 24.04 LTS, and an extended testing period before the official 5-stable release in November. This update brings significant improvements, including enhanced security, support, and updated packages, to ensure your data pipelines remain efficient and future-proof.To provide customers with enough time to prepare and test their pipelines, we are delaying the release of these orchestrators to the 5-stable version by one month. During this time, you can test your pipelines against the 5-latest tag, giving you the opportunity to ensure compatibility with the new features before the stable release in November.Why Are We Upgrading to Ubuntu 24.04 LTS?The primary driver for this upgrade is the extended long-term support offered by Ubuntu 24.04 LTS, which provides security and maintenance updates until April 2029. By upgrading, we ensure that orchestrators remain secure, efficient, and compatible wit

250

18 days ago

DataOps.liveCommunity Manager

published in Announcements

Upcoming: DataOps.live Orchestrators Powered by Ubuntu 24.04 LTS

We’re excited to announce that, starting with the November release, all DataOps.Live orchestrators will be based on Ubuntu 24.04 LTS, an upgrade from the previous version, Ubuntu 20.04 LTS. This update reflects our commitment to providing the most secure, reliable, and feature-rich environment for your data operations.Why the Upgrade?The primary motivation for this upgrade is to ensure continued support and security for the operating system and the underlying packages. Canonical will end support for Ubuntu 20.04 LTS in April 2025, which would mean no further updates or security patches for the OS packages beyond that date. Moving to Ubuntu 24.04 LTS extends that support until at least April 2029, giving you peace of mind that your data operations are running on a system that will continue to receive critical updates.Key Benefits of the UpgradeUpgrading the operating system brings several significant benefits that will enhance the overall performance, functionality, and security of the

580

29 days ago

DataOps.liveCommunity Manager

published in Announcements

How DataOps.live is Supporting Snowflake’s Move to Service Users

As Snowflake shifts to stronger security by replacing passwords with Service Users and keypair authentication, DataOps.live is here to help make this transition as smooth as possible for our customers. Here's an update on where we’re at and what to expect.Key Updates1. Strengthening Orchestrator SecurityWe’re actively working on implementing keypair authentication for those orchestrators connecting to Snowflake that do not already support it. This will ensure that automated workflows are more secure by using Service User accounts instead of traditional passwords. The shift will enhance security and reliability in orchestrations, and while this is still in development, we’re moving steadily towards full integration to support smooth and secure operations.2. Service User Setup (Managed via SOLE)Right now, Service Users can be managed through SOLE, the DataOps.Live orchestrator for managing your Snowflake configuration. While the setup process is a bit more manual, it’s fully functional.

250

1 month ago

DataOps.liveCommunity Manager

published in Announcements

Enhancing SOLE Gen & SOLE Gen for Data Products: Opt-In Feature for Managing Procedure and Function Statements

As part of our ongoing improvements to SOLE Gen and SOLE Gen for Data Products, we’ve introduced an opt-in feature designed to give you more control over how procedure and function statements are stored. Previously, all statements were stored directly inside the YAML configuration, but now you have the flexibility to offload longer statements to external files based on your preferences. This keeps your YAML files clean and more manageable, especially for large projects.Why This Feature is ValuableThe new --inline-statement-limit feature gives you more control and flexibility over how procedure and function statements are stored. By setting a limit, you can keep your YAML files clean and manageable, with longer statements automatically offloaded to external files while shorter ones remain inline. This is especially useful for projects with a mix of short and long procedures.How to Opt - In Enable External File Storage: Use the -o option to enable external file storage. This ensures that

400

1 month ago

DataOps.liveCommunity Manager

published in Announcements

Observability Lab: A First Step Towards Gaining Insights From Your DataOps.live Pipelines

In today's fast-paced data environments, maintaining visibility and control over your DataOps.live pipelines is essential.We are excited to introduce the first phase of DataOps.live Pipeline Observability through a hands-on lab, providing early access to data that can be used to monitor your DataOps.live pipelines.While this feature provides valuable insights into query performance, resource usage, and the connection between Snowflake queries and DataOps.live projects, it's currently in a lab phase.This is just the beginning, and we look forward to expanding and refining these capabilities in future iterations, guided by your feedback.What Is DataOps.live Pipeline Observability Lab?Powered by the MATE dataops_snowflake_usage package, our solution is designed to provide you with a comprehensive overview of your DataOps pipelines. By leveraging Snowflake's query history and the built-in DataOps query tags, you gain unprecedented visibility into how your DataOps.live Operate pipelines eng

1010

1 month ago

drew.kreigerCommunity Manager

posted in Announcements

NEW! 🚨 Spendview for Snowflake

Change the way your business makes decisions around data with a unified and harmonizedview of your Snowflake spend - It's FREE! Spendview for Snowflake is a free module from DataOps.live observability, a core component of our platform.Spendview for Snowflake collects and aggregates all operational metadata about your Snowflake production and consumption to help you visualize and understand your accounts' potential spend drivers.To see all aspects of Spendview for Snowflake and what insights you can get using it, check out the below topics:Setup Overall Cost Summary Compute Activity and Cost Summary Storage Cost Summary Usage Cost Summary Account Management Data Security and Snowflake Privileges Sign up today

1134

1 year ago

drew.kreigerCommunity Manager

posted in Getting started in the community

Welcome to the DataOps Community! Earn your Early Adopter badge before Aug 1st!

Welcome! We are excited to announce the launch of our NEW community platform! This platform is designed with customers, partners, and DataOps professionals in mind. This is the place to: Share your expertise and ask questions Access a wealth of knowledge base articles to gain a deeper understanding of the DataOps.live platform Access our training and doc materials free of charge. Interact with other customers and get support from the DataOps.live team, who will be actively participating in the forum. Sign up and add your avatar to our new community platform by Aug 1st to earn an “Early Adopter Badge” DataOps.live Community Early Adopter Badge Make sure to add your avatar! Could be a favorite character, your pet, of your self. Sign up today If you have any questions, you can contact me anytime at drew.kreiger@dataops.live. Welcome again, see you around in the community!

420

1 year ago

drew.kreigerCommunity Manager

posted in Getting started in the community

DataOps.Live community code of conduct

A guide of who we are as a company, our values, and our community guidelines, privacy policy, and terms of service. Our goal is to create a #TrueDataOps community of like-minded professionals to collaborate, share, and increase their knowledge. Guidelines Do’s: Help your fellow community members Share helpful content Network and connect to build each other's knowledge Become a leader in the community forum by helping others Challenge and push others with sharing your learnings Be cool, be kind Don’ts: Share personal information or others personal information Attack/call out others Degrade other members based on their knowledge level Promote a personal brand or company Be rude Guidelines Long Overview The DataOps.live Community is dedicated to providing a harassment-free, equitable and inclusive community experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, age,

390

1 year ago

drew.kreigerCommunity Manager

posted in Getting started in the community

New member? Everything to get you started.

New to the DataOps.live Community? Welcome! What is the DataOps Community?Our goal is to create a #TrueDataOps community of like-minded professionals to collaborate, share, and increase their knowledge. Take a tour of the general welcome community posts.-Please head over to our community guidelines page to learn:Who we are a company and a community team Unacceptable Behavior/ Guidelines (Do’s and Dont’s) Code Of Conduct Communication Guidelines Reporting Harassment or Other Issues Developer HubA one stop for all things, Docs. academy, and our Resource library DataOps.live SupportDataOps.live provides support during regular business hours from Monday to Friday.Get support - to create your support tickets or track their progress, go to our Support Portal. DataOps.live Starter’s GuideA detailed resource cover what is DataOps, setup, and creating your first project. DataOps.live AcademyHead over to the new DataOps.live Academy to take our Intro to DataOps.live course

2230

1 year ago

Badge winners

Traycho Milevhas earned the badge DataOps.live Foundations
NickHalseyhas earned the badge Early Adopter
allanthuesenhas earned the badge Early Adopter
Patrick_at_snowflakehas earned the badge Early Adopter
Rohanhas earned the badge Early Adopter

Show all badges

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

Username *

E-mail address *

First name *

Last name *

Job Title *

Executive Product Owner Engineer Developer Other

Company *

Country *

Zip Code *

I agree to receive marketing communications *

Yes - I consent to marketing (opt out anytime by clicking unsubscribe in email) No - I do not consent to marketing

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.