What an exciting month of announcements. Snowflake Summit in San Francisco ended recently. And, of course, we are making many of the announcements immediately available to you. Enjoy.

DataOps.live named Snowflake AI Data Cloud Product Growth Partner of the Year

DataOps.live was recognized by Snowflake for helping joint customers to automate, orchestrate, observe and deploy data products on the Snowflake AI Data Cloud to supercharge their data engineering team productivity by 10X while achieving up to a 60% reduction in cost. 

Learn more...

Snowflake Summit 24 for DataOps users

Many exciting announcements were made at the Snowflake Summit in June 2024. Let's group them into five primary areas: enterprise AI, enterprise ML, native apps, catalog and data lake, and data governance. Many are now generally available or in public preview – ready for you to use during your data operations projects.

Let’s start with enterprise AI. Centered around Snowflake Cortex, they enable you to use generative AI with large language models. Fully hosted in Snowflake, your valuable data never leaves Snowflake. Whether you want to build a chat application with the SQL COMPLETE function, create a fine-tuned model to reduce cost and improve model quality, or summarize and describe unstructured data – you can use them in DataOps immediately. Leverage them when you use MATE to build your tables or call them in Streamlit from Python as a UDF.

Let’s continue with enterprise ML. Snowflake offers forecasting and anomaly detection in time series data in their set of ML functions. Leverage them in your standard SQL as alternative ways to create insights from your harmonized data. New with Summit is the Snowpark pandas API. Allowing you to run your existing pandas with only a few changes, you can now make use of them with the Snowpark orchestrator and run them natively in a DataOps pipeline.

Extremely exciting for all builders of Snowflake Native Apps was the announcement that they are now fully integrated with Snowpark Container Service. If you want to learn more about how you build your own, we invite you to watch our recent webinar again.

 Building a Cortex-Powered Snowflake Native App in 10 Minutes 
(47min)

️ By Engineers for Engineers - DataOps How-to videos

In this month’s video, let's review our best practices of configuring your DataOps Runner effectively for running reliable and efficient data pipelines.

We have written a couple of articles on this topic which you can find on our community portal:

• Why are my DataOps.live pipelines running slowly? 
• Troubleshooting and Preventive Measures for DataOps Runner Errors 
• More community articles with the 1Runner] tag

DataOps.live Assist is accessible to all!

Our copilot has matured and now supports a wide variety of use cases. To celebrate this, we are now making Assist available to all users by default. 

Enjoy summaries and descriptions of your merge requests and accelerate your development tasks in Develop. Have it generate documentation, dbt SQL models, Snowpark Python code, or even a Streamlit application.

If you're not quite ready for this feature yet, contact our support team to opt-out.

ICYMI - Frank Bell - #TrueDataOps Podcast Ep 36

Frank Bell, a Snowflake Data Superhero and Evangelist, talks about his journey from the Air Force to becoming a top Snowflake partner, sharing lessons from his extensive experience in data operations and his take on Snowflake’s transformative impact on the industry. 

Frank and host Kent Graziano discuss: 

• The critical role of DataOps in managing the rapid pace of innovation, especially with the rise of AI and machine learning. 
• The concept of data products and DataOps impact on delivering reliable, scalable solutions 
• The need for automated monitoring and testing to maintain data quality 
• And more! 

 Watch Episode 36 here 

 Listen to Episode 36 here 

Snowflake Lifecycle Engine for data products is generally available

Starting with the May 2024 monthly release, we are proud to make SOLE for data products generally available.

To start, decide on the granularity of grouping for each Snowflake object. You can group objects per schema, group objects based on business logic, or keep it simple and put each object into a single file.

Once you defined how you want to manage the granularity of your object: 

1. Introduce a SOLE project file dataops_config.yml 

2. Split your large database.template.yml into smaller files

Learn more...

It's that time of year!

The Summer 24 Product Launch webinar is coming up soon. We'll share all the new features and show you how to use DataOps.live Assist to create a Streamlit application. Click the button below to learn more and save your spot.

That’s all for now and until next time.

- the DataOps.live Product Team