Community

Recently active
Help others
Categories

Troubleshooting Git Error in Develop: Missing “read_repository” Permission

Issue When opening a project in the DataOps.live platform and trying certain Git operations in Dataops.live Develop, users meet an error message saying that an operation needs the additional permission “read_repository”. Cause This error occurs when the user's Git account lacks the necessary permission to read the repository. Resolution steps To resolve this issue: Access your user settings within Develop by visiting the URL User Settings (dataops.live) and verify your permissions. Click the ellipses (...) and select Edit Permissions to open a new dialog box. Select the read_repository checkbox and click Update Permissions. This adds the new permission to your permission list.

170

10 days ago

DataOps.liveCommunity Manager

Guides

Troubleshooting Git Commit Issue in DataOps.live Develop

Issue When trying to commit updates within a DataOps project in DataOps.live Develop and then pushing them to the Git repository, users sometimes face issues with the Commit button in DataOps.live Develop, a VS Code version perfect for Data Operations. Cause Issues with VS Code settings or extensions may interfere with the staging and committing process. Resolution steps You can troubleshoot and resolve this issue by taking one of the following steps:1. Stage your changes Stage changes to permanently save them in the repository and prepare the files to be included in the next commit. To do this:a. In the VS Code sidebar, point to the file you want to commit and click the “+” button to stage it. This enables the Commit button. b. Proceed with the commit.2. Smart commit Check if the Smart Commit feature is enabled. To do this: a. From the menu in the VS Code sidebar, go to File → Preferences → Settings. b. In the settings search field, search for `git.suggestSmartCommit`

280

10 days ago

RaymonGompelmanEmployee

Videos

DataOps.live Assist Chat walkthrough

DataOps.live Assist Chat walkthrough DataOps.live Assist is an AI-powered copilot that improves your user experience on the data product platform. It enhances the workflow for every team member, regardless of their role. Use it to massively increase each team member's productivity and do more with the same. This video will demonstrate how using DataOps.live Assist Chat can help you build, test and release much quicker than ever before.

240

14 days ago

RaymonGompelmanEmployee

Videos

The 7 pillars of TrueDataOps: Continuous integration/continuous delivery (CI/CD)

The 7 pillars of TrueDataOps: Continuous integration/continuous delivery (CI/CD) One of the hallmarks of DevOps is the continuous integration (CI) and continuous delivery (CD) cycle from a code repository. A DataOps repository allows configuration and code to be stored, tested, promoted, released, and rolled back and each time there is a change to deploy this change to a target environment. To learn more about what DataOps is, visit this page. To read our book about Dataops and the 7 pillars of TrueDataOps, visit this page. This video will demonstrate how this works using the DataOps.live platform:

110

14 days ago

RaymonGompelmanEmployee

Videos

mganchevCommunity Manager

#TrueDataOps Discussions

How to pass Snowflake credentials to DevReady environment?

Hey @DataOps.live ,I am curious to know more about how I can “connect” or pass my snowflake credentials to the DevReady environment and in particular a streamlit app that I am using. Would you kindly share more? Thanks

23 days ago

CharlieDataOpsCommunity Manager

Guides

How to speed up pipelines that define many artifacts

Artifacts are a great way to share files and/or directories that are generated during job execution with other jobs in your pipeline. However, as the number of jobs in you pipeline grows and the usage of artifacts increases, you may see the time it takes for your jobs to complete go up significantly, and often unnecessarily.A key points to consider is that by default each job will pull all artifacts from previous jobs. This can slow down your pipeline unnecessarily if you have jobs that don’t need all or any artifacts. Jobs that don’t need any artifacts:For any jobs that don’t use previous job artifacts, you can specify an empty array [] for the dependencies config. This will mean the job doesn’t download any artifacts potentially speeding up your overall pipeline considerably. E.g.My Build Job: stage: build script: - /dataops dependencies: []Warning! For the majority of jobs running in a DataOps.live pipeline you will need to specify the "Initialise Reference Project" job as a d

330

1 month ago

Traycho MilevSenior DataOps Engineer

Guides

Prefill DataOps CI/CD Pipeline-Level Variables for Enhanced Workflow Control

DataOps CI/CD pipelines are powerful tools for automating software development workflows. Within these pipelines, variables play a crucial role in providing flexibility and customisation. In this article, we'll explore how to utilise pipeline-level variables in DataOps CI/CD to enhance manual pipeline runs, focusing on both simple pre-filled variables and more complex selectable options.Pipeline-Level Variables:DataOps allows the definition of variables at both the job and pipeline levels. While job-level variables cannot be pre-filled for manual runs, pipeline-level variables offer this functionality. These variables are defined in the full-ci.yml file and can be pre-filled with default values and descriptions.Simple Pre-Filled Variables: To pre-fill a variable for manual pipeline runs, simply define it within the variables section of your CI/CD configuration file, along with a description and, optionally, a default value. For example:variables: PLATFORM_CREDENTIALS: description:

490

1 month ago

mohammadnaghibiNew Participant

#TrueDataOps Discussions

best practice for architecture data pipeline with open source tools on premise

Hello everyoneI`m junior in data engineering and want implement data pipeline for company that I working in that I have 3 questions:1- What is the best practice for the architecture of implementing data lake and data warehouse?2- What open source tools are available for this?3- My data sources are postgresql and mongodb, what open source tools can I use to implement ETL and data ware house?

2 months ago

SushilParticipating Frequently

Have an academy question?

pipeline not running

Hi Team,I am doing Fundamentals of DataOps.live training and as part of this did setup for mentioned runner in this course.However when I am running pipeline its giving below message-Please help to resolve this issue to proceed further with this course config updated as belowmessage getting when trying to run pipeline

3 months ago

Welcome

Everything you need to know about the DataOps.live community

Getting started in the community

3 topics
0 Replies

Announcements

1 topic
4 Replies

DataOps.live Products

Looking for answers? You're in the right place. Post your question about any product here.

Have a question?

5 topics
9 Replies

DataOps.live Academy Courses

Do you need help with you DataOps.live course or certification? This is the place! Ask questions, get help.

Have an academy question?

1 topic
19 Replies

#TrueDataOps Community

Join us to discuss all things DataOps. #TrueDataOps

The DataOps Library

4 topics
1 Reply

#TrueDataOps Discussions

2 topics
7 Replies

User leaderboard

Badges

Traycho Milevhas earned the badge DataOps.live Foundations
NickHalseyhas earned the badge Early Adopter
allanthuesenhas earned the badge Early Adopter
Patrick_at_snowflakehas earned the badge Early Adopter
Rohanhas earned the badge Early Adopter

Show all badges

Explore the community

Join conversations, learn and grow with people who get community like you

Troubleshooting Git Error in Develop: Missing “read_repository” Permission

Troubleshooting Git Commit Issue in DataOps.live Develop

DataOps.live Assist Chat walkthrough

The 7 pillars of TrueDataOps: Continuous integration/continuous delivery (CI/CD)

The 7 pillars of TrueDataOps: Code Design & Maintainability

DataOps.live Develop walkthroughDataOps.live Develop demo

DataOps.live Develop to become the default choice

How to pass Snowflake credentials to DevReady environment?

How to speed up pipelines that define many artifacts

Prefill DataOps CI/CD Pipeline-Level Variables for Enhanced Workflow Control

best practice for architecture data pipeline with open source tools on premise

pipeline not running

Welcome

Getting started in the community

Announcements

DataOps.live Products

Have a question?

DataOps.live Academy Courses

Have an academy question?

#TrueDataOps Community

The DataOps Library

#TrueDataOps Discussions

User leaderboard

Badges

Community

Explore the community

Join conversations, learn and grow with people who get community like you

DataOps.live Develop walkthroughDataOps.live Develop demo

User leaderboard

Badges

Sign up

Login to the community

Scanning file for viruses.

This file cannot be downloaded