Posts Tagged ‘Synapse Pipeline’
Build a Synapse Pipeline Part 3: Full and Incremental Refresh / Building a Notebook
Welcome to Part Three of this three-part video series on creating a pipeline to handle both full and incremental refreshes in Azure Synapse presented by OmniData™’s Principal Solutions Architect, Ray Marquina. In Part One, we created our control table using Delta Lake. In Part Two, we left off with building our initial pipeline and ended…
Read MoreBuild a Synapse Pipeline Part 2: Expanding on Control Tables
Welcome to Part Two of this three-part video series on creating a pipeline to handle both full and incremental refreshes in Azure Synapse presented by OmniData™’s Principal Solutions Architect, Ray Marquina. In Part One, we created our control table using Delta Lake. If you missed Part One, please check out that video because it is…
Read MoreBuild a Synapse Pipeline Part 1: Handle Full and Incremental Refreshes Using Delta Lake Control Tables
What exactly is Delta Lake and how can you use it to build Azure Synapse Pipelines for full and incremental loads? Find out in Part One of a three-video series describing the step-by-step process. In today’s Tech Talk, OmniData™’s Principal Solutions Architect, Ray Marquina, will discuss an architecture using Azure Data Lake as the storage…
Read MoreExplore the “If” Condition Within Azure Synapse Pipelines
Don’t miss this tutorial for beginners just learning about Azure Synapse Pipeline configurations and analytics. This tutorial builds on the concept of using Switch statements to do conditional evaluations in Synapse Pipelines. You can check out that short video in a previous Tech Talk Thursday. In this video, Ray Marquina, our Principal Solutions Architect, will…
Read MoreHow to Configure API Pagination within Azure Synapse Pipeline
API pagination can be an exceptional data display and analytics tool. This is especially true in Azure Synapse pipelines. But using REST APIs can get a bit confusing and tricky sometimes. In this short video, we’ll explain and walk you through the process, screen-by-screen, using some simple but powerful tools and techniques. You’ll learn how…
Read More