Training

Welcome to Part Three of this three-part video series on creating a pipeline to handle both full and incremental refreshes in Azure Synapse presented by OmniData’s Principal Solutions Architect, Ray Marquina. In Part One, we created our control table using Delta Lake.  In Part Two, we left off with building our initial pipeline and ended…

Welcome to Part Two of this three-part video series on creating a pipeline to handle both full and incremental refreshes in Azure Synapse presented by OmniData’s Principal Solutions Architect, Ray Marquina. In Part One, we created our control table using Delta Lake. If you missed Part One, please check out that video because it is…

Don’t miss this tutorial for beginners just learning about Azure Synapse Pipeline configurations and analytics. This tutorial builds on the concept of using Switch statements to do conditional evaluations in Synapse Pipelines. You can check out that short video in a previous Tech Talk Thursday. In this video, Ray Marquina, our Principal Solutions Architect, will…

If you’ve ever encountered issues with corrupt file types, or encoded files that aren’t supported on the destination end of an Azure Synapse data pipeline, you won’t want to miss this video. In this latest Tech Talk Thursday video, Ray Marquina, one of OmniData’s top Azure Synapse pipeline gurus, walks you through the process. See…

API pagination can be an exceptional data display and analytics tool. This is especially true in Azure Synapse pipelines. But using REST APIs can get a bit confusing and tricky sometimes. In this short video, we’ll explain and walk you through the process, screen-by-screen, using some simple but powerful tools and techniques. You’ll learn how…

This Tech Tip from OmniData Principal Solutions Architect Ray Marquina is perfect for beginners as well as advanced data analytics professionals who want to understand large information processing pipelines in Azure Synapse. You’ll learn the essentials of creating a data pipeline and moving large amounts of information from the source database to the destination, such…

Using Switch Activity in Azure Synapse Analytics, located in “Activities” under “Iterations and Conditionals,” will provide you with the same functionality as using a switch statement in most programming languages.  Switch Activities, built in Synapse Studio, will evaluate a set of activities corresponding to a created “case” that matches the condition evaluation you defined in…

Have you ever wished you could have been notified when you had an Azure Synapse Pipeline fail? If so, you don’t want to miss this Tech Tip from OmniData’s Principal Solutions Architect, Ray Marquina.  Sure, you can always log into the Azure portal to check pipeline activity, but that’s a manual, time-consuming process. This tip…