Tech Talk Thursday
Talk Thursday: Power BI Dataset Refresh Part 1 – Trigger a Dataset from Power BI using REST API
Welcome to another two-part series for Tech Talk Thursday hosted by Ray Marquina, OmniData’s Principal Solutions Architect. In this series, we will be exploring how we can trigger a dataset refresh from Power BI within our Synapse Analytics pipeline using Power BI REST API. In this Part One video, we will be exploring the following:…
Read MoreTech Talk Thursday: Build a Synapse Pipeline Part 3: Full and Incremental Refresh / Building a Notebook
Welcome to Part Three of this three-part video series on creating a pipeline to handle both full and incremental refreshes in Azure Synapse presented by OmniData’s Principal Solutions Architect, Ray Marquina. In Part One, we created our control table using Delta Lake. In Part Two, we left off with building our initial pipeline and ended…
Read MoreTech Talk Thursday: Build a Synapse Pipeline Part 2: Expanding on Control Tables
Welcome to Part Two of this three-part video series on creating a pipeline to handle both full and incremental refreshes in Azure Synapse presented by OmniData’s Principal Solutions Architect, Ray Marquina. In Part One, we created our control table using Delta Lake. If you missed Part One, please check out that video because it is…
Read MoreTech Talk Thursday: Build a Synapse Pipeline Part 1: Handle Full and Incremental Refreshes Using Delta Lake Control Tables
What exactly is Delta Lake and how can you use it to build Azure Synapse Pipelines for full and incremental loads? Find out in Part One of a three-video series describing the step-by-step process. In today’s Tech Talk, OmniData’s Principal Solutions Architect, Ray Marquina, will discuss an architecture using Azure Data Lake as the storage…
Read MoreTech Talk Thursday: Explore the “If” Condition Within Azure Synapse Pipelines
Don’t miss this tutorial for beginners just learning about Azure Synapse Pipeline configurations and analytics. This tutorial builds on the concept of using Switch statements to do conditional evaluations in Synapse Pipelines. You can check out that short video in a previous Tech Talk Thursday. In this video, Ray Marquina, our Principal Solutions Architect, will…
Read MoreTech Talk Thursday: Dynamic Mapping Using a Copy Activity Within Azure Synapse Analytics
If you’ve ever encountered issues with corrupt file types, or encoded files that aren’t supported on the destination end of an Azure Synapse data pipeline, you won’t want to miss this video. In this latest Tech Talk Thursday video, Ray Marquina, one of OmniData’s top Azure Synapse pipeline gurus, walks you through the process. See…
Read MoreTech Talk Thursday: Configure API Pagination within Azure Synapse Pipeline
API pagination can be an exceptional data display and analytics tool. This is especially true in Azure Synapse pipelines. But using REST APIs can get a bit confusing and tricky sometimes. In this short video, we’ll explain and walk you through the process, screen-by-screen, using some simple but powerful tools and techniques. You’ll learn how…
Read MoreTech Talk Thursday: How to Create a Metadata Driven Pipeline using Azure Synapse Analytics
This Tech Tip from OmniData Principal Solutions Architect Ray Marquina is perfect for beginners as well as advanced data analytics professionals who want to understand large information processing pipelines in Azure Synapse. You’ll learn the essentials of creating a data pipeline and moving large amounts of information from the source database to the destination, such…
Read MoreTech Talk Thursday: How to Use Switch Activity Within Azure Synapse Analytics
Using Switch Activity in Azure Synapse Analytics, located in “Activities” under “Iterations and Conditionals,” will provide you with the same functionality as using a switch statement in most programming languages. Switch Activities, built in Synapse Studio, will evaluate a set of activities corresponding to a created “case” that matches the condition evaluation you defined in…
Read MoreTech Talk Thursday: How to Setup Notifications Within Synapse Pipelines With Logic App
Have you ever wished you could have been notified when you had an Azure Synapse Pipeline fail? If so, you don’t want to miss this Tech Tip from OmniData’s Principal Solutions Architect, Ray Marquina. Sure, you can always log into the Azure portal to check pipeline activity, but that’s a manual, time-consuming process. This tip…
Read More