Tag Archive: Fabric

  • Fabric Trials: The Countdown Is On

    We are drawing near to the end of Microsoft Fabric trials! ⌛ With the countdown ending mid-June for many trial capacities, it is important that you take measures to protect any Microsoft Fabric resources you have. Microsoft have informed users that once the trial ends, the capacity will be converted to a Power BI Premium capacity where Fabric items can no longer be used or stored. From here, you will have a 7 day retention period before all…

    » Read more
  • How to call Microsoft Fabric Data Pipelines dynamically using APIs

    The Microsoft Fabric REST APIs allow you to automate Fabric procedures and processes. In this blog post, we’ll focus on a specific API: “Run On Demand Item Job” To dynamically call another data pipeline, we’ll utilise this API within a data pipeline web activity. By passing in the itemId of the data pipeline we want to invoke, we can trigger its execution. You can learn more here:…

    » Read more
  • Microsoft Fabric Mirroring: Quick Start Guide

    Mirroring provides a modern approach to accessing and ingesting data continuously and seamlessly from any database or data warehouse into the Data Warehousing experience within Microsoft Fabric. Here are the key points about Mirroring: Near Real-Time Data Access: Mirroring allows users to access changes in the source data almost instantly. It ensures that the data in Fabric’s OneLake remains up-to-date without complex setup or manual…

    » Read more
  • New Microsoft Fabric Features – A SQLBits and FabCon Round Up!

    March was a big month for Microsoft Fabric and its users as there were two major conferences discussing all aspects of Microsoft Fabric, from functionality to security and governance. SQLBits, a community conference, came first with a wealth of knowledge from experts using Microsoft Fabric from a beginner to experienced level. FabCon immediately followed, which was a conference from Microsoft to announce new features and to hear from those…

    » Read more
  • Connecting Your Fabric Data Warehouse to Spark Notebooks

    When using Spark notebooks in Fabric, it is very easy to connect directly to a Lakehouse. From here, you can see all of the data that is stored in tables and click and drop to insert code snippets to extract the data. Here at Purple Frog, it is common to have projects using Data Warehouses as their data store. When looking at ways to connect Notebooks to a warehouse, there is currently  little information available online; One way that is…

    » Read more
  • Upload files to a LakeHouse in OneLake using Powershell

    In this blog post, I will be sharing a PowerShell script that uploads files to a OneLake Lakehouse. This is the script: The script is downloadable at the bottom of the page as a txt file. To use the script there are few steps: Install the Powershell module Az.Storage. This code exists in the script and just needs to be uncommented for the first run, if the module is not already installed. Fill in the variables at the top of the script: tenantID…

    » Read more
  • Microsoft Fabric – So how do I build a Data Warehouse without Identity Columns and Merge?

    At the time of writing (29th June 2023) the following T-SQL commands are not supported in a Fabric Data Warehouse. Identity Columns Merge To see the full list of T-SQL limitations please refer to the documentation link below: https://learn.microsoft.com/en-us/fabric/data-warehouse/tsql-surface-area Here at Purple Frog, all of our Data Warehouses are knitted together using surrogate keys to link Dimension tables to Fact tables following the…

    » Read more
  • What is Microsoft Fabric? (Power BI + Synapse + DW + DataLake + ML)

    What Is Microsoft Fabric

    At today’s Build conference, Microsoft announced Fabric. What is this? In simple terms, think of taking Synapse Analytics, Data Warehousing, Data Lakes, Data Factory, Spark Notebooks and Machine Learning, and bring them all together into Power BI. This is underpinned by Microsoft OneLake, a high performance scalable data lake storage layer, supporting all of the above. OneLake is, as the name implies, one data lake that can be used across…

    » Read more