Fabric

Fabric

  • Connecting Your Fabric Data Warehouse to Spark Notebooks

    When using Spark notebooks in Fabric, it is very easy to connect directly to a Lakehouse. From here, you can see all of the data that is stored in tables and click and drop to insert code snippets to extract the data. Here at Purple Frog, it is common to have projects using Data Warehouses as their data store. When looking at ways to connect Notebooks to a warehouse, there is currently  little information available online; One way that is…

    » Read more
  • Upload files to a LakeHouse in OneLake using Powershell

    In this blog post, I will be sharing a PowerShell script that uploads files to a OneLake Lakehouse. This is the script: The script is downloadable at the bottom of the page as a txt file. To use the script there are few steps: Install the Powershell module Az.Storage. This code exists in the script and just needs to be uncommented for the first run, if the module is not already installed. Fill in the variables at the top of the script: tenantID…

    » Read more
  • Microsoft Fabric enters General Availability!

    Microsoft Fabric enters General Availability!

    After 6 months of public preview, Microsoft Fabric is now in production and generally available! 🎉 The announcement was made today at Microsoft Ignite, in Seattle. A round up of the news can be found at https://news.microsoft.com/ignite-2023-book-of-news/.   Here is a summary of some of the Fabric changes that we are looking forward to: Mirroring in Fabric Announced – expected in Q4 2023 Mirroring is a real-time clone of an Azure…

    » Read more
  • Fabric Data Warehouse – ALTER TABLE workaround

    You may be aware that the ALTER TABLE T-SQL command is currently not supported when working with data warehouses in Fabric. This isn’t much of a problem if the table you’re working with is empty, you can simply drop and recreate the table with the new structure. But if you do have data in a table and you want to make a change to the table, how can you do this without the ALTER TABLE command and without losing your data? My solution…

    » Read more
  • Microsoft Fabric: Should I Use a Data Warehouse or Lakehouse?

    Fabric is the newest data analytics platform from Microsoft. It brings together the entire analytics process onto the Power BI service, meaning that you no longer need to be moving your data around from different services. The introduction of OneLake means that all data that you import whether from Cloud servers, On-Premises servers or more is available in one central location. With Fabric, you need to choose how you will store the data that you…

    » Read more
  • Microsoft Fabric – So how do I build a Data Warehouse without Identity Columns and Merge?

    At the time of writing (29th June 2023) the following T-SQL commands are not supported in a Fabric Data Warehouse. Identity Columns Merge To see the full list of T-SQL limitations please refer to the documentation link below: https://learn.microsoft.com/en-us/fabric/data-warehouse/tsql-surface-area Here at Purple Frog, all of our Data Warehouses are knitted together using surrogate keys to link Dimension tables to Fact tables following the…

    » Read more
  • What is Microsoft Fabric? (Power BI + Synapse + DW + DataLake + ML)

    What Is Microsoft Fabric

    At today’s Build conference, Microsoft announced Fabric. What is this? In simple terms, think of taking Synapse Analytics, Data Warehousing, Data Lakes, Data Factory, Spark Notebooks and Machine Learning, and bring them all together into Power BI. This is underpinned by Microsoft OneLake, a high performance scalable data lake storage layer, supporting all of the above. OneLake is, as the name implies, one data lake that can be used across…

    » Read more