Data Warehouse

  • Microsoft Fabric Mirroring: Quick Start Guide

    Mirroring provides a modern approach to accessing and ingesting data continuously and seamlessly from any database or data warehouse into the Data Warehousing experience within Microsoft Fabric. Here are the key points about Mirroring: Near Real-Time Data Access: Mirroring allows users to access changes in the source data almost instantly. It ensures that the data in Fabric’s OneLake remains up-to-date without complex setup or manual…

    » Read more
  • New Microsoft Fabric Features – A SQLBits and FabCon Round Up!

    March was a big month for Microsoft Fabric and its users as there were two major conferences discussing all aspects of Microsoft Fabric, from functionality to security and governance. SQLBits, a community conference, came first with a wealth of knowledge from experts using Microsoft Fabric from a beginner to experienced level. FabCon immediately followed, which was a conference from Microsoft to announce new features and to hear from those…

    » Read more
  • Connecting Your Fabric Data Warehouse to Spark Notebooks

    When using Spark notebooks in Fabric, it is very easy to connect directly to a Lakehouse. From here, you can see all of the data that is stored in tables and click and drop to insert code snippets to extract the data. Here at Purple Frog, it is common to have projects using Data Warehouses as their data store. When looking at ways to connect Notebooks to a warehouse, there is currently  little information available online; One way that is…

    » Read more
  • Fabric Data Warehouse – ALTER TABLE workaround

    You may be aware that the ALTER TABLE T-SQL command is currently not supported when working with data warehouses in Fabric. This isn’t much of a problem if the table you’re working with is empty, you can simply drop and recreate the table with the new structure. But if you do have data in a table and you want to make a change to the table, how can you do this without the ALTER TABLE command and without losing your data? My solution…

    » Read more
  • Microsoft Fabric: Should I Use a Data Warehouse or Lakehouse?

    Fabric is the newest data analytics platform from Microsoft. It brings together the entire analytics process onto the Power BI service, meaning that you no longer need to be moving your data around from different services. The introduction of OneLake means that all data that you import whether from Cloud servers, On-Premises servers or more is available in one central location. With Fabric, you need to choose how you will store the data that you…

    » Read more
  • Microsoft Fabric – So how do I build a Data Warehouse without Identity Columns and Merge?

    At the time of writing (29th June 2023) the following T-SQL commands are not supported in a Fabric Data Warehouse. Identity Columns Merge To see the full list of T-SQL limitations please refer to the documentation link below: https://learn.microsoft.com/en-us/fabric/data-warehouse/tsql-surface-area Here at Purple Frog, all of our Data Warehouses are knitted together using surrogate keys to link Dimension tables to Fact tables following the…

    » Read more