Azure SSIS – How to Setup, Deploy, Execute & Schedule Packages
January 8th, 2018 in ADFv2, Azure, Blog, PowerShellWelcome back to work in 2018! 🙂 Let’s get stuck in with a hot topic. How do we actually use our beloved SQL Server Integration Services (SSIS) packages in Azure with all this new platform as a service (PaaS) stuff? Well, in this post I’m going to go through it end to end. Post Contents Azure Services Setup Azure Data Factory v2 Azure SQL Instance Azure SSIS IR Creating & Deploying the SSIS Package SSIS Azure Feature Pack…
» Read moreBusiness Intelligence in Azure – SQLBits 2018 Precon
November 17th, 2017 in Azure, Blog, CommunityWhat can you expect from my SQLBits pre conference training day in February 2018 at the London Olympia? Well my friends, in short, we are going to take whirlwind tour of the entire business intelligence stack of services in Azure. No stone will be left unturned. No service will be left without scalability. We’ll cover them all and we certainly aren’t going to check with the Azure bill payer before turning up the compute on our data…
» Read moreRDP to Azure Batch Service Compute Nodes
November 6th, 2017 in Azure, BlogDid you know it’s now possible to RDP to your Azure Batch Service compute nodes? I’ve used the batch service to handle the compute for my Azure Data Factory custom activities for a while now. Which I’ve basically been doing blindly because the code execution and logging is provided to ADF, with no visibility to the underlying pool of VM’s doing the work. Well, no more is this the case! In the Azure portal go to your Batch…
» Read moreAzure Data Lake – The Services. The U-SQL. The C# (Reference Guide)
October 13th, 2017 in Azure, Blog, Community, Reference GuideThis post is a reference guide to support an event talk or webinar. The content is intended to assist the audience only. Thank you. Abstract How do we implement Azure Data Lake? How does a lake fit into our data platform architecture? Is Data Lake going to run in isolation or be part of a larger pipeline? How do we use and work with USQL? Does size matter?! The answers to all these questions and more in this session as we immerse ourselves in…
» Read moreWhat’s New in Azure Data Factory Version 2 (ADFv2)
September 24th, 2017 in ADFv2, Azure, Blog, C#, JSON, PowerShellI’m sure for most cloud data wranglers the release of Azure Data Factory Version 2 has been long overdue. Well good news friends. It’s here! So, what new features does the service now offer for handling our Azure data solutions?… In short, loads! In this post, I’ll try and give you an overview of what’s new and what to expect from ADFv2. However, I’m sure more questions than answers will be raised here. As developers we…
» Read moreCommunity Speaking Analysis with Power BI
September 12th, 2017 in Blog, Community, Just For Fun, PowerBIJust a short post. During the SQL Saturday Cambridge speaker meal on Saturday night I was chatting with various people at the dinner table. During this time I got asked the question by an event sponsor “do you speak at many of these things?”. While the general answer I gave at the time was yes. It occurred to me that I didn’t have any accurate means of answering the question with some richer detail. Being a data/business…
» Read moreChaining Azure Data Factory Activities and Datasets
August 23rd, 2017 in Azure, Blog, JSONAs I work with Azure Data Factory (ADF) and help others in the community more and more I encounter some confusion that seems to exist surrounding how to construct a complete dependency driven ADF solution. One that chains multiple executions and handles all of your requirements. In this post I hope to address some of that confusion and will allude to some emerging best practices for Azure Data Factory usage. First a few simple questions: Why is…
» Read moreAzure Business Intelligence – The Icon Game!
July 11th, 2017 in Azure, Blog, Community, Just For FunAs Azure becomes the new normal for many organisations our architecture diagrams become ever more complicated. Articulating our designs/data flows to management or technical audiences therefore requires a new group of cloud service icons in our pretty pictures. Especially for hybrid solutions. Sadly those icons aren’t yet that familiar for most. So, here’s a very simple blog post to help you recognise what’s in the Azure stack from a…
» Read moreConnecting PowerBI.com to Azure Data Lake Store – Across Tenants
June 29th, 2017 in Azure, Blog, PowerBIWelcome readers, this is a post to define a problem that shouldn’t exist. But sadly, does exist and given its relative complexity I think warrants some explanation. Plus, I’ve included details of what you can currently do if you encounter it. First some background… Power BI Desktop With the recent update to the Power BI desktop application we now find the Azure Data Lake Store connector has finally relinquished its ‘(Beta)’ status and…
» Read moreMy Advice for Speaking in the Community
June 15th, 2017 in Blog, CommunityI wanted to do something a little different with this blog post. I’ve certainly not ran out of technical content to blog about. But I wanted to write something to help all those new speakers out there that are about to stand up at the front of an event and share there knowledge, maybe for the first time, or maybe a veteran speaker that wants to see if they agree with my advice. The former is basically where I found myself about 18 months…
» Read more
Call today 0845 643 6463
