Call today 0845 643 6463

C#

  • What’s New in Azure Data Factory Version 2 (ADFv2)

    September 24th, 2017 in ADFv2, Azure, Blog, C#, JSON, PowerShell

    I’m sure for most cloud data wranglers the release of Azure Data Factory Version 2 has been long overdue. Well good news friends. It’s here! So, what new features does the service now offer for handling our Azure data solutions?… In short, loads! In this post, I’ll try and give you an overview of what’s new and what to expect from ADFv2. However, I’m sure more questions than answers will be raised here. As developers we…

    » Read more

  • Calling U-SQL Stored Procedures with C# Code Behind

    April 22nd, 2017 in Azure, Blog, C#, U-SQL, Visual Studio

    So friends, some more lessons learnt when developing with U-SQL and Azure Data Lake. I’ll try and keep this short. Problem You have a U-SQL stored procedure written and working fine within your Azure Data Lake Analytics service. But we need to add some more business logic or something requiring a little C# magic. This is the main thing I love about U-SQL, having that C# code behind file where I can extend my normal SQL behaviour. So,…

    » Read more

  • Writing a U-SQL Merge Statement

    December 13th, 2016 in Azure, Blog, C#, U-SQL, Visual Studio

    Unlike T-SQL, U-SQL does not currently support MERGE statements. Our friend that we have come to know and love since its introduction in SQL Server 2008. Not only that, but U-SQL also doesn’t currently support UPDATE statements either… I know… Open mouth emoji required! This immediately leads to the problem of change detection in our data and how, for example, we should handle the ingestion of a daily rolling 28-day TSV extract,…

    » Read more

  • Azure Data Lake Authentication from Azure Data Factory

    December 2nd, 2016 in Azure, Blog, C#, PowerShell, Visual Studio

    rereTo set the scene for the title of this blog post lets firstly think about other services within Azure. You’ll probably already know that most services deployed require authentication via some form of connection string and generated key. These keys can be granted various levels of access and also recycled as required, for example an IoT Event Hub seen below (my favourite service to play with). Then we have other services like SQLDB that…

    » Read more

  • Creating Azure Data Factory Custom Activities

    November 4th, 2016 in Azure, Blog, C#, JSON, Visual Studio

    When creating an Azure Data Factory (ADF) solution you’ll quickly find that currently it’s connectors are pretty limited to just other Azure services and the T within ETL (Extract, Transform, Load) is completely missing altogether. In these situations where other functionality is required we need to rely on the extensibility of Custom Activities. A Custom Activity allows the use of .Net programming within your ADF pipeline.…

    » Read more

  • Windows IoT UWP Tasks Tickers and Threading

    July 22nd, 2016 in Azure, Blog, C#, IoT, JSON, UWP, Windows

    Upon entering the IoT revolution a few things immediately became apparent; We now had the ability to collect and handle more sensor data than we’d ever before possibly conceived. These sensors and there data will/are going to change the very way we live… Not convinced by this one? Talk to anybody that has a Fitbit attached to their wrist about how many steps they do each day! More relevant to this article. The procedural tools we…

    » Read more