RDP to Azure Batch Service Compute Nodes

Did you know it’s now possible to RDP to your Azure Batch Service compute nodes?

I’ve used the batch service to handle the compute for my Azure Data Factory custom activities for a while now. Which I’ve basically been doing blindly because the code execution and logging is provided to ADF, with no visibility to the underlying pool of VM’s doing the work. Well, no more is this the case!

In the Azure portal go to your Batch Service > Pools > Select Pool > Nodes > Select Node > Connect.

The connect button then presents you with the option to add a new user before telling you the external IP with an RDP file.

Once you’ve connected you’ll find a virtual machine, but with a few slight differences.

The directory on the VM used for any ADF custom activities will be something like the following path:

C:\user\tasks\workitems\adf-{guid}\job-0000000001\{guid}-{activityname}-\wd\

I hope this was helpful when you go beyond the basics of Creating Azure Data Factory Custom Activities

Many thanks


Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags are not allowed.

1,040 Spambots Blocked by Simple Comments

Paul’s Frog Blog

Paul is a Microsoft Data Platform MVP with 10+ years’ experience working with the complete on premises SQL Server stack in a variety of roles and industries. Now as the Business Intelligence Consultant at Purple Frog Systems has turned his keyboard to big data solutions in the Microsoft cloud. Specialising in Azure Data Lake Analytics, Azure Data Factory, Azure Stream Analytics, Event Hubs and IoT. Paul is also a STEM Ambassador for the networking education in schools’ programme, PASS chapter leader for the Microsoft Data Platform Group – Birmingham, SQL Bits, SQL Relay, SQL Saturday speaker and helper. Currently the Stack Overflow top user for Azure Data Factory. As well as very active member of the technical community.
Thanks for visiting.
@mrpaulandrew