CSV

  • Part 1: Using the Companies House API

    : A person wearing a Purple Frog-branded polo shirt stands with arms crossed in front of a modern curved glass building. The background features a purple geometric design with hexagons and circular tech-style graphics. Text on the right reads: ‘Part 1: Using the companies house API.’

    The .gov website hosts companies house and the companies house API. This is a comprehensive list of businesses across the UK, new and old, big and small, and their filings and info. You can interact with this information via code such as Python. The following blog post series will show you how to perform an advanced search of companies – using multiple different filters to get specific businesses – and then looping through these results to…

    » Read more
  • PowerShell – Extract zipped folders and delete original .zip

    PowerShell – Extract zipped folders and delete original .zip

    It may be of use to extract .zip folders quickly and effectively, particular in large volumes. Rather than going through manually, one by one clicking extract here for each folder, waiting, then finding the next folder to unzip, do this via PowerShell instead. The scenario we have faced is archiving source files. Instead of having 15,000 files in a folder for March, they are contained in a .zip folder called 202403.zip – its much cleaner.…

    » Read more
  • Synapse Copy Activity Fails Over Certain File Size – ADF

    Copy Activity Issue in ADF / Synapse Analytics Recently, when trying to copy a .csv file from an FTP source to a Azure Data Lake using a Copy Activity in Azure Synapse, I had an issue where files > 16MB in size would fail. To overcome this, I took the first 13k rows and created another file from this, which resulted in a 4MB file. I tested this extra small file and it worked in the copy activity no issues. I multiplied these same 13k rows out…

    » Read more
  • Exporting to a CSV file from SSMS – Simple BCP Method

    Export table contents to a CSV file from SQL Server  It may be useful to export a tables contents to a CSV file for some exploratory analysis, to feed an ETL and much more. This can be done with some simple SQL commands that exist as a stored procedure, SQL agent job or just a one off piece of code. The export can be the whole table or filtered results but one thing to keep in mind is the number of rows and result size as it may become…

    » Read more