Call today 0845 643 6463

CSV

  • Synapse Copy Activity Fails Over Certain File Size – ADF

    July 21st, 2023 in Azure, Blog, CSV, Data Factory, Data Lake, Synapse

    Copy Activity Issue in ADF / Synapse Analytics Recently, when trying to copy a .csv file from an FTP source to a Azure Data Lake using a Copy Activity in Azure Synapse, I had an issue where files > 16MB in size would fail. To overcome this, I took the first 13k rows and created another file from this, which resulted in a 4MB file. I tested this extra small file and it worked in the copy activity no issues. I multiplied these same 13k rows out…

    » Read more

  • Exporting to a CSV file from SSMS – Simple BCP Method

    June 19th, 2023 in BCP, Blog, CSV, Excel, Export, Purple Frog Systems, SQL, SQL Server

    Export table contents to a CSV file from SQL Server  It may be useful to export a tables contents to a CSV file for some exploratory analysis, to feed an ETL and much more. This can be done with some simple SQL commands that exist as a stored procedure, SQL agent job or just a one off piece of code. The export can be the whole table or filtered results but one thing to keep in mind is the number of rows and result size as it may become…

    » Read more