Call today 0845 643 6463

SQL Server

  • LogParser Performance Inserting into SQL Server

    August 2nd, 2013 in Blog, Integration Services, SQL Server

    Recently I’ve been using LogParser a lot to import log files, such as W3C logs from an IIS web server. The distasteful format of these files is made palatable by the awesomeness that is LogParser; it just takes care fo it for you. (Check out this SQLBits session on LogParser by Jonathan Allen (Twitter | Blog) for a good intro to LogParser) However I’ve been suffering with very poor performance with large files, so started to…

    » Read more

  • Database Management PhD survey

    December 18th, 2012 in Blog, Community, SQL Server

    If you’re involved in database management, can you spare 20 minutes to complete a survey? Victoria Holt is studying for her PhD, and would very much appreciate it if you could help her out with her survey. Go on… Fill it in whilst you have a break over a cup of tea & a mince pie… Full in the survey here On behalf of Victoria, thanks

    » Read more

  • Rock Paper Scissors Lizard Spock

    October 5th, 2012 in Blog, Community, SQL Server

      I want to share with you some genius level work by Phil Quinn (blog | twitter), who is furthering the boundaries of SQL Server.   Phil has taken the spatial drawing code from an earlier Frog-blog and used it to create a fully functional Rock Paper Scissors Lizard Spock game, just using the power of SQL Server. Not even the brightest boffins at Microsoft could ever have imagined that SQL Server would be able to provide such an awesome…

    » Read more

  • MSc Dissertation – Performance of Loading SCDs in SSIS

    July 20th, 2012 in Blog, Business Intelligence, Integration Services, SQL Server

    Well after 3.5 years, I’ve finally completed my MSc Business Intelligence – hoorah! And to reward the time, effort and increased grey hair, they saw fit to give me a merit as well. During the last year I’ve been writing a thesis investigating the performance characteristics of loading data into data warehouse dimensions. Specifically loading Type 2 SCDs using SSIS. For those who have followed the previous posts and my…

    » Read more

  • SQLBits X Video available

    June 19th, 2012 in Blog, Business Intelligence, Community, Integration Services, SQL Server

    SQLBits X Video Now available The video of my talk at SQLBits X is now available on the SQLBits website here. The talk was focused on presenting the results of my MSc Business Intelligence dissertation, comparing the performance of different methods of using SSIS to load data warehouse dimensions, specifically type 2 SCDs. The talk also covers a comparison of the performance between traditional hard disks and solid state storage systems such as…

    » Read more

  • SQL Relay Agenda Announced

    April 19th, 2012 in Blog, Community, SQL Server

    SQL Relay: Free, Full Day SQL Server Events If you’ve not heard the news yet, then where have you been hiding?! With SQLBits X such a phenomenal success, but already a distant memory, we’re all looking for the next SQL Server community event to learn, network and enjoy. The 2012 SQL Relay, following on from the great inaugural events last year, have now been announced and registration is open. Where are they? Monday 21st May –…

    » Read more

  • Automating T-SQL Merge to load Dimensions (SCD)

    April 6th, 2012 in Blog, Business Intelligence, Integration Services, SQL Server

    This is the 3rd post in the Frog-Blog series on the awesomeness of T-SQL Merge. Post 1: Introduction to T-SQL merge basics Post 2: Using T-SQL merge to load data warehouse dimensions In this post we’ll be looking at how we can automate the creation of the merge statement to reduce development time and improve reliability and flexibility of the ETL process. I discussed this in the 2nd half of a talk I gave at the UK technical launch of SQL…

    » Read more

  • Using T-SQL Merge to load Data Warehouse dimensions

    January 16th, 2012 in Blog, Business Intelligence, SQL Server

    In my last blog post I showed the basic concepts of using the T-SQL Merge statement, available in SQL Server 2008 onwards. In this post we’ll take it a step further and show how we can use it for loading data warehouse dimensions, and managing the SCD (slowly changing dimension) process. Before we start, let’s have a quick catch up on what an SCD is… What is a Slowly Changing Dimension (SCD)? If you want a full explanation of…

    » Read more

  • Introduction to T-SQL Merge Basics

    December 13th, 2011 in Blog, SQL Server

    A number of Frog-Blog posts over the next couple of months are going to make heavy use of the awesome SQL Server MERGE statement, introduced in SQL Server 2008. I thought it best to write an introduction post to provide the basics and groundwork for future posts. So what does the Merge statement do? Merge upserts data into a table. If, like me, you find the word ‘upsert’ more than a little ridiculous, we can scrap it in favour of a slightly…

    » Read more

  • Fast record count in SQL Server using sp_spaceused

    December 7th, 2011 in Blog, SQL Server

    Just a quick tidbit today, but a very useful one. Ever need to do SELECT Count(*) on a very large table? It can take ages. Instead, use sp_spaceused EXEC sp_spaceused 'MyTable' It returns you a useful result set like name rows reserved data index_size unused MyTable 19690290 13637488 KB 3001688 KB 9986416 KB 649384 KB Not only does it also give you extra useful information about the table, but it comes back virtually instantly. Columns:…

    » Read more