11 May 2022


Performance issue insert select

A while ago I noticed a performance issue with a view in Azure SQL Server. The returned result set of this view is inserted....

28 December 2021


Export Datasets Properties

Recently we have we migrated successfully our on-premises data warehouse to the Azure platform. During this project we improved many things, e.g. the way we develop a dataset....

1 November 2020


Log script name in Powershell

Earlier this year I wrote a blog about logging in Powershell. I was happy with this but recently I have changed the script a bit...

25 October 2020


Converting a dataset to json and flat file with Powershell

Sometimes as part of my daily job I need to transform a SQL Server data set (or recordset) to json or a flat file. Mostly I use an ETL Tool or a SQL Server json query to get the job done. To get more knowledge about Powershell...

13 May 2020


Logging in Powershell

I am always a big fan to have some logging in the software/scripts I develop. A log gives details what happened inside the software/script and it can be useful for debugging or validation purposes. So I decided to write a Powersehll logging script...

22 February 2020


Query with multiple full outer joins

Last week I got the question to help someone with a query because the query result was not as expected. At first sight the query was pretty straight forwarded. But there was one thing he used multiple full outer join and I asked why this was needed from a functional viewpoint...

23 December 2019


Counting nbr of lines based on a field separator

A while ago a customer for which I have designed and developed a data platform has asked me to develop a solution to count the real number of lines of a flat file. With this number we are able to validate the load, just to be sure that we have loaded all rows into a table. In short the number of imported rows returned by the T-SQL command bulk insert should be the same as the number of lines of the flat file...