Building AgileBI Block by Block – Agile Data Modelling = Data Vault

by | Nov 26, 2015

Building AgileBI Block by Block – Agile Data Modelling = Data Vault

by Nov 26, 2015

An awesome Data Vault course

We had the privilege of hosting Hans Hultgren in our Wellington offices this week for his 3 day Data Vault Certification course. It was a great three days and confirmed for me that we have found another crucial lego block in our AgileBI stack.

That was a perfect fit for how we deliver

When we started the AgileBI journey a year (or two..) ago, we naively thought that there were probably some people around the world who had done it all before and solved most of the problems we would encounter.  Ideally they would have written books or would run courses that would help us replicate their success.
We were wrong.
But what we did find that there were some very smart people that had spent a lot of time solving parts of the AgileBI problems we would encounter.  Hans was one of these and he has helped solve our Agile Data Modeling problem.

AgileBI Building Blocks

To be a truly Agile team delivering data, analytical models and visualisations every three weeks, you need a lot capabilities in your toolkit to help you deliver. At OptimalBI we talk about the Lego Blocks that are required to make the AgileBI Lego Tower.
We have managed to find or build 4 blocks in our AgileBI tower so far:
AgileBI 4 Lego Blocks When we say we have a block sorted, what we mean is that we have the developed or found the Concepts, Processes and Templates that enable us to deliver this capability consistently.   (And we give ourselves extra points if we have built some automation for it.)
We test we have these blocks sorted by proving we can teach our customers how use deliver this capability like we do.
We were ecstatic that when we found the Data Vault approach as it fitted our needs for Agile Data Modelling perfectly.  And again for extra points it even integrated nicely with our Agile Data requirements gathering approach (based on BEAM).
In fact it is amazing how closely BEAM Data Requirements gathering and Data Vault Data Modeling align.  And that’s an important point I will blog about later, its important that each of the blocks integrate with each other, else we are only building a house of cards, which will easily topple.
 

Source: Flickr

Impressive but it aint going to last!  A bit like a purely dimensional Enterprise Data Warehouse. And we have even gone for the extra points on the Agile Data Modelling block by starting development on our open source data vault automation engine, ODE.
And of course we have a few more lego blocks to go, which I will blog about later.

Thanks Hans

For now I would just like to say a big ups and thanks to Hans for both his passion, his book and his course as he has given us one of our much required AgileBI Lego Blocks, which means we didn’t need to invent that capability on our own.

Start your AgileBI journey with us.

Other steps in the AgileBI Journey

And sometimes a sprint or a scrum.
Where to find some open data

Where to find some open data

The OptimalBI team loves open source and is also mad about data.  Alison wrote a blog on Open source datasets already, and because there's more options out there, I thought I would give you some more places to get open data from for your various data needs. I have...

read more
New Zealand Traffic Data

New Zealand Traffic Data

When you ventured out to the supermarket during lockdown, I bet you noticed waaaay less traffic on the roads.  I live in the Wellington CBD, and it was really weird walking around with no people, no traffic for weeks. It got me wondering about the data;  Thankfully...

read more
Learning Azure with Pluralsight

Learning Azure with Pluralsight

Cloud solutions have little to do with the solutions we have on-premises. Cloud solutions are built with ambitious and monstrously huge goals in mind, so, often it feels like no previous technology has been reused. In addition to some understandable concepts, like...

read more
How to Model a Reporting Layer

How to Model a Reporting Layer

On my first BI job, where I was an ETL developer, my team was using Microsoft SQL Server Reporting Service (SSRS) as a reporting tool. My job was to model the Data Marts and create the data flows into those tables. Our report analysts were good at SQL, I have even...

read more
Qlik Replicate – Task Metadata

Qlik Replicate – Task Metadata

Recently I was working for a client and had a specific issue which led me to probe around various aspects of Qlik Replicate tasks, attempting to understand how Qlik Replicate works. While I did not manage to achieve what I was specifically attempting I did have a look...

read more
ETL is Easy Again in Azure Data Factory

ETL is Easy Again in Azure Data Factory

Almost two years ago I was a part of the BI team in an organization that decided to move to the Cloud. As a first step they followed the lift and shift approach, so they moved their Data Warehouse and all the existing processes into the Azure environment almost...

read more
SAS Functions Book

SAS Functions Book

Over the years, we've been building up our comic-style SAS function one-page guides, drip-feeding them to you.  Well, guess what?!  We put them all together and made a book so they're all in the one place, to make referencing them easier for you. Thank you...

read more
Zen and the art of database model maintenance

Zen and the art of database model maintenance

So there you are having created a work of beauty in Sparx Enterprise Architect that models all of your databases, and then the fly lands in the ointment.  There's a new version of "stuff" coming down the pipeline and you need to update the model or things are...

read more
Checking the File Path from Database in PowerShell

Checking the File Path from Database in PowerShell

On one of my recent projects I was analysing my customer's data for migration. Their legacy application could handle documents. They were stored on the organisation's shared folder, and the file path was recorded in the database with the rest of data. As a part of the...

read more
The best lockdown baking recipes

The best lockdown baking recipes

The nation has been hit by a baking craze!  Lockdown gave some of us more time to do some of the simple things in life, like baking, and, if you were lucky enough to get flour and yeast you could create some delicious treats! I've always enjoyed baking, so loved...

read more
Snowflake and Qlik: End-to-End BI Solution

Snowflake and Qlik: End-to-End BI Solution

Recently I watched a webinar organised by Snowflake, it was called "Data Warehouse Automation, Ingestion and Industry Leading Analytics with Snowflake and Qlik". In the past I could never find time for webinars, and it's amazing how life can give you opportunities to...

read more
Being social while social distancing

Being social while social distancing

The world has been social distancing for some time now, and will be for a bit longer, depending where you live. To help put off or at least mitigate going stir crazy I thought I would share what I have been doing to keep up some sort of social life.   Before the lock...

read more
0 Comments

Trackbacks/Pingbacks

  1. All About Hans Hultgren and Data Vault | OptimalBI - […] Building AgileBI Block by Block – Agile Data Modelling = Data Vault […]
  2. Data Vault blogs you need to read | OptimalBI - […] Building AgileBI Block by Block – Agile Data Modelling = Data Vault […]
Submit a Comment

Your email address will not be published. Required fields are marked *