Building AgileBI Block by Block – Agile Data Modelling = Data Vault

by | Nov 26, 2015

Building AgileBI Block by Block – Agile Data Modelling = Data Vault

by Nov 26, 2015

An awesome Data Vault course

We had the privilege of hosting Hans Hultgren in our Wellington offices this week for his 3 day Data Vault Certification course. It was a great three days and confirmed for me that we have found another crucial lego block in our AgileBI stack.

That was a perfect fit for how we deliver

When we started the AgileBI journey a year (or two..) ago, we naively thought that there were probably some people around the world who had done it all before and solved most of the problems we would encounter.  Ideally they would have written books or would run courses that would help us replicate their success.
We were wrong.
But what we did find that there were some very smart people that had spent a lot of time solving parts of the AgileBI problems we would encounter.  Hans was one of these and he has helped solve our Agile Data Modeling problem.

AgileBI Building Blocks

To be a truly Agile team delivering data, analytical models and visualisations every three weeks, you need a lot capabilities in your toolkit to help you deliver. At OptimalBI we talk about the Lego Blocks that are required to make the AgileBI Lego Tower.
We have managed to find or build 4 blocks in our AgileBI tower so far:
AgileBI 4 Lego Blocks When we say we have a block sorted, what we mean is that we have the developed or found the Concepts, Processes and Templates that enable us to deliver this capability consistently.   (And we give ourselves extra points if we have built some automation for it.)
We test we have these blocks sorted by proving we can teach our customers how use deliver this capability like we do.
We were ecstatic that when we found the Data Vault approach as it fitted our needs for Agile Data Modelling perfectly.  And again for extra points it even integrated nicely with our Agile Data requirements gathering approach (based on BEAM).
In fact it is amazing how closely BEAM Data Requirements gathering and Data Vault Data Modeling align.  And that’s an important point I will blog about later, its important that each of the blocks integrate with each other, else we are only building a house of cards, which will easily topple.
 

Source: Flickr

Impressive but it aint going to last!  A bit like a purely dimensional Enterprise Data Warehouse. And we have even gone for the extra points on the Agile Data Modelling block by starting development on our open source data vault automation engine, ODE.
And of course we have a few more lego blocks to go, which I will blog about later.

Thanks Hans

For now I would just like to say a big ups and thanks to Hans for both his passion, his book and his course as he has given us one of our much required AgileBI Lego Blocks, which means we didn’t need to invent that capability on our own.

Start your AgileBI journey with us.

Other steps in the AgileBI Journey

And sometimes a sprint or a scrum.
3 reasons why I like Python

3 reasons why I like Python

3 reasons why I enjoy coding with Python, and what I use it for (beginner)   I can’t be called a code monkey when compared to my colleagues, but recently I’ve found Python to be really helpful with some of my work tasks, so I signed up for a Udemy course to learn...

read more
What’s New – Qlik Sense 2020

What’s New – Qlik Sense 2020

2020 has been a big year for the world, so you can be excused if you missed out on what is new and hot in Qlik Sense! As always Qlik are bringing out new features, functionality, and bug fixes. In this blog I will try and summarise the new features for this year’s...

read more
MongoDB University

MongoDB University

It is always a challenge to learn how to use new software products. Of course, all of them have documentation and how-to guides to explain the basics. However, many people would rather watch videos or find a teacher as this is the best way for our brains to consume...

read more
Where to find some open data

Where to find some open data

The OptimalBI team loves open source and is also mad about data.  Alison wrote a blog on Open source datasets already, and because there's more options out there, I thought I would give you some more places to get open data from for your various data needs. I have...

read more
New Zealand Traffic Data

New Zealand Traffic Data

When you ventured out to the supermarket during lockdown, I bet you noticed waaaay less traffic on the roads.  I live in the Wellington CBD, and it was really weird walking around with no people, no traffic for weeks. It got me wondering about the data;  Thankfully...

read more
Learning Azure with Pluralsight

Learning Azure with Pluralsight

Cloud solutions have little to do with the solutions we have on-premises. Cloud solutions are built with ambitious and monstrously huge goals in mind, so, often it feels like no previous technology has been reused. In addition to some understandable concepts, like...

read more
How to Model a Reporting Layer

How to Model a Reporting Layer

On my first BI job, where I was an ETL developer, my team was using Microsoft SQL Server Reporting Service (SSRS) as a reporting tool. My job was to model the Data Marts and create the data flows into those tables. Our report analysts were good at SQL, I have even...

read more
Qlik Replicate – Task Metadata

Qlik Replicate – Task Metadata

Recently I was working for a client and had a specific issue which led me to probe around various aspects of Qlik Replicate tasks, attempting to understand how Qlik Replicate works. While I did not manage to achieve what I was specifically attempting I did have a look...

read more
ETL is Easy Again in Azure Data Factory

ETL is Easy Again in Azure Data Factory

Almost two years ago I was a part of the BI team in an organization that decided to move to the Cloud. As a first step they followed the lift and shift approach, so they moved their Data Warehouse and all the existing processes into the Azure environment almost...

read more
SAS Functions Book

SAS Functions Book

Over the years, we've been building up our comic-style SAS function one-page guides, drip-feeding them to you.  Well, guess what?!  We put them all together and made a book so they're all in the one place, to make referencing them easier for you. Thank you...

read more
Zen and the art of database model maintenance

Zen and the art of database model maintenance

So there you are having created a work of beauty in Sparx Enterprise Architect that models all of your databases, and then the fly lands in the ointment.  There's a new version of "stuff" coming down the pipeline and you need to update the model or things are...

read more
Checking the File Path from Database in PowerShell

Checking the File Path from Database in PowerShell

On one of my recent projects I was analysing my customer's data for migration. Their legacy application could handle documents. They were stored on the organisation's shared folder, and the file path was recorded in the database with the rest of data. As a part of the...

read more
0 Comments

Trackbacks/Pingbacks

  1. All About Hans Hultgren and Data Vault | OptimalBI - […] Building AgileBI Block by Block – Agile Data Modelling = Data Vault […]
  2. Data Vault blogs you need to read | OptimalBI - […] Building AgileBI Block by Block – Agile Data Modelling = Data Vault […]
Submit a Comment

Your email address will not be published. Required fields are marked *