Press "Enter" to skip to content

Bad Data in the Silver Layer

Andy Brownsword answers a question:

When combining and curating data in your Silver layer it’s not uncommon to find entries don’t always fit quite right. It could be missing references, incomplete data, or broken validation rules.

Should that bad data be allowed into your carefully crafted Silver layer? And if not, where should that data go?

Let’s look at some options for handling the bad data and how they compare.

This is a harder question to answer than it would first appear. In a perfect world, you’ve applied all of the data cleansing logic and you have pristine data with no errors. Also, you ride unicorns to work in the Fields of Elysium.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.