Unexpected (and unwanted) data transformation problems can result from 50 (or more) issues that can be seen in the table that’s referenced in this blog post (see below). This post is an introduction to many causes of data transformation defects and how to avoid them. Data transformations are a process of altering data and data-related […]
It’s Essential – Verifying the Results of Data Transformations (Part 2)
Test cases, data, and validation procedures are crucial for data transformations, requiring an understanding of transformation requirements, scenarios, and specific techniques for accuracy and integrity. Data transformations require complex testing due to their sophisticated logic, computations, and dependency on real-time data streams. This necessitates extensive test case design, representative data, automation tools, and robust validation […]
It’s Essential – Verifying the Results of Data Transformations (Part 1)
Today’s data pipelines use transformations to convert raw data into meaningful insights. Yet, ensuring the accuracy and reliability of these transformations is no small feat – tools and methods to test the variety of data and transformation can be daunting. Transformations generally involve changing raw data that has been cleansed and validated for use by […]
Data Risk in 2018: Data Management and Data Integrity Necessities
Click to learn more about author John Felahi. Once again, businesses sat up and took notice of a number massive consumer information leaks over the past year. The data breach headlines of 2017 were led by Yahoo, Uber, Arby’s, and Equifax, to name just a few. These events exposed various levels of personal and identifiable […]