Data integration processes benefit from automated testing just like any other software. Yet finding a data pipeline project with a suitable set of automated tests is rare. Even when a project has many tests, they are often unstructured, do not communicate their purpose, and are hard to run. A characteristic of data pipeline development is the frequent […]
Top 5 Trends for Data Management in 2023
Despite ongoing economic uncertainty, we know that 2023 will require us to do more with the data we have, protect it better, and find new ways to uncover insights through improved Data Management. 2023 will require everyone to be nimble with their data, but I don’t see the economy derailing growth in this area. In […]
The Declarative Approach in a Data Playground
Click to learn more about author Michele Iurillo. One of the most fascinating things I’ve found at my current organization is undoubtedly the declarative approach. It is something so simple and so powerful. In my first business intelligence endeavors, there were data normalization issues; in my Data Governance period, Data Quality and proactive Metadata Management were the critical points. But […]
Understanding the ETL vs. ELT Alphabet Soup and When to Use Each
There are advantages and disadvantages to both ETL and ELT. To understand which method is a better fit, it’s important to understand what it means when one letter comes before the other.
Planet of the Apps and Their SaaS-ification
Click to learn more about author Chris Lynch. As the CEO of a technology startup and a recovering venture capitalist, I’ve developed a love/hate relationship with technology during the last few decades. I had the incredible opportunity to be at the forefront of change and explosive growth in the early networking days, was present for […]
New Talend and Snowflake Features Enable Faster Cloud Analytics Migrations
According to a new press release, “Talend, a global leader in cloud data integration, and Snowflake Computing, the data warehouse built for the cloud, today announced the availability of new, high-performance bulk loading and native, Extract, Load, Transform (ELT) push-down capabilities that make it fast and efficient to move massive data volumes and varieties from […]