Click to learn more about author Avee Mittal. Data cleansing is an important step to prepare data for analysis. It is a process of preparing data to meet the quality criteria such as validity, uniformity, accuracy, consistency, and completeness. Data cleansing removes unwanted, duplicate, and incorrect data from datasets, thus helping the analyst to develop […]
Moving Unstructured Data Is Risky and Pricey, but Critical: Five Steps to Improve It
Click to learn more about author Daniel Esposito. It’s time-consuming – and often very costly – for enterprises to perform a network-attached storage (NAS) or object data migration. As moving unstructured data has proliferated over the past decade, with as much as 90% of all data defined as unstructured data, the task has become increasingly […]
The Three Pillars of Trusted AI
Click to learn more about author Jett Oristaglio. As AI becomes ubiquitous across dozens of industries, the initial hype of new technology is beginning to be replaced by the challenge of building trustworthy AI systems. We’ve all heard the headlines: Amazon’s AI hiring scandal, IBM Watson’s $62 million failure in oncology, the now-infamous COMPAS recidivism […]
Messy Data Shouldn’t Stop Machine Learning in Its Tracks
Click to learn more about author Jon Reilly. Businesses are creating data at an incredible pace that will only accelerate. In fact, data storage company Seagate predicts it will pass a yearly rate of “163 zettabytes (ZB) by 2025. That’s ten times the amount of data produced in 2017.” Moore’s Law – the principle that […]
Three Reasons to Take a More Holistic Approach to Data Management
Click to learn more about author Olivia Hinkle. Taking a holistic approach to data requires considering the entire data lifecycle – from gathering, integrating, and organizing data to analyzing and maintaining it. Companies must create a standard for their data that fits their business needs and processes. To determine what those are, start by asking […]
Dear Laura: Data Democratization
Click to learn more about author Laura Madsen. Welcome to the Dear Laura blog series! As I’ve been working to challenge the status quo on Data Governance – I get a lot of questions about how it will “really” work. I’ll be sharing these questions and answers via this DATAVERSITY® series. Last year I wrote […]
Being Data-Driven Means Embracing Data Quality and Consistency Through Data Governance
Click to learn more about author Terence Siganakis. Organizations are constantly coming to us wanting help in becoming more “data-driven.” They want to improve their decision making, shifting the process to be more quantitative and less based on gut and experience. This is a worthy goal but is a little more complex than just putting dashboards […]
Becoming a Prized Data Warehouse and Data Integration Tester
Click to learn more about author Wayne Yaddow. Data warehouse (DW) testers with data integration QA skills are in demand. Data warehouse disciplines and architectures are well established and often discussed in the press, books, and conferences. They have become a standard necessity for most modern organizations. Each business often uses one or more data […]
How a Data Catalog Enables Remote Collaboration
Click to learn more about author Emily Washington. Forty-two percent of the U.S. workforce is working from home full-time, according to the Stanford Institute for Economic Policy Research — almost twice as many employees as this time last year. As companies reimagine a post-pandemic workforce, many are either abandoning their office spaces completely or embracing […]
Ten Use Cases to Enable an Organization with Metadata and Catalogs
Click to learn more about author Tejasvi Addagada. Enterprises are modernizing their data platforms and associated tool-sets to serve the fast needs of data practitioners, including data scientists, data analysts, business intelligence and reporting analysts, and self-service-embracing business and technology personnel. However, as the tool-stack in most organizations is getting modernized, so is the variety of […]