According to Pat Patterson, Community Champion at StreamSets, “data drift” is such a problem now that “only about one fifth of a data analyst’s time is actually spent analyzing the data.” The remainder is spent “wrangling it into shape and getting it from where it is to the actual analysis platform.” Speaking at the Enterprise […]
Scaling Machine Learning Applications
When the number of users for a predictive model grows, it is expected (albeit often wrongly) that the machine learning powered systems will automatically scale to keep up with this growth. If the system fails to scale, processing requirements may outpace performance. Using an example from a LinkedIn article, a sample recommender system fails to […]
Blockchain Use Cases
Blockchain, which is akin to a distributed and decentralized accounts ledger, can record and verify high volumes of digital transactions, irrespective of location. So, blockchain has the capacity to contribute to many industry sectors, besides finance. As a secure technology platform, blockchain’s main benefits are accuracy, protection against fraud, and easy sharing of information. The […]
Case Study: Crown College Uses Predictive Analytics to Retain At-Risk Students
Crown College in St. Bonifacius MN embraced a five-year persistence and completion project four years ago. The college’s Presidents’ Cabinet embraced persistence and completion as an improvement initiative to retain at-risk students and the school had been accepted into the Higher Learning Commission (HLC) Persistence and Completion Academy. HLC accredits colleges and universities in a […]
Graph Databases: Updates on Their Growing Popularity
Graph databases became recognized as a database design in 2006, when Tim Bernes-Lee developed the concept of a huge database called the “linked data.” This concept became the basis of graph storage, and could display how organizations, people, and items or entities are associated, or “interconnected” with one another, and the nature of the relationships. […]
Advances in Machine Learning
There is little doubt machine learning has become one of the most powerful technologies in the last decade. The emphasis on “learning” in machine learning allows computers to make better and better decisions, based on previous experiences. Advances in this technology have allowed for recent breakthroughs that promote faster and more efficient business intelligence, using […]
A Brief History of Data Security
Data security describes the protection of digital data from a cyberattack or a data breach. A data breach is the unauthorized opening of data, typically to read or copy the information. Stolen data may contain confidential information, such as customer data, credit card numbers, or trade secrets. A cyberattack is much more aggressive. It is […]
2020 DATAVERSITY Top 20
With 2020 now behind us, we here at DATAVERSITY are taking a moment to look back on the hits and misses of this unprecedented year. What content did you, our readers, seek out most during challenging times? Which topics helped you succeed as a data professional, and what should we focus more on in 2021 […]
Data Container Architecture: Answers and Challenges
Data containers are a recent step in the evolution of the cloud. Their purpose is to run reliably as they are transferred from one computer environment to another. They are isolated, improve security, and are “usually” easy to work with. Containers promote application portability through their novel use of packaging, and the philosophy of “develop […]
A Brief History of Data Management
Data Management is the organization of data, the steps used to achieve efficiency, and gather intelligence from that data. Data Management, as a concept, began in the 1960s, with ADAPSO (the Association of Data Processing Service Organizations) forwarding Data Management advice, with an emphasis on professional training and quality assurance metrics. Data Management should not […]