In 2009, the U.S. Army Intelligence and Security Command wanted the ability to track, in real-time, national security threats. Potential solutions had to provide instant results, and use graphics to provide insight into their extremely large streaming datasets. At the time, there was nothing available to meet their needs. Both NoSQL solutions and classical relational […]
A Brief History of Big Data
Big Data has been described by some Data Management pundits (with a bit of a snicker) as “huge, overwhelming, and uncontrollable amounts of information.” In 1663, John Graunt dealt with “overwhelming amounts of information” as well, while he studied the bubonic plague, which was currently ravaging Europe. Graunt used statistics and is credited with being […]
More than Two-Thirds of Data Analytics Now Run on Modern Non-Relational Data Sources
by Angela Guess A new press release states, “Zoomdata, developers of the world’s fastest visual analytics platform for big and streaming data, and O’Reilly Media, an internationally recognized, multi-faceted company that has played a seminal role in the evolution and adoption of the Internet revolution, today released the results of a comprehensive survey run by […]
How Can Machine Learning Affect Your Organizational Data Strategy?
One of biggest challenges facing enterprises today is Data Security and Data Privacy. The emergence of potent data technologies such as Big Data, Machine Learning (ML), and the Internet of Things (IoT) in the Data Management landscape has now sparked a new interest in Data Governance. With so much multi-channel data flowing into an average […]
Enterprise Metadata Management Moves Forward
Enterprise Metadata Management and Data Governance vendor Data Advantage Group is continuing to advance its solution since the publication of Gartner’s Magic Quadrant for Metadata Management last summer. At the time, the company’s MetaCenter Enterprise Metadata Repository product, which provides end-to-end data lineage across multiple data sources, was cited as a leader in the Challengers’ […]
OLAP, Hadoop, and Multi-Dimensional Analytics Combined
Kyvos Insights offers OLAP (Online Analytical Processing) software, which works directly with Hadoop storage systems. The use of Hadoop counteracts OLAP’s historical problem of lacking scalability. Their software constructs “cubes” on Hadoop which, in turn, supports multi-dimensional analytics. The OLAP/Hadoop combination supports the processing of both unstructured and structured data at any scale, in turn, […]
What’s After Hadoop?
Click to learn more about video blogger Stefan Groschupf. Introducing the Big Data & Brews video blog series presented by Stefan Groschupf, Founder of Datameer. The series will touch on hot topics within the business of Big Data, Analytics, Internet of Things, Cloud Computing, Machine Learning, Modern BI, NoSQL and Next Generation Technologies. In today’s video blog Stefan Groschupf talks […]
The Innovative Data Scientist: Overcoming the Big Data and Data Management Divide
In an ideal world, a Data Scientist is expected to demonstrate a rare combination of technical, analytical, and communication skills that make them sought after data innovators. In the real world, Data Scientists arrive from a wide variety of academic majors like mathematics, statistics, economics, operations research, or computer science. Additionally, the roles they assume […]
Data Quality in the Data Lake
It’s been a few months since data migration and integration vendor Syncsort completed its acquisition of Data Quality solutions vendor Trillium Software. The combination of the two vendors is already proving a good fit, mirroring where the industry is going, according to Harald Smith, Director of Product Management at Trillium. As he explains it, Syncsort […]
Syncsort’s New Change Data Capture Capabilities Extend Leadership in Mainframe Access
by Angela Guess According to a recent press release, “Syncsort, a global leader in data liberation, integrity and integration solutions for next-generation analytics, today announced new capabilities in its unrivaled mainframe data access and integration solution that continuously, quickly and efficiently populates Hadoop data lakes with changes in mainframe data. The new DMX Change Data […]