There has never been a time when more options were available to stand up a process-driven and/or platform-driven Data Architecture. In recent years, some companies find themselves with an embarrassment of riches, having every tool known to humankind. Using tools à la carte, with a different tool for each solution, works for some organizations. Other […]
Data Governance vs. Blockchain
Data Governance is the hot topic in today’s security- and privacy-concerned digital ecosystem. Blockchain technology offers data-centered security to sensitive, transactional systems that require tamper-resistant, fully auditable tracking mechanisms. Thus, blockchain and Data Governance (DG) complement each other in many ways, while maintaining distinct operational philosophies and application turfs. Blockchain is today’s preferred technology for […]
Data Containers Demystified: A Reliable Data Movement Solution
The Data Management industry has seen a significant rise in the recent interest of data containers. As Cloud Computing has gained popularity, methods for transporting data and its processing instructions, have been investigated, with data containers coming in as a viable a solution. Data containers solve the problem of getting software to run reliably, while […]
A Brief History of the Hadoop Ecosystem
In 2002, internet researchers just wanted a better search engine, and preferably one that was open-sourced. That was when Doug Cutting and Mike Cafarella decided to give them what they wanted, and they called their project “Nutch.” Hadoop was originally designed as part of the Nutch infrastructure, and was presented in the year 2005. The […]
Tools for Quick Wins with Data Architecture and Data Governance
Data Governance can have various definitions, depending on the audience. To many, Data Governance consists of committee meetings and stewardship roles. To others, it focuses on technical Data Management and controls. Holistic Data Governance combines both of these aspects, and a robust Data Architecture and associated diagrams can be the “glue” that binds business and […]
IoT vs. Serverless Computing
The Internet of Things (IoT) describes an interconnected network of physical and digital devices, sensors, mechanical components, and communication protocols with the ability to transfer and exchange data machine-to-machine or machine-to-interactions. The serverless computing model is cloud-based and all its resources are managed by the service provider. The client is charged based on the consumption […]
Case Study: Indiana University, Data Virtualization, and The Decision Support Initiative
“We can throw business intelligence tools at problems and we can have really smart technicians write code but if it’s not serving the needs of the business and actually answering questions that people need to know, then ultimately, our work is futile,” said Dan Young, Chief Data Architect at Indiana University (IU). Young said that […]
A Brief History of Microservices
The history and origins of microservices are a continuing effort to provide better communication between different platforms, greater simplicity, and more user-friendly systems. Microservices are typically thought of as a software development technique which organizes an application as a group of loosely coupled services. It is, however, any kind of small service which interacts with […]
Demystifying Data Architecture
Ludwig Mies van der Rohe said, “Architecture starts when you carefully put two bricks together”—and Data Architecture begins upon creating, storing, and putting two or more characters together, be they sets of records, emails, pictures, audio, video. This resonated well with initial thoughts about Data Architecture, as it is comprised of things, the functionality of […]
Data Governance in the Cloud
IT center, on-premise infrastructure is becoming increasingly complex and costly, and requires highly skilled manpower, so businesses are now moving their IT and Data Science functions to the cloud. Cloud computing promises low-cost storage facilities, 100 percent up-time, managed services, and automated analytics and BI services, leaving the businesses to concentrate on their domain expertise […]