Advertisement

10 Advantages of Real-Time Data Streaming in Commerce

While early science fiction shows like “Buck Rogers” (1939) and “The Fly” (1950) depicted teleportation technology, it was Star Trek’s transporter room that made real-time living matter transfer a classical sci-fi trope. While we haven’t built technology that enables real-time matter transfer yet, modern science is pursuing concepts like superposition and quantum teleportation to facilitate information transfer across any distance […]

How to Become a Data Engineer

The work of data engineers is extremely technical. They are responsible for designing and maintaining the architecture of data systems, which incorporates concepts ranging from analytic infrastructures to data warehouses. A data engineer needs to have a solid understanding of commonly used scripting languages and is expected to support the steady evolution of improved Data Quality, […]

Fundamentals of Data Virtualization

Organizations are increasingly employing innovative technology called “data virtualization” (DV) to tackle high volumes of data from varied sources. Data virtualization is widely used in enterprise resource planning (ERP), customer relationship management (CRM), and sales force automation (SFA) systems to collect and aggregate multi-source data. From multi-sourced data acquisition to advanced analytics, this technology seems […]

The Fundamentals of Data Integration

Data integration uses both technical and business processes to merge data from different sources, helping people access useful and valuable information efficiently. A well-thought-out data integration solution can deliver trusted data from a variety of sources. Data integration is gaining more traction within the business world due to the exploding volume of data and the […]

Best Practices in Data Pipeline Test Automation

Data integration processes benefit from automated testing just like any other software. Yet finding a data pipeline project with a suitable set of automated tests is rare. Even when a project has many tests, they are often unstructured, do not communicate their purpose, and are hard to run. A characteristic of data pipeline development is the frequent […]

Database Management Best Practices

Database management best practices promote the efficient use of data throughout the organization. These practices support the collection and storage of quality data, as well as provide easy access to the data by the appropriate people. With today’s data growing in volume and becoming increasingly complex, the intelligent management of data has become a necessity.  […]

What’s a Semantic Layer Worth?

There’s been a lot of talk about semantic layers lately. I’ve seen dozens of companies using a semantic layer to drive self-service analytics at scale. But even with all these success stories, I still get this question: “Is a semantic layer worth the effort?” In other words, is the juice worth the squeeze?  So, how […]

How a Modern Data Engineering Stack Can Help Create a Data-Driven Culture

Creating a collaborative, data-driven culture is one of the most important goals of many modern organizations. However, access to the data and data processing tools remains restricted to the selected few technical users or upper management echelons. Data-driven culture cannot exist without the democratization of the data. Data democratization certainly does not mean unrestricted access to all […]