The Three Things Data Practitioners Struggle With

By on
Read more about author Matt Wallace.

Data Management has never been more critical than today. As AI grows more prominent, data initiatives are more important than ever. As the digital age propels us forward, the need for robust DataOps strategies becomes evident. These strategies, however, are not devoid of challenges. 

Data-focused practitioners have a unique relationship with data. They are grappling with an uptick in the number of users accessing data, which presents a multitude of challenges, such as metadata management, data movement, and data discovery. Coupled with using different systems to conduct business, managing the data created adds a layer of complexity. Having data spread across systems and sources creates inconsistencies, further complicating trust in the quality of data. When data is spread across the organization, it’s difficult to monitor and manage the quality of data. This eats time and resources and makes it difficult to integrate dispersed data. It’s hard for organizations to trust their data when they never know how accurate it is. 

Keeping Pace with Tech Innovations Is Forcing Change 

Diving deeper into the digital transformation narrative, data practitioners – along with an assist from software and IT teams – emerge as the unsung heroes. Their pivotal role has led to significant enhancements in efficiency, potentially accelerating the pace of businesses. The State of DataOps survey by Enterprise Strategy Group found that 46% of these tech-savvy individuals reported improved data quality and reliability, while 41% experienced heightened agility in their operations. However, as with any rapid progression, challenges lurk in the shadows. The same survey found 39% grapple with the swift pace of technological evolution, while 33% wrestle with the task of integrating data from a myriad of sources.

Data Initiatives Are Necessary to Manage the Explosion of Data 

In the relentless pace of the digital age, businesses aren’t just using data; they are becoming fundamentally data-driven. This transformation isn’t limited to technology firms or startups. Traditional industries, from manufacturing to healthcare, are embedding analytics into their core, redefining their strategies around data insights. By doing so, they’re not merely staying competitive but are also unlocking new avenues of innovation and growth, ones that were previously inconceivable. 

The intertwining of data with business operations is ushering in a paradigm where data fluency isn’t just an IT trait but a holistic organizational competency. Developers and data practitioners are at the forefront of this transformation, but the real magic unfolds when these technical insights are married with business acumen. It’s a synergy where data points transform into actionable strategies, and bytes become business models. The imperative for organizations is clear: Foster an environment where technical prowess and business strategy walk hand in hand, propelling the enterprise into the next echelon of innovation. 

The proliferation of devices at the edge, from IoT sensors to mobile devices, is set to complicate the DataOps narrative. As data generation shifts from centralized data centers to the periphery, managing, processing, and gleaning insights from this distributed data trove will demand new strategies. Edge computing, where data is processed closer to its source, is poised to play a pivotal role in delivering faster satisfaction to customers. In the enterprise, the transformation looks to be even more dramatic, between the rise of analytical AI and the promise of improvements from generative AI as well.

As we traverse this landscape, the omnipresence of multi-cloud strategies is undeniable. Half of DataOps practitioners employ three or more cloud providers. However, the multi-cloud realm is not without its tribulations. 

Multi-Cloud Strategies Can Help Drive Data Initiatives 

While multi-cloud strategies can drive benefits through enhanced innovation and collaboration, they also underscore the vital need for centralized data services. These services would provide consistent, performant, secure access to data where governance, movement, copying, and confusion were kept out of the picture. This is where cutting-edge solutions come into play, enabling organizations to run any workload, anywhere, and at any time. With a single copy of their data made available to all cloud-based applications and services simultaneously, businesses can truly harness the power of their data.

As we stand at the crossroads of innovation and challenges, the DataOps narrative unfolds. While the road ahead is riddled with complexities, with the right strategies and tools, businesses can navigate this labyrinth with confidence and precision.


Enterprise Strategy Group, a division of TechTarget, Inc. Research Survey, The State of DataOps, July 2023