by Angela Guess
The App Man over at Sys-Con Media has posted a new article regarding what he refers to as the Data Cloud. The article begins, “As data has grown exponentially at many sites, companies have been forced to horizontally scale their data. Some have turned to sharding of databases like Postrres or MySQL , while others have switched to newer NoSQL data systems. There have been many debates in the last few years about SQL vs. NoSQL data management systems and which is better. What many have failed to grasp, though, is how similar these systems are and how complex they both are to run in production in high scale.”
It continues, “Both of these systems represent what I call a Data Cloud. This Data Cloud is logical data set spread across many nodes. While developers have heated debates about which system is better and how to design code around it, those in DevOps usually struggle with very similar issues because the two systems are mostly the same. Both systems (1) Run across many nodes with large amounts of data flowing between them and from/to the application. (2) Strain both the hardware of all nodes, and the network connecting them. (3) Maintain duplicate data across nodes for fault tolerance, and must have failover ability. (4) Must be tuned on a per node and cluster-wide bases. (5) Must allow for growth by adding additional nodes.”
