In today’s digitally driven world, processing streaming data in real-time is a requirement for business success. The introduction of 5G networks will only increase the data volume and speed requirements that are already putting pressure on traditional data architectures.
There is a massive difference between generating the input data needed by a Machine Learning model once (to prove a concept), and doing it continuously, indefinitely, at scale, and within short time periods. Years of experience working with disparate and imperfect data sets lead me to suspect that people trying to move desktop scale ML […]
For decades, relational databases was the de-facto choice for financial service companies, until the 2000s where systems started to face challenges with scalability and availability as the amount of data being processed and consumed shaped how companies conducted their business. NoSQL databases emerged as a reaction to these challenges and while they certainly helped address […]
Editor’s Note: This piece originally appeared in DBTA. More companies are realizing that leveraging real-time data is the key to success in modern applications, which means that more people are searching for the right in-memory database technology. However, with many options, comparing in-memory databases for your use case can be challenging. Regardless of use case and […]
In 2016, we partnered with Research Now to conduct a survey on a subject we take very seriously: data consistency. The results were shocking. While there was wide agreement on what is defined by “critical data” (financial data), only 58% of people surveyed stated that having consistent critical data transactions was vital to their business. […]
In my previous post, I described four applications (three implemented, one an example) that require, or at least strongly benefit from, strong ACID transactions. With that out of the way, we can now get to the fun bits. Today’s claim: most databases that claim to be 100% ACID compliant fudge definitions, goof up, or deliberately […]
The ACID properties and the CAP theorem are two important concepts in data management and distributed systems. It’s unfortunate that in both acronyms the “C” stands for “Consistency,” but actually means completely different things. What follows is a primer on the two concepts and an explanation of the differences between the two “C”s. What is […]
There has been another round of online conversations about the CAP theorem as the internet community continues to discuss its implications on networked databases. Coda Hale recently wrote a well received article titled CAP paper by Gilbert and Lynch. Scattered in the larger conversation is a continued mis-perception of my position regarding the CAP theorem. […]
