The introduction of 5G networks will only increase the data volume and speed requirements that are already putting pressure on traditional data architectures.
Traditional pub/sub systems such as Apache Kafka (and their numerous ever evolving stream processing avatars like Apache Samza, Apache Storm, Apache Flink, etc.) work fine for a bunch of simple use cases where there is a need for simple decisions, speed, scale and stability....
There is a massive difference between generating the input data needed by a Machine Learning model once (to prove a concept), and doing it continuously, indefinitely, at scale, and within short time periods. Years of experience working with disparate and imperfect data sets lead me...
Recently Forrester group has started to talk about "translytics" and Translytical Databases - databases that can “Deliver Analytics At The Speed Of Transactions”. Is this more marketing hype? Or is there something to it? A traditional OLTP database handles lots of rapid fire transactions, but doesn’t...
For decades, relational databases was the de-facto choice for financial service companies, until the 2000s where systems started to face challenges with scalability and availability as the amount of data being processed and consumed shaped how companies conducted their business. NoSQL databases emerged as a reaction...
Editor's Note: This piece originally appeared in DBTA. More companies are realizing that leveraging real-time data is the key to success in modern applications, which means that more people are searching for the right in-memory database technology. However, with many options, comparing in-memory databases for your use...
In 2016, we partnered with Research Now to conduct a survey on a subject we take very seriously: data consistency. The results were shocking. While there was wide agreement on what is defined by “critical data” (financial data), only 58% of people surveyed stated that...
In my previous post, I described four applications (three implemented, one an example) that require, or at least strongly benefit from, strong ACID transactions. With that out of the way, we can now get to the fun bits. Today’s claim: most databases that claim to be...
The ACID properties and the CAP theorem are two important concepts in data management and distributed systems. It's unfortunate that in both acronyms the "C" stands for "Consistency," but actually means completely different things. What follows is a primer on the two concepts and an...
There has been another round of online conversations about the CAP theorem as the internet community continues to discuss its implications on networked databases. Coda Hale recently wrote a well received article titled CAP paper by Gilbert and Lynch. Scattered in the larger conversation is a...