Tag: fast data pipeline

Solving Lambda Architecture’s Fast Layer Problem

February 05, 2018

Getting up to date answers about recent events and asking the same question about older data is really hard to do using open source. The Lambda Architecture is a somewhat complicated way of doing this kind of mass scale, relatively fast, open source data processing. The key point is that you have two layers: a [...]

February 5, 2018
No Comments

The Open Source Real-Time Question (and Fast Data Answers)

October 24, 2017

By: Volt Active Data Blog Staff

Rising Amounts of Information As we look at total amount of information created world wide, we see an exponentially rising curve. According to the 2017 Internet Trends study, the amount of total information generated in the world today is about 16 zettabytes (zb). Based on Kleiner estimates, this number will grow at least tenfold to [...]

October 24, 2017
No Comments

What Real-Time Application Pattern Works for You?

October 20, 2017

By: Adrian Scholes

3 common real-time application patterns that require a real-time decision Editor’s note: This blog post first appeared on the InfoWorld blog on September 29, 2017. At first glance, building a real-time application may sound like a daunting proposition, one that involves technical challenges as well as a significant financial investment, especially when you have an […]

October 20, 2017
No Comments

Fast Data Pipeline Design: Updating Per-Event Decisions by Swapping Tables

July 11, 2017

By: Adrian Scholes

Volt Active Data was one of the first companies to enable a new modern breed of applications, applications that combine streaming, or “fast data”, tightly with big data.We call these applications Fast Data Pipelines. First, a quick high-level summary of the fast data pipeline architecture: The first thing to notice is that there is […]