kaskada

We are very excited to have our 1st blog post in a series of blog posts talking about the recent work we are doing on Kaskada and on event based data processing. Kaskada was recently open sourced as well and if you are interested drop by https://github.com/kaskada-ai/kaskada

We recently open-sourced Kaskada – an event-processing engine built on Rust and Apache Arrow. It features a high-level, declarative query language designed specifically for reasoning about events in bulk and in real time. Unlike SQL, an aggregation over events produces a timeline indicating the value at each point in time over the events that have occurred up to that point in time. The query language provides composable, expression oriented syntax, including the ability to nest aggregations. Due to the focus on events and temporal queries, it provides capabilities to shift events forward (not backward, to avoid "leaking" information about the future into past values), ticks that create new times (allowing you to observe the current value of an aggregation every day, for instance) and joins that operate "at the current time". Example query