I’m going to show you how to use ksqlDB to do the following:
– Configure the live ingest of a stream of data from an external source (in this case, Twitter)
– Filter the stream for certain columns
– Create a new stream populated only by messages that match a given predicate
– Build aggregate materialised views, and use pull queries to directly fetch the state from these
Let’s dive in! As always, you’ll find the full test rig for trying this out yourself on GitHub.