Stateful Dataflows Examples

This repository offers a comprehensive range of dataflow examples from basic to advanced levels, designed to familiarize you with the concepts and techniques essential for deploying Stateful Dataflows.

Prerequisites

Install & Update Rust

curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
rustup update

Install Fluvio & SDF

SDF is the abreviation for Stateful Dataflows.

curl -fsS https://hub.infinyon.cloud/install/install.sh | bash
fvm install sdf-preview9

Start a cluster

fluvio cluster start

DataFlows (Inline)

DataFlows defined inline:

• bank-processing
• car-processing
• http-callout
• openai-callout
• word-counter
• word-probe

DataFlows (Composed)

DataFlows defined via composable packages:

• mask-user-info
• split-sentence

Primitives

Simple examples centered around primitives.

• map
• filter
• filter-map
• flat-map
• split
• merge
• regex
• update-state

References

• connectors