Skip to main content

Propagating the side effects in cluster mode

6 min read
David Delassus
Co-creator of FlowG

Since v0.61.0, FlowG can run as a cluster of nodes sharing a single FoundationDB storage. Storing the data is the easy part: FoundationDB replicates it for us. But saving a pipeline is more than a write. Something must be compiled, started, reloaded or stopped, and not just on the node that received the API call. On every node.

FlowG v0.63.1 makes this work. Here's how.

Turning your logs into metrics

11 min read
David Delassus
Co-creator of FlowG

Logs tell you what happened. Metrics tell you how much, how often, and is it getting worse. Most infrastructures pay for both, twice, with two different agents reading the same lines.

Since FlowG v0.62.0, they can share the work: a pipeline is now able to count the records flowing through it, and expose those counters to Prometheus.