Hiya! Excited to try this, The devil is of-course in the details :) What are the throughput implications for the rest of the cluster? IS there any way to profile the transforms usage as a percentage of the whole? How much of the API is exposed? can it create topics?

Hi, of course there are :) So the transformations are deployed in a separate NodeJs process per node. You can use familiar tools to take a look at its cpu + memory usage.

As for how it affects redpanda, currently we are working on exposing metrics via Prometheus. All of this work occurs on background threads, so the only way it would affect throughput is if enough coprocessors are deployed with enough actual work that would eventually start to fill up our seastar reactors.

Have a look at https://m-ld.org/ , its a CRDT implementation that's all Javascript. it could help

Looks very promising. Thanks for sharing!

Yup, and it supports Ably too, see https://js.m-ld.org/#ably-remotes!

Matt, Ably co-founder

I've never gone out of my way to try and get my friends to apply as I have for Ably Realtime(PaaS startup) I joined in the pandemic lockdown, and they just rolled with it. When things eased, all of the flexibility stayed. Best place I've worked as a parent.