Рет қаралды 3,876
Bytewax is a curious stream processing tool that blends a Python surface with a Rust core to produce something that’s in a similar vein to Kafka Streams or Apache Flink, but with a fundamentally different implementation. This week we’re going to take a look at what it does, how it works in theory, and how the marriage of Python and Rust works in practice…
-
The original Naiad Paper: dl.acm.org/doi/10.1145/251734...
Timely Dataflow: github.com/TimelyDataflow/tim...
Bytewax the Library: github.com/bytewax/bytewax
Bytewax the Service: bytewax.io/
PyO3, for calling Rust from Python: pyo3.rs/v0.21.2/
Kris on Mastodon: mastodon.social/@krisajenkins
Kris on LinkedIn: / krisjenkins
Kris on Twitter: / krisajenkins
--
0:00 Intro
2:06 Podcast
59:56 Outro
#softwaredevelopment #dataengineering #apachekafka #timelydataflow