Revival of the Kafka Wire Protocol implementation

[jpohanka]

There has been recently a discussion in the Fluvio Discord channel regarding the implementation of the Kafka Wire Protocol for Fluvio.

While there has already been an initiative to achieve this, it was discontinued due to the volume of required effort.

However, since then, there have been other initiatives to create the Kafka Wire Protocol implementation in Rust and other languages, namely:

• https://github.com/ivanyu/kafka_wire_protocol

• https://github.com/tychedelia/kafka-protocol-rs

These initiatives could serve as a good starting point for reviving the original Fluvio initiative and reducing the required work.

Implementing this feature would enable Fluvio to directly connect to Kafka producers and consumers, thus allowing faster adoption in many data streaming use cases.

If you would like to have this feature in Fluvio (or even help with the development), vote for it by giving this GH issue a 👍. Otherwise, give it a 👎.

[sehz]

Would be happy to mentor and assist this effort. Fluvio protocol is basically modified version of Kafka so it's mostly compatible.

[gregfurman]

+1 It would be brilliant to have a Kafka-compatible-Fluvio as opposed to needing to bring up an entire Kafka cluster whenever running CI/integration tests 😄