Kafka Connect is a tool to rapidly stream events in and out of Kafka. It has a narrow focus on data ingress in and egress out of the central nervous system of modern streaming frameworks. Connect allows developers to quickly build robust, durable and scalable pipelines in and out of Kafka.
Landoop provides a large collection of Connectors bundled in the Stream Reactor. This open source set of components can be used as the entry point for building your streaming data flows.
Kafka Connect can run in standalone or distributed mode. The former is targetting testing or an one-off jobs whereas the later provides a scalable, fault-tolerant service supporting an entire organization. Connect can scale down for development, testing, and small deployments or scale out to support production workloads. Combined with KCQL it offers a low barrier entry and operational overhead allowing support for large organizations data pipelines.
All our connectors support Avro, and use the converters to translate the Avro into Kafka Connects internal
We also offer support for JSON for the following Sinks:
- DSE Cassandra Sink
- JMS - TextMessages only
- CoAP Sink
- MQTT Sink
- Elastic2x and 5x Sinks
We are in the process of upgrading the remaining connectors.
Lenses provides a UI and API to deploy and monitor Stream Reactor and third-party connectors.