https://kafka.apache.org/43/kafka-connect/Recent content in Kafka Connect on Apache KafkaHugo -- gohugo.ioenhttps://kafka.apache.org/43/kafka-connect/overview/Mon, 01 Jan 0001 00:00:00 +0000https://kafka.apache.org/43/kafka-connect/overview/Kafka Connect is a tool for scalably and reliably streaming data between Apache Kafka and other systems. It makes it simple to quickly define connectors that move large collections of data into and out of Kafka. Kafka Connect can ingest entire databases or collect metrics from all your application servers into Kafka topics, making the data available for stream processing with low latency. An export job can deliver data from Kafka topics into secondary storage and query systems or into batch systems for offline analysis.https://kafka.apache.org/43/kafka-connect/user-guide/Mon, 01 Jan 0001 00:00:00 +0000https://kafka.apache.org/43/kafka-connect/user-guide/The quickstart provides a brief example of how to run a standalone version of Kafka Connect. This section describes how to configure, run, and manage Kafka Connect in more detail. Running Kafka Connect Kafka Connect currently supports two modes of execution: standalone (single process) and distributed. In standalone mode all work is performed in a single process. This configuration is simpler to setup and get started with and may be useful in situations where only one worker makes sense (e.https://kafka.apache.org/43/kafka-connect/connector-development-guide/Mon, 01 Jan 0001 00:00:00 +0000https://kafka.apache.org/43/kafka-connect/connector-development-guide/This guide describes how developers can write new connectors for Kafka Connect to move data between Kafka and other systems. It briefly reviews a few key concepts and then describes how to create a simple connector. Core Concepts and APIs Connectors and Tasks To copy data between Kafka and another system, users create a Connector for the system they want to pull data from or push data to. Connectors come in two flavors: SourceConnectors import data from another system (e.https://kafka.apache.org/43/kafka-connect/administration/Mon, 01 Jan 0001 00:00:00 +0000https://kafka.apache.org/43/kafka-connect/administration/Kafka Connect’s REST layer provides a set of APIs to enable administration of the cluster. This includes APIs to view the configuration of connectors and the status of their tasks, as well as to alter their current behavior (e.g. changing configuration and restarting tasks). When a connector is first submitted to the cluster, a rebalance is triggered between the Connect workers in order to distribute the load that consists of the tasks of the new connector.