org.apache.kafka.connect.source

Class SourceRecord

java.lang.Object

org.apache.kafka.connect.connector.ConnectRecord

org.apache.kafka.connect.source.SourceRecord

@InterfaceStability.Unstable
public class SourceRecord
extends ConnectRecord

SourceRecords are generated by SourceTasks and passed to Kafka Connect for storage in Kafka. In addition to the standard fields in ConnectRecord which specify where data is stored in Kafka, they also include a sourcePartition and sourceOffset.

The sourcePartition represents a single input sourcePartition that the record came from (e.g. a filename, table name, or topic-partition). The sourceOffset represents a position in that sourcePartition which can be used to resume consumption of data.

These values can have arbitrary structure and should be represented using org.apache.kafka.connect.data objects (or primitive values). For example, a database connector might specify the sourcePartition as a record containing { "db": "database_name", "table": "table_name"} and the sourceOffset as a Long containing the timestamp of the row.

Constructor Summary

Constructors

Constructor and Description
SourceRecord(Map<String,?> sourcePartition, Map<String,?> sourceOffset, String topic, Integer partition, Schema valueSchema, Object value)
SourceRecord(Map<String,?> sourcePartition, Map<String,?> sourceOffset, String topic, Integer partition, Schema keySchema, Object key, Schema valueSchema, Object value)
SourceRecord(Map<String,?> sourcePartition, Map<String,?> sourceOffset, String topic, Schema valueSchema, Object value)
SourceRecord(Map<String,?> sourcePartition, Map<String,?> sourceOffset, String topic, Schema keySchema, Object key, Schema valueSchema, Object value)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	equals(Object o)
int	hashCode()
Map<String,?>	sourceOffset()
Map<String,?>	sourcePartition()
String	toString()

Methods inherited from class org.apache.kafka.connect.connector.ConnectRecord

kafkaPartition, key, keySchema, topic, value, valueSchema

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

SourceRecord

public SourceRecord(Map<String,?> sourcePartition,
            Map<String,?> sourceOffset,
            String topic,
            Integer partition,
            Schema valueSchema,
            Object value)

SourceRecord

public SourceRecord(Map<String,?> sourcePartition,
            Map<String,?> sourceOffset,
            String topic,
            Schema valueSchema,
            Object value)

SourceRecord

public SourceRecord(Map<String,?> sourcePartition,
            Map<String,?> sourceOffset,
            String topic,
            Schema keySchema,
            Object key,
            Schema valueSchema,
            Object value)

SourceRecord

public SourceRecord(Map<String,?> sourcePartition,
            Map<String,?> sourceOffset,
            String topic,
            Integer partition,
            Schema keySchema,
            Object key,
            Schema valueSchema,
            Object value)

Method Detail

sourcePartition

public Map<String,?> sourcePartition()

sourceOffset

public Map<String,?> sourceOffset()

equals

public boolean equals(Object o)

Overrides:

equals in class ConnectRecord

hashCode

public int hashCode()

Overrides:

hashCode in class ConnectRecord

toString

public String toString()

Overrides:

toString in class ConnectRecord