connect converter

接口：
org.apache.kafka.connect.storage.Converter
实现：
org.apache.kafka.connect.storage.StringConverter
org.apache.kafka.connect.json.JsonConverter
org.apache.kafka.connect.converters.ByteArrayConverter //不做任何转换
com.blueapron.connect.protobuf.ProtobufConverter
io.confluent.connect.avro.AvroConverter
io.confluent.connect.json.JsonSchemaConverter

ConsumerPartitionAssignor

接口：
org.apache.kafka.clients.consumer.ConsumerPartitionAssignor
实现：
org.apache.kafka.clients.consumer.CooperativeStickyAssignor
org.apache.kafka.clients.consumer.RangeAssignor
org.apache.kafka.clients.consumer.RoundRobinAssignor
org.apache.kafka.clients.consumer.StickyAssignor

Partitioner

接口：
org.apache.kafka.clients.producer.Partitioner
实现：
org.apache.kafka.clients.producer.RoundRobinPartitioner
org.apache.kafka.clients.producer.UniformStickyPartitioner

kafka-connect

SourceConnect

接口：
org.apache.kafka.connect.source.SourceConnector
实现：
org.apache.kafka.connect.file.FileStreamSourceConnector

io.debezium.connector.mysql.MySqlConnector
io.debezium.connector.postgresql.PostgresConnector
io.debezium.connector.sqlserver.SqlServerConnector
io.debezium.connector.oracle.OracleConnector
io.debezium.connector.cassandra.Cassandra3Connector
io.debezium.connector.cassandra.Cassandra4Connector

SinkConnect

接口：
org.apache.kafka.connect.sink.SinkConnector
实现：
org.apache.kafka.connect.file.FileStreamSinkConnector
io.debezium.connector.jdbc.JdbcSinkConnector
io.confluent.connect.jdbc.JdbcSinkConnector https://www.confluent.io/hub/confluentinc/kafka-connect-jdbc
io.confluent.connect.elasticsearch.ElasticsearchSinkConnector

com.datastax.oss.kafka.sink.CassandraSinkConnector

config

org.apache.kafka.common.config.AbstractConfig
实现：
– org.apache.kafka.clients.admin.AdminClientConfig
– org.apache.kafka.clients.consumer.ConsumerConfig
– org.apache.kafka.connect.storage.ConverterConfig
– org.apache.kafka.clients.producer.ProducerConfig
– org.apache.kafka.streams.StreamsConfig
– org.apache.kafka.connect.mirror.MirrorClientConfig
– org.apache.kafka.connect.runtime.WorkerConfig
– https://kafka.apache.org/documentation/#configuration

ConnectorConfig

• org.apache.kafka.connect.runtime.ConnectorConfig
• org.apache.kafka.connect.runtime.SinkConnectorConfig
• org.apache.kafka.connect.runtime.SourceConnectorConfig

• io.debezium.connector.mysql.MySqlConnectorConfig

• io.debezium.connector.sqlserver.SqlServerConnectorConfig

OffsetBackingStore

接口:
org.apache.kafka.connect.storage.OffsetBackingStore
实现:
org.apache.kafka.connect.storage.KafkaOffsetBackingStore
org.apache.kafka.connect.storage.MemoryOffsetBackingStore
org.apache.kafka.connect.storage.FileOffsetBackingStore
io.debezium.storage.redis.offset.RedisOffsetBackingStore

io.debezium.relational.history.SchemaHistory

接口:
io.debezium.relational.history.SchemaHistory
实现:
io.debezium.storage.file.history.FileSchemaHistory
io.debezium.storage.azure.blob.history.AzureBlobSchemaHistory
io.debezium.storage.kafka.history.KafkaSchemaHistory
io.debezium.storage.redis.history.RedisSchemaHistory
io.debezium.storage.rocketmq.history.RocketMqSchemaHistory

Glossary

LSO (Last Stable Offset)
ACKS（Acknowledgments）确认、回执
LW（Low watermark）低水位
HW（High watermark）高水位
LEO（Log end offset）日志末尾偏移量
AR（Assigned replica）分配的副本
ISR（In sync replica）正常同步的副本
OSR（Out sync replica）非正常同步的副本

ref

• https://github.com/debezium/debezium-ui/tree/main/oc-demo

• 标签 kafka