Pulsar IO connectors enable you to easily create, deploy, and manage connectors that interact with external systems, such as Apache Cassandra, , and many others.
Pulsar IO connectors come in two types: source and sink.
下图说明了 source、Pulasr 和 sink 之间的关系:
通用的 source 包括其它消息系统和流水式数据管道 API。
想要了解 Pulsar 内置 source 连接器的完整列表,参阅 source connector。
Common sinks include other messaging systems and SQL and NoSQL databases.
了解 Pulsar 内置 sink 连接器的完整列表,参阅 。
Processing guarantees 用于处理向 Pulsar 主题写入消息时发生的错误。
Source: Pulsar ensures that writing messages to Pulsar topics respects to the processing guarantees. It is within Pulsar’s control.
Sink: the processing guarantees rely on the sink implementation. If the sink implementation does not handle retries in an idempotent way, the sink does not respect to the processing guarantees.
创建连接器时,可以使用以下语义设置 processing guarantee:
ATLEAST_ONCE
EFFECTIVELY_ONCE
Here takes Admin CLI as an example. For more information about REST API or JAVA Admin API, see here.
Source
Sink
了解更多关于 的信息,参阅。
创建连接器后,可以使用以下语义更新 processing guarantee:
ATLEAST_ONCE
ATMOST_ONCE
EFFECTIVELY_ONCE
Here takes Admin CLI as an example. For more information about REST API or JAVA Admin API, see here.
Source
Sink
了解更多关于 pulsar-admin 源代码更新
的信息,参阅。
了解更多关于 pulsar-admin sinks 更新
的信息,参阅这里。
可以通过 、sources 和 子命令来管理 Pulsar 连接器(例如,创建、更新、启动、停止、重启、重载等操作)。