DataStream Connectors

Connectors provide code for interfacing with various third-party systems. Currently these systems are supported:

• Apache Kafka (source/sink)
• (source/sink)
• Elasticsearch (sink)
• (sink)
• RabbitMQ (source/sink)
• (source/sink)
• Hybrid Source (source)
• (source/sink)
• Twitter Streaming API (source)
• (sink)

Filesystem source formats are gradually replaced with new Flink Source API starting with Flink 1.14.0.

• Apache ActiveMQ (source/sink)
• (sink)
• Redis (sink)
• (sink)
• Netty (source)

Using a connector isn’t the only way to get data in and out of Flink. One common pattern is to query an external database or web service in a or FlatMap in order to enrich the primary datastream. Flink offers an API for to make it easier to do this kind of enrichment efficiently and robustly.

Queryable State