To use this Apache Druid extension, and druid-kafka-extraction-namespace
in the extensions load list.
If you need updates to populate as promptly as possible, it is possible to plug into a Kafka topic whose key is the old value and message is the desired new value (both in UTF-8) as a LookupExtractorFactory.
The consumer properties group.id
and CANNOT be set in kafkaProperties
as they are set by the extension as UUID.randomUUID().toString()
and smallest
respectively.
See lookups for how to configure and use lookups.
Testing the Kafka rename functionality
To test this setup, you can send key/value pairs to a Kafka stream via the following producer console:
Renames can then be published as followed by newline (enter or return)