Currently, additional properties for the KafkaStreamReader have to be specified with the prefix reader.options. E.g. reader.options.kafka.security.protocol or reader.options.kafka.ssl.key.password
This prefix is inconsistent with all other properties which start with decoder.avro., writer.parquet., manager.checkpoint or transformer.columns.. The properties for the KafkaStreamReader should start with reader.kafka., i.e. reader.kafka.options.kafka.security.protocol.
For additional properties like reader.options.failOnDataLoss or reader.options.minPartitions it's hard to find out which reader implementation they belong to.
Tasks
- Change prefix for additional properties for
KafkaStreamReader to reader.kafka.options.
How to migrate
- All property keys starting with
reader.options have to be replaced by reader.kafka.options
Currently, additional properties for the
KafkaStreamReaderhave to be specified with the prefixreader.options.E.g.reader.options.kafka.security.protocolorreader.options.kafka.ssl.key.passwordThis prefix is inconsistent with all other properties which start with
decoder.avro.,writer.parquet.,manager.checkpointortransformer.columns.. The properties for theKafkaStreamReadershould start withreader.kafka., i.e.reader.kafka.options.kafka.security.protocol.For additional properties like
reader.options.failOnDataLossorreader.options.minPartitionsit's hard to find out which reader implementation they belong to.Tasks
KafkaStreamReadertoreader.kafka.options.How to migrate
reader.optionshave to be replaced byreader.kafka.options