Hello,
I want to store the kafka offset externally and this plainPartitionedManualOffsetSource seems to be a good fit for my use case. I have a working code without any commit using plainSource that uses slick to push the data to Postgres. I am using Slick.flow for that.
I need to change the code so that
a) i should be able to be able to load the offset during source creation. Partition and groupId are provided from the config. IE, i should be able to provide offset, partition and groupId apart from topic.
b) store the offset after inserting the data to postgres
For this Slick.flowWithPassThrough seems to be fine.
I do not find any example to how to create the consumer with plainPartitionedManualOffsetSource in java. I am unable to follow scala.
Can someone direct me to proper example or provide documentation for both plainPartitionedManualOffsetSource and Slick.flowWithPassThrough ?
Thanks and Regards
2 posts - 2 participants
