Hi I have an architecture similar to the image shown below.

I have two kafka producer which will send messages to kafka topic with frequent duplicate messages.

Is there a way that I can handle the situation in a easy manner something like service bus topic.

Thank you for your help.

[![enter image description here](https://i.stack.imgur.com/FILKR.png)](https://i.stack.imgur.com/FILKR.png)