Same issue here. I solved it by using Cogrouping like here https://cwiki.apache.org/confluence/display/KAFKA/KIP-150+-+Kafka-Streams+Cogroup