Here is a pdf going briefly into kafka comparison and design motivation <a href="http:&#x2F;&#x2F;goo.gl&#x2F;J9XdsG" rel="nofollow">http:&#x2F;&#x2F;goo.gl&#x2F;J9XdsG</a> . During my time at twitter I remember when Twitter switch from Kafka to distributedlog. They have an internal layer that adapts Kafka API to distributedlog, I am not sure if they have open sourced that