title: Flume use hdfs sink. How to ensure data integrity when hdfs is not available?
body: <p>When hdfs is not available, is there an approach to make sure the data security? The scenario is: kafka-source, flume memory-channel, hdfs-sink. What if the flume service is down, does it can store the offset of topic's partitions and consume from the right position after recovery?</p>