Machine Learning, NLP, Information Technology, Data, AI.
Binary Erasure Channel (BEC). Each bit is erased with probability p Assume that we want to transmit the bit “0”. If we send it once, there is a significant chance (p) that it won’t survive. We can try sending it twice, and reduce that probability to , but we will pay a heavy price in rate — we will