1. Entropy is a broken measurement<p>2. This is incorrect<p>3. There is no concept of entropy for a specific finite sequence<p>Do you see what you did there? Entropy is  limited concept if you want to advance compression beyond certain limit.<p>General note: There is tendency of commentators to nit-pick  blog posts as if being in debate where the goal is to win. It would be more valuable if we would read the article and try to interpret the intended meaning behind them favorably. Of course there are parts that are over-simplified or incorrect. This is just writing in the blog, not fully thought out edited and peer reviewed writing.