Machine Learning, Entropy, Information Theory, Python.
in information theory: In 1948 Claude Shannon published “Mathematical theory of communication” also known as Information theory. Information is fundamental unit of communication . If S is the source of information emitiing symbols {s1, s2, …sn} with probability {p1, p2,...pn} then expected amount