Information, Quantum Computing, Physics.
general definition for Shannon Entropy S, here p is the probability of occurrence for a given point i in a range of k possible points (such as k=2 for binary code) of distribution A. Note the convention of log base 2, we will abbreviate this to just “log” going forward. It is further demonstrated