Information theory MOC Shannon entropy The Shannon entropy or information-theoretic entropy of a discrete random variable is the Expectation of its Shannon information , info where corresponds to the unit , corresponds to the unit , and corresponds to the unit . Shannon entropy is closely related to thermodynamic entropy. develop | en | sembr