information entropy
expected value of the amount of information delivered by a message
redundancy
in information theory, extra bits transmitted without adding information
joint entropy
measure of information in probability and information theory
expected value of the amount of information delivered by a message