Changes

<math>

<math>

S=-k_B \sum_{i=1}^N p_i \log p_i

S=-k_B \sum_i^N p_i \log p_i

</math>

</math>

where <math>k_B</math> is the Bolzmann constant. This definition is closely related to ideas in [[information theory]], where the definition of information content is very similar to the definition of entropy.

This definition is closely related to ideas in [[information theory]], where the definition of information content is very similar to the definition of entropy.

===Entropy in information Theory===

===Entropy in information Theory===