Changes

== History of applications ==

== History of applications ==

A comprehensive outline of applications such as tele-communication, channel coding, computer science, physics, neurobiology, electrical engineering and so on may be found in Wikipedia.  

A comprehensive outline of applications such as telecommunication, channel coding, computer science, physics, neurobiology, electrical engineering and so on may be found in Wikipedia.  

Less well known is the use of information theory in simulated evolution by random search. For instance, the average speed of a random walk with Gaussian distributed steps in a hypercube or simplex is proportional to  -P log( P ), where P is the average probability that a step will lead to a new point inside the hypercube, Kjellström, 1969. This may be interpreted as the self-information –log(P) divided by the work or time – proportional to 1/P – needed to get the information on the average. A more general theorem of efficiency based on information theory may be found in a paper by Kjellström, 1991.

Less well known is the use of information theory in simulated evolution by random search. For instance, the average speed of a random walk with Gaussian distributed steps in a hypercube or simplex is proportional to  -P log( P ), where P is the average probability that a step will lead to a new point inside the hypercube, Kjellström, 1969. This may be interpreted as the self-information –log(P) divided by the work or time – proportional to 1/P – needed to get the information on the average. A more general theorem of efficiency based on information theory may be found in a paper by Kjellström, 1991.