The principle explicates a biological system’s attempt to maintain order by restricting itself to a finite set of states. The systems minimise a free energy function of their internal states requiring beliefs about hidden states of the external world.
The brain is trying to balance making predictions while minimising surprise. No predictions at all would result in a constant level of surprise with everything. Whereas predictions with 100% certainty would result in massive surprise at any other outcome.