Information-theoritic OED Criteria#
Information-theoretic OED criteria are based on summaries of the information content or expected information gain. The most commonly used are the expected information gain (EIG Criterion), and the KL-divergence Criteria between prior and the posterior in Bayesian OED.